Masked Language Modeling
Dynamic masking
Masking strategy where masked tokens change at each training epoch, improving model robustness as in RoBERTa.
← KembaliMasking strategy where masked tokens change at each training epoch, improving model robustness as in RoBERTa.
← Kembali