MrBERT: Modern Multilingual Encoders via Vocabulary, Domain, and Dimensional Adaptation
arXiv:2602.21379v1 Announce Type: cross Abstract: We introduce MrBERT, a family of 150M-300M parameter encoders built on the ModernBERT architecture and pre-trained on 35 languages and …