Louis Est\`eve, Christophe Servan, Thomas Lavergne, Agata Savary

A Diversity Diet for a Healthier Model: A Case Study of French ModernBERT

arXiv:2602.22014v1 Announce Type: new Abstract: Diversity has been gaining interest in the NLP community in recent years. At the same time, state-of-the-art transformer models such …