Beyond Subtokens: A Rich Character Embedding for Low-resource and Morphologically Complex Languages

arXiv:2602.21377v1 Announce Type: new Abstract: Tokenization and sub-tokenization based models like word2vec, BERT and the GPTs are the state-of-the-art in natural language processing. Typically, these …