All Articles

Articles

Academic · 1 min

Faster Superword Tokenization

arXiv:2604.05192v1 Announce Type: new Abstract: Byte Pair Encoding (BPE) is a widely used tokenization algorithm, whose tokens cannot extend across pre-tokenization boundaries, functionally limiting it …

Craig W. Schmidt, Chris Tanner, Yuval Pinter
36 views
Academic · 1 min

Towards Scaling Law Analysis For Spatiotemporal Weather Data

arXiv:2604.05068v1 Announce Type: new Abstract: Compute-optimal scaling laws are relatively well studied for NLP and CV, where objectives are typically single-step and targets are comparatively …

Alexander Kiefer, Prasanna Balaprakash, Xiao Wang
33 views