Long-Tail Knowledge in Large Language Models: Taxonomy, Mechanisms, Interventions and Implications

arXiv:2602.16201v1 Announce Type: new Abstract: Large language models (LLMs) are trained on web-scale corpora that exhibit steep power-law distributions, in which the distribution of knowledge …