Jayadev Billa

Academic · 1 min

Modality Collapse as Mismatched Decoding: Information-Theoretic Limits of Multimodal LLMs

arXiv:2602.23136v1 Announce Type: new Abstract: Multimodal LLMs can process speech and images, but they cannot hear a speaker's voice or see an object's texture. We …

Jayadev Billa

37 views Feb 28

Academic · 1 min

The Cascade Equivalence Hypothesis: When Do Speech LLMs Behave Like ASR$\rightarrow$LLM Pipelines?

arXiv:2602.17598v1 Announce Type: new Abstract: Current speech LLMs largely perform implicit ASR: on tasks solvable from a transcript, they are behaviorally and mechanistically equivalent to …

Jayadev Billa

24 views Feb 21

Academic · 1 min

Anatomy of Capability Emergence: Scale-Invariant Representation Collapse and Top-Down Reorganization in Neural Networks

arXiv:2602.15997v1 Announce Type: new Abstract: Capability emergence during neural network training remains mechanistically opaque. We track five geometric measures across five model scales (405K-85M parameters), …

Jayadev Billa

26 views Feb 20

Articles by Jayadev Billa

Modality Collapse as Mismatched Decoding: Information-Theoretic Limits of Multimodal LLMs

The Cascade Equivalence Hypothesis: When Do Speech LLMs Behave Like ASR$\rightarrow$LLM Pipelines?

Anatomy of Capability Emergence: Scale-Invariant Representation Collapse and Top-Down Reorganization in Neural Networks

JCG, PC

HSOLLC Co., Ltd.