Jayadev Billa

Academic · 약 1분

Modality Collapse as Mismatched Decoding: Information-Theoretic Limits of Multimodal LLMs

arXiv:2602.23136v1 Announce Type: new Abstract: Multimodal LLMs can process speech and images, but they cannot hear a speaker's voice or see an object's texture. We …

Jayadev Billa

조회수 69회 02.28

Academic · 약 1분

The Cascade Equivalence Hypothesis: When Do Speech LLMs Behave Like ASR$\rightarrow$LLM Pipelines?

arXiv:2602.17598v1 Announce Type: new Abstract: Current speech LLMs largely perform implicit ASR: on tasks solvable from a transcript, they are behaviorally and mechanistically equivalent to …

Jayadev Billa

조회수 51회 02.21

Academic · 약 1분

Anatomy of Capability Emergence: Scale-Invariant Representation Collapse and Top-Down Reorganization in Neural Networks

arXiv:2602.15997v1 Announce Type: new Abstract: Capability emergence during neural network training remains mechanistically opaque. We track five geometric measures across five model scales (405K-85M parameters), …

Jayadev Billa

조회수 57회 02.20

Jayadev Billa의 전문분석자료

Modality Collapse as Mismatched Decoding: Information-Theoretic Limits of Multimodal LLMs

The Cascade Equivalence Hypothesis: When Do Speech LLMs Behave Like ASR$\rightarrow$LLM Pipelines?

Anatomy of Capability Emergence: Scale-Invariant Representation Collapse and Top-Down Reorganization in Neural Networks

JCG, PC