전체 전문분석자료

전문분석자료

Academic · 약 1분

Warm Starting State-Space Models with Automata Learning

arXiv:2603.05694v1 Announce Type: new Abstract: We prove that Moore machines can be exactly realized as state-space models (SSMs), establishing a formal correspondence between symbolic automata …

William Fishell, Sam Nicholas Kouteili, Mark Santolucito
조회수 89회
Academic · 약 1분

Bridging Domains through Subspace-Aware Model Merging

arXiv:2603.05768v1 Announce Type: new Abstract: Model merging integrates multiple task-specific models into a single consolidated one. Recent research has made progress in improving merging performance …

Levy Chaves, Chao Zhou, Rebekka Burkholz, Eduardo Valle, Sandra Avila
조회수 60회
Academic · 약 1분

Sparse Crosscoders for diffing MoEs and Dense models

arXiv:2603.05805v1 Announce Type: new Abstract: Mixture of Experts (MoE) achieve parameter-efficient scaling through sparse expert routing, yet their internal representations remain poorly understood compared to …

Marmik Chaudhari, Nishkal Hundia, Idhant Gulati
조회수 24회
Academic · 약 1분

MoE Lens -- An Expert Is All You Need

arXiv:2603.05806v1 Announce Type: new Abstract: Mixture of Experts (MoE) models enable parameter-efficient scaling through sparse expert activations, yet optimizing their inference and memory costs remains …

Marmik Chaudhari, Idhant Gulati, Nishkal Hundia, Pranav Karra, Shivam Raval
조회수 24회