Sparse Crosscoders for diffing MoEs and Dense models
arXiv:2603.05805v1 Announce Type: new Abstract: Mixture of Experts (MoE) achieve parameter-efficient scaling through sparse expert routing, yet their internal representations remain poorly understood compared to dense models. We present a systematic comparison of MoE and dense model internals using crosscoders,...
MoE Lens -- An Expert Is All You Need
arXiv:2603.05806v1 Announce Type: new Abstract: Mixture of Experts (MoE) models enable parameter-efficient scaling through sparse expert activations, yet optimizing their inference and memory costs remains challenging due to limited understanding of their specialization behavior. We present a systematic analysis of...
Self-Auditing Parameter-Efficient Fine-Tuning for Few-Shot 3D Medical Image Segmentation
arXiv:2603.05822v1 Announce Type: new Abstract: Adapting foundation models to new clinical sites remains challenging in practice. Domain shift and scarce annotations must be handled by experts, yet many clinical groups do not have ready access to skilled AI engineers to...
Stock Market Prediction Using Node Transformer Architecture Integrated with BERT Sentiment Analysis
arXiv:2603.05917v1 Announce Type: new Abstract: Stock market prediction presents considerable challenges for investors, financial institutions, and policymakers operating in complex market environments characterized by noise, non-stationarity, and behavioral dynamics. Traditional forecasting methods often fail to capture the intricate patterns and...
Omni-Masked Gradient Descent: Memory-Efficient Optimization via Mask Traversal with Improved Convergence
arXiv:2603.05960v1 Announce Type: new Abstract: Memory-efficient optimization methods have recently gained increasing attention for scaling full-parameter training of large language models under the GPU-memory bottleneck. Existing approaches either lack clear convergence guarantees, or only achieve the standard ${\mathcal{O}}(\epsilon^{-4})$ iteration complexity...
Preventing Learning Stagnation in PPO by Scaling to 1 Million Parallel Environments
arXiv:2603.06009v1 Announce Type: new Abstract: Plateaus, where an agent's performance stagnates at a suboptimal level, are a common problem in deep on-policy RL. Focusing on PPO due to its widespread adoption, we show that plateaus in certain regimes arise not...
Latent Diffusion-Based 3D Molecular Recovery from Vibrational Spectra
arXiv:2603.06113v1 Announce Type: new Abstract: Infrared (IR) spectroscopy, a type of vibrational spectroscopy, is widely used for molecular structure determination and provides critical structural information for chemists. However, existing approaches for recovering molecular structures from IR spectra typically rely on...
DC-Merge: Improving Model Merging with Directional Consistency
arXiv:2603.06242v1 Announce Type: new Abstract: Model merging aims to integrate multiple task-adapted models into a unified model that preserves the knowledge of each task. In this paper, we identify that the key to this knowledge retention lies in maintaining the...
Gradient Flow Polarizes Softmax Outputs towards Low-Entropy Solutions
arXiv:2603.06248v1 Announce Type: new Abstract: Understanding the intricate non-convex training dynamics of softmax-based models is crucial for explaining the empirical success of transformers. In this article, we analyze the gradient flow dynamics of the value-softmax model, defined as ${L}(\mathbf{V} \sigma(\mathbf{a}))$,...
Will the Pentagon’s Anthropic controversy scare startups away from defense work?
On the latest episode of TechCrunch’s Equity podcast, we discussed what the controversy means for other startups seeking to work with the federal government.
Owner of ICE detention facility sees big opportunity in AI man camps
AI data center developers are increasingly relying on a style of camp popularized as housing for men working in remote oil fields.
A roadmap for AI, if anyone will listen
The Pro-Human Declaration was finalized before last week's Pentagon-Anthropic standoff, but the collision of the two events wasn’t lost on anyone involved.
Google just gave Sundar Pichai a $692M pay package
Most of it is tied to performance, including new stock incentives linked to Waymo and Wing, its drone delivery venture.
Grammarly’s ‘expert review’ is just missing the actual experts
A recently-added feature in Grammarly purports to improve users’ writing with help from the world's great writers and thinkers — and some tech journalists, too.
Symposia Archive - Minnesota Law Review
2024–25 Environmental and Energy Regulation Reformation: Challenges and Solutions After West Virginia v. EPA, Sackett v. EPA, and Loper Bright Enterprises v. Raimondo 2023–24 Aiming for Answers: Balancing Rights, Safety, and Justice in a Post-Bruen America 2022–23 Leaving Langdell Behind:...
A HAZY FIVE HOURS: MINNESOTA SHOULD NOT REINVENT THE WHEEL IN ADDRESSING THC BEVERAGES IN RESTAURANTS - Minnesota Law Review
By Shannon Schooley, Volume 108 Staff Member In 2023, Minnesota legalized recreational cannabis.[1] Although Minnesota followed twenty-two states and the District of Columbia in doing so,[2] its legal landscape presents unique regulatory challenges.[3] Minnesota’s full-scale recreational legalization comes on the...
READY, AIM, FIRE? EVALUATING THE FUTURE OF LIABILITY FOR THE FIREARMS INDUSTRY DURING NEW-WAVE PLCAA LITIGATION - Minnesota Law Review
By: Will Roberts, Volume 108 Staff Member I. MECHANISMS FOR FIREARMS INDUSTRY LIABILITY In 2005, Congress enacted the Protection of Lawful Commerce in Arms Act (PLCAA) which significantly shielded members of the firearms industry from civil liability for over a...
Clinics & Experiential Learning
At Vanderbilt Law School, we firmly believe that a comprehensive legal education extends beyond textbooks and lecture halls. Our dynamic legal clinics, enriching experiential learning programs, and open-ended externships
A NEW TAKE ON TAKINGS: BIG PHARMA’S CONSTITUTIONAL CHALLENGES TO BIDEN’S INFLATION REDUCTION ACT - Minnesota Law Review
By: Marie Lundgren, Volume 108 Staff Member I. BACKGROUND In 2003, Congress passed the Medicare Modernization Act, marking the largest expansion of benefits in the 38-year history of U.S. public healthcare.[1] When the Medicare program was first enacted in 1965,...
Why fairness cannot be automated: Bridging the gap between EU non-discrimination law and AI
Public Interest
The Vanderbilt Law School Public Interest Office prepares students for fulfilling and sustainable public interest careers through robust advising, programming, and community support. It fosters a culture of public service by providing the vision, training, and opportunities to serve the...
Office of Culture & Community
Our community brings together those with diverse backgrounds, perspectives, identities, and preferences, and each member contributes to school life through their own distinctive set of viewpoints, experiences, and ideas.We celebrate this diversity. We cherish it.We believe that it can fully...
Career Services for Employers
2026 Winter Mingle January 28th, 2026 at the Music City Center in Nashville, TNThis year’s Winter Mingle will take a slightly different approach, bringing together all VLS students for the event. It’s an excellent opportunity to connect with students and...
Judicial Clerkship Program
A judicial clerkship is one of the most prestigious and valuable experiences available to a recent law graduate. Judicial clerks gain inside knowledge of how parties pursue actual cases and how judges resolve legal issues. They receive exposure to substantive...
Dual-Degree Programs
J.D./M.B.A. J.D./M.S. Finance J.D./M.D. J.D./Divinity School J.D./Masters in Education Policy (M.P.P.) Customized Dual-Degree Program Students who wish to pursue a dual-degree program with a graduate
Curbing Private Enforcement of the Voting Rights Act: Thoughts on Recent Developments
For decades, private plaintiffs have brought claims to enforce key provisions of the Voting Rights Act (VRA). Recent decisions have tossed out these claims on the ground that enforcement authority lies solely with the Attorney…The postCurbing Private Enforcement of the...
Call for Submissions for Second Annual Student Essay Competition
The Virginia Law Review (VLR) Online is excited to announce the topic for our second annual essay competition. This competition is open to all current law students (including LLMs) and recent graduates (from the Classes of 2018–2021) from any ABA-accredited...
The keys to sustainable competitive advantage
The World Court’s Enforcement Dilemma — And How to Solve It
VanderbiltVanderbilt
Quick Guide First-Year Applicants Transfer Applicants International Applicants High School Counselors Apply Dates & Deadlines MyAppVU Visit Campus Request Info Find Your Major Contact a Student The Admissions Blog Financial Aid & Scholarships Nashville Information for Small Town and