PETS: A Principled Framework Towards Optimal Trajectory Allocation for Efficient Test-Time Self-Consistency
arXiv:2602.16745v1 Announce Type: new Abstract: Test-time scaling can improve model performance by aggregating stochastic reasoning trajectories. However, achieving sample-efficient test-time self-consistency under a limited budget remains an open challenge. We introduce PETS (Principled and Efficient Test-TimeSelf-Consistency), which initiates a principled study of trajectory allocation through an optimization framework. Central to our approach is the self-consistency rate, a new measure defined as agreement with the infinite-budget majority vote. This formulation makes sample-efficient test-time allocation theoretically grounded and amenable to rigorous analysis. We study both offline and online settings. In the offline regime, where all questions are known in advance, we connect trajectory allocation to crowdsourcing, a classic and well-developed area, by modeling reasoning traces as workers. This perspective allows us to leverage rich existing theory, yielding theoretical guarante
arXiv:2602.16745v1 Announce Type: new Abstract: Test-time scaling can improve model performance by aggregating stochastic reasoning trajectories. However, achieving sample-efficient test-time self-consistency under a limited budget remains an open challenge. We introduce PETS (Principled and Efficient Test-TimeSelf-Consistency), which initiates a principled study of trajectory allocation through an optimization framework. Central to our approach is the self-consistency rate, a new measure defined as agreement with the infinite-budget majority vote. This formulation makes sample-efficient test-time allocation theoretically grounded and amenable to rigorous analysis. We study both offline and online settings. In the offline regime, where all questions are known in advance, we connect trajectory allocation to crowdsourcing, a classic and well-developed area, by modeling reasoning traces as workers. This perspective allows us to leverage rich existing theory, yielding theoretical guarantees and an efficient majority-voting-based allocation algorithm. In the online streaming regime, where questions arrive sequentially and allocations must be made on the fly, we propose a novel method inspired by the offline framework. Our approach adapts budgets to question difficulty while preserving strong theoretical guarantees and computational efficiency. Experiments show that PETS consistently outperforms uniform allocation. On GPQA, PETS achieves perfect self-consistency in both settings while reducing the sampling budget by up to 75% (offline) and 55% (online) relative to uniform allocation. Code is available at https://github.com/ZDCSlab/PETS.
Executive Summary
The article introduces PETS, a principled framework for optimal trajectory allocation to achieve efficient test-time self-consistency. PETS formulates trajectory allocation as an optimization problem, leveraging the self-consistency rate as a measure of agreement with the infinite-budget majority vote. The framework is applied to both offline and online settings, yielding theoretical guarantees and efficient allocation algorithms. Experimental results demonstrate that PETS outperforms uniform allocation, achieving perfect self-consistency while reducing sampling budgets by up to 75% in offline and 55% in online settings.
Key Points
- ▸ Introduction of PETS, a principled framework for trajectory allocation
- ▸ Formulation of trajectory allocation as an optimization problem using the self-consistency rate
- ▸ Application to both offline and online settings with theoretical guarantees and efficient allocation algorithms
Merits
Theoretical Grounding
PETS provides a theoretically grounded approach to trajectory allocation, enabling rigorous analysis and optimization
Efficient Allocation
The framework yields efficient allocation algorithms, reducing sampling budgets while achieving perfect self-consistency
Demerits
Limited Scope
The article focuses on a specific problem domain, which may limit the applicability of PETS to other areas
Expert Commentary
The introduction of PETS marks a significant advancement in the field of test-time self-consistency. By formulating trajectory allocation as an optimization problem, PETS provides a theoretically grounded approach to achieving efficient test-time scaling. The framework's ability to adapt to both offline and online settings, while preserving strong theoretical guarantees and computational efficiency, makes it a valuable tool for practitioners and researchers alike. Further research is needed to explore the applicability of PETS to other domains and to investigate potential limitations and challenges.
Recommendations
- ✓ Future research should investigate the applicability of PETS to other problem domains and explore potential extensions and modifications
- ✓ Practitioners should consider adopting PETS as a means to improve model performance and reduce sampling budgets in their respective applications