Rahul Thomas, Teo Kitanovski, Micah Goldblum, Arka Pal

Dynamic Delayed Tree Expansion For Improved Multi-Path Speculative Decoding

arXiv:2602.16994v1 Announce Type: new Abstract: Multi-path speculative decoding accelerates lossless sampling from a target model by using a cheaper draft model to generate a draft …