Together AI Releases Aurora — Open-Source RL Framework That Makes Speculative Decoding Self-Improving

Together AI Blog·medium signal

Together AI released Aurora, an open-source reinforcement learning framework that turns speculative decoding from a static one-time optimization into a continuously self-improving system. Aurora achieves 1.25x speedup over well-trained static speculators by learning from every inference request, adapting the draft model in real-time. For anyone running local inference at scale, this could meaningfully reduce cost-per-token without sacrificing quality.