Contents TandemLLM Docs
v0.14.2
Star58

TandemLLM in brief, from the website

License, paper and credits

License

The engine is AGPL-3.0-only for everyone, or under a commercial license for use without the AGPL's obligations. The docs are CC BY 4.0. The weights derived from Qwen are Apache-2.0; the Nemotron packs carry NVIDIA's OpenMDW-1.1.

Commercial license

Paper

Khaled Bakeer. StairCut: sizing speculative draft trees on a measured verification-cost staircase. 2026. Zenodo, 10.5281/zenodo.23045275.

The paper measured commit 431ddee; release v0.2.0-staircut is its code.

Community weights

Packs other people publish sit in the Setup Guide next to ours, each with its author and its Hugging Face repository. Adding one takes a pull request with one JSON file, and a maintainer runs it on a DGX Spark before the entry says verified.

The community packs Add your pack

TandemLLM builds on Qwen's models, turboderp's exllamav3, Inco AI's DFlash2 drafter, NVIDIA's Nemotron models and LiLiCorr drafters, LiquidAI's LFM2.5, PyTorch and Triton.

TandemLLM 0.14.2, manual of October 2026. Built 2026-10-23. The text is CC BY 4.0.