Contents TandemLLM Docs
v0.8.3
Star58

Release notes, v0.8.3

TandemLLM 0.8.3 on GitHub, published 2026-10-13. The changelog chapter of this version: Changelog summary; the full file: CHANGELOG.md.

TandemLLM jumps from 0.3.0 to 0.8.3 in this release. These notes cover everything in between; the full history is in CHANGELOG.md, and the manual is attached as a PDF.

Models and weights

  • Qwen3.8-Flash-Next runs on the same engine as the 27B, with the full 262,144-token window, image input and up to 3 chats at once.
  • Weight profiles: the 27B runs in NVFP4 or as an EXL3 quant from 2.5 to 6.0 bits a weight. ops/use-profile.sh <name> switches between them.
  • Six EXL3 quants of the 27B and their drafters are public on Hugging Face, in one collection.
  • Community weights: anyone can add a quant with one JSON file in a pull request, and the setup page fetches the list from GitHub (docs/community-weights.md). The first one is ThinkingCap by @0xWhiteMage.
  • A complete EXL3 pack of the 27B family loads directly as the model (#1 by @0xWhiteMage).
  • A new DGX Spark downloads every file a profile needs with no Hugging Face token, and checks each one against the hub.

Speed and memory

  • Drafting is priced per context length. Where a drafted round costs more than a plain step, the engine takes the plain step, so speculation is never slower than plain decoding.
  • Flash-Next drafts with its own draft layer, and text lookup goes into the same round.
  • One shared KV pool: every slot can reach 262,144 tokens, and memory is mapped as a conversation grows.
  • The small helper models give memory back when it runs short and come back later.
  • Decoding no longer stops while another chat prefills.
  • Saved conversations survive restarts and upgrades: the disk cache identifies its files by content.

The dashboard

  • A setup guide with Wren, a small model that explains each step and can fill in the form for you.
  • A Chat tab (beta). A run keeps going when the browser closes, and another device picks it up mid-answer. Tools run in a sandbox, with terminal, preview and file panes, MCP servers, skills, plan mode with rewind, and Ask, Auto or YOLO modes. Long runs compact their context, and a panel shows what fills it.
  • A phone layout: four tabs plus More, and a composer with every control in view.

The conductor

  • Before a turn reaches the model, the conductor picks the task class, the thinking effort, the packages and skills and the memory notes, and guards the answer as it streams.
  • Every client sees one model, TandemLLM, and it names the model it really runs.
  • Other backends (DeepSeek, vLLM, SGLang) sit behind the same proxy and ledger.

Known limitations

  • The Chat tab is in beta. The agent loop gets its next round of work in the coming release.
  • No video input. The Flash-Next 5.05 pack doesn't load yet.
  • Several chats at once aren't faster in total than one after another, only quicker to start.

Install

curl -fsSLO https://raw.githubusercontent.com/0xBakeer/TandemLLM/v0.8.3/install.sh
bash install.sh --setup --yes
~/TandemLLM/run/ops/use-profile.sh flashnext-3.05

Thanks to @0xWhiteMage for the first outside pull request and the first community quant.

Files of the release