Install, step by step, TandemLLM v0.14.2 documentation

You need a DGX Spark: a GB10 GPU with 128 GB of memory shared by CPU and GPU. Other CUDA GPUs are best effort. Two commands install TandemLLM; neither needs a Hugging Face token.

bash, release 0.14.2

curl -fsSLO https://raw.githubusercontent.com/0xBakeer/TandemLLM/v0.14.2/install.sh
bash install.sh --setup --yes

The installer checks the board, builds a pinned Python environment and downloads only Wren's model, 4.3 GB. Then it starts setup mode. No model is loaded yet.
Open the Setup Guide in your browser and pick a model. On the box, the address is http://127.0.0.1:8000/dashboard/#/setup.
The guide checks that your choice fits in memory, downloads the weights, checks every file and starts the engine on port 8000.

From another computer

Setup mode listens on the box itself only. Open an SSH tunnel to the box, then open the same address on your computer:

ssh -L 8000:127.0.0.1:8000 <user>@<box>

Or add --host 0.0.0.0 to the install command, and open http://<box>:8000/dashboard/#/setup from any computer on your network.

The dashboard asks for no password until you set one. Until then, anyone who can reach the port can run the setup and change what it shows, so keep the engine on a trusted network.

The Setup Guide walks through the model, its weights, the tools beside it and the parallel requests in eight steps, shows every change and then installs it. Wren, a small model on the box, answers questions on the side.

Advanced: from the command line

The Setup Guide runs use-profile.sh for you. To pick the weights from a shell instead, after the two commands:

~/TandemLLM/run/ops/use-profile.sh --list                # every profile
~/TandemLLM/run/ops/use-profile.sh <profile> --dry-run   # each file's URL and size
~/TandemLLM/run/ops/use-profile.sh <profile>             # download, check, start

Setup guide The manual, one PDF Release notes of 0.14.2 Changelog