GLM 5.3 Flash Recipe Hits 60.4 tok/s on Two Sparks
@MiaAI_lab's recipe serves 1M-token contexts, vision and up to 8 requests on two or three Sparks.
@MiaAI_lab's recipe page for GLM 5.3 Flash on two DGX Sparks publishes a full measurement table. Two Sparks decode one prose request at 60.4 tok/s, four at 108.8 combined, and prefill a 32k prompt at 1,978.9 tok/s. A third Spark wired as a triangle lifts single-stream prose to 77.6 tok/s and four-request throughput to 146.2.
The quant itself is rebuilt: routed experts at 4 bits, BF16 elsewhere. KL divergence to Z.AI's official FP8 release sits lower on all six test sets, 0.0903 against TR3-4bpw's 0.0990 on the wiki set. The page counts 16-37% fewer confident mistakes and about 10% shorter coding replies. GSM8K reads 98.8% and HumanEval 95.7%, with the gaps against TR3 going both ways and none statistically significant.
Prompt reuse is the sleeper feature: an identical 64k prompt sent again starts in under 0.07 seconds instead of 34, and a shared 7.9k system prompt drops from 4.24 seconds to 0.13. The stack runs TensorFold v0.6.0 with 75 patches, an FP8 KV cache pool near 2.9M tokens, RoCE between the Sparks, and optional Ablit weights behind a Responsible Use Agreement.