Three Frontier Models, One Spark, About 38 Watts
Qwen3.8-Flash-Next, DeepSeek-V4-Flash and GLM-5.3-Flash served head to head on one 128 GB box.
@jvr0x fit three frontier-class models on one DGX Spark and ran the same benchmark on each: Qwen3.8-Flash-Next at 125B, DeepSeek-V4-Flash 0731 at 284B, and GLM-5.3-Flash at 320B. All three served locally at roughly 20 to 30 tok/s per stream while the box drew about 38W. With thinking on, Qwen scaled from 27.7 tok/s aggregate at one stream to 70.4 at four; DeepSeek reached 61.9; GLM held a single slot at 21.3.
The thinking toggle explained the fight over Mia's 40+ figure. Same server, same prompt: 23 to 27 tok/s with the reasoning trace on, 32 to 36 with it off, because a predictable answer lifts drafter acceptance while exploratory reasoning collapses it. @jvr0x: “the mode matters more than the quant, and nobody puts that in the headline.” He also credits @MiaAI_lab's PLE-offload trick, a 27 GB n-gram table memory-mapped on the CPU side.
His verdict: Qwen wins the concurrency game, DeepSeek is “right there” for a 284B model on one box, and GLM is “the solo specialist” with the lowest per-stream decay. The deeper point is what fits: “125B + 284B + 320B MoEs, each serving on a 128 GB box that draws less than a lightbulb per stream. Two years ago this was datacenter territory. Now it's a box under my desk.”