One terabyte of pooled memory, a faster all-reduce for switched clusters, and a $4,999 64 GB Spark today.
NVIDIA now supports eight-node DGX Spark clusters with 1 TB of unified memory, its technical blog says. Its NVFP4 build of the full 753B GLM-5.3, about 470 GB, decodes at 31 tok/s for one user on eight boxes.
428B total, 23B active, about 252 GB; a four-Spark recipe hits 46.5 tok/s on prose.
MiniMax-M3.1-Flash open weights are live, @MiaAI_lab reports: 428B parameters, 23B active, about 252 GB. NVIDIA reposted day-zero NVFP4 support.
A 3.06 bpw EXL3 pack and a 203.5 GB GGUF fit 256 GB; neither has a Spark result yet.
@MiaAI_lab says a TensorFold recipe for two Sparks is coming and her EXL3 quant is ready. Its card lists about 171 GB, every routed expert at 3 bits, and no quality or engine test yet.
77.0 to 73.7 on DeepSWE; MiniMax wins Automation-Bench. @MiaAI_lab ranks DeepSeek first of what you can run.
In MiniMax’s own benchmark table, DeepSeek V4.1 Flash 1017 beats M3.1 Flash on DeepSWE v1.1, 77.0 to 73.7, and on Terminal Bench 4.0, 42.3 to 38.1, @MartinSzerment notes. MiniMax wins Automation-Bench, 62.8 to 60.5.
EAQ v1.1 makes the original’s token picks 403,560 of 403,560 times; v1 stays the recommended pack.
@MiaAI_lab released DeepSeek-V4.1-Flash EXL3-EAQ v1.1, an experimental quant that keeps the sparse-attention indexer path in full BF16. Fed the original model’s inputs, it makes the exact same picks past 16k, 403,560 of 403,560, against 94.95% for v1.
7.5 tok/s over llama.cpp RPC, 325k tokens out, and 12 of 12 tests passing at the end.
@sudoingX gave Ling 3.1 Flash, a 560B MoE, one prompt on four borrowed DGX Sparks and never touched it again. In Q4 GGUF over llama.cpp RPC with Hermes Agent driving, it ran 12 hours 26 minutes at 7.5 tok/s decode.
The model does not fit in 128GB, so experts stream from an NVMe drive over USB4.
@jgattermayer runs DeepSeek V4.1 Flash 1017 on a Strix Halo box with two second-hand RX 7900 XTX cards. The Maya-S GGUF does not fit in 128GB, so experts stream from an NVMe drive over USB4.
An open challenge on Macs and DGX Spark: 144.8 to 959.6 tok/s, with exact-token checks.
Bonsai 2 9B decode went from 144.8 to 959.6 tok/s on Apple Silicon in one week, @pratikg explains. The weights were frozen, anyone could change the engine, and every run on an M5 Max or DGX Spark had to produce exactly the reference tokens.