DeepSeek v4.1 Flash Stretches to Four DGX Sparks
@MiaAI_lab posts an 8,000,000-token KV cache pool, 1M context, and 134 tok/s at 16 streams.
@MiaAI_lab released official DeepSeek v4.1 Flash weights for four DGX Sparks, with no quantization and a passed 1M-context needle test. Default settings give eight concurrent sessions at 1M context each, backed by an 8,000,000-token KV cache pool. Speeds: 45 tok/s on single-stream prose, 73 on two streams, 134 on 16. @u1tra_instinct helped test at TP=4, and @MiaAI_lab's cluster guide pegs the MikroTik CRS504 switch at about $759 for four-box builds, at roughly 98% of pricier switches' performance.
GLM 5.3 Flash Adds a Three-Spark Path and 500K Downloads
@MiaAI_lab's TP=3 path lifts decode 28% over TP=2; @0xSero counts 500K Hugging Face downloads.
@MiaAI_lab added a TP=3 path for GLM 5.3 Flash EXL3: decode up 28% and prefill up 9% versus TP=2, with a 3.2M KV cache and 1M context, no switch required. Head-node weight sharing via NFS_SHARE=1 frees disk on the other Sparks. @0xSero's tracker puts the model past 500K downloads on Hugging Face, 100M impressions on X, and 9k GitHub stars.
A Dual-Spark Recipe Squeezes 3.65M Cache Tokens From Qwen
MiaAI-Lab's GitHub recipe runs Qwen3.8-Flash-Next at TP2+EP+MTP3; fp8 KV cache lifts concurrency to 13.93x.
The MiaAI-Lab dual-Spark repository documents measured numbers, not estimates: an fp8 KV cache pool of 3,652,200 tokens, 13.93x concurrency at 262,144 context, and 32.02 GiB of KV on each node. Batch-1 decode runs 54.4 tok/s, rising to 207.0 tok/s across eight streams. MTP=3 lifts decode from 24.5 to 52.1 tok/s, a 2.13x gain at 72.8% draft acceptance. Cold start takes about 10m55s, and weights claim 68.52 GiB per GPU.
Qwen 3.8 Flash Next Hits 67 tok/s on a Solo Spark
@vr8vr8 matches his two-Spark speed on one box; @sudoingX logs the model at 180B MoE, 512 experts.
@vr8vr8 published a solo-box recipe running Qwen 3.8 Flash Next at 67 tok/s, the same speed his two-Spark v2 build managed, with nvme offload costing about 7 tok/s. His two-Spark post the day before logged 100 tok/s with HumanEval 95.7, GSM8K 98.0, IFEval 91.5/93.4, and MMLU-Pro 84.9. @sudoingX started benching after a week of hype went quiet and counts a 180B MoE with 512 experts, 10 plus 1 active, and 186K downloads.
A 510GB DeepSeek Model Runs on One 128GB Spark
@TeksEdge profiles @0xBakeer's expert-caching build: 17.1 tok/s prose, 98GB resident, 44.1% of experts hot.
DeepSeek-V4.1-Flash weighs roughly 510GB on disk, and one DGX Spark holds 128GB. @TeksEdge reports @0xBakeer's experimental build keeps 6,779 of 15,360 experts hot, 44.1% of the routed pool at 98GB resident, and still posts 17.1 tok/s on prose, 28.2 on JavaScript, and 36.6 on HTML games. An earlier full expert-streaming version managed about 3 tok/s. Arena.ai's card adds +4.87% net improvement at $0.07 per median task on Agent Arena.