Full GLM-5.3 Fits Four DGX Sparks at 319 GB
GLM-5.3 runs on four DGX Sparks at 41 tok/s from a 319 GB quant, every expert intact.
@ViC305 published GLM-5.3 SAGE EXL3 at 3.38 bpw, a 319 GB quant that keeps all 19,200 routed experts with no pruning or expert merging. On four DGX Sparks it averaged about 41 tok/s across six real prompts with the DFlash2 drafter, bursting to 69. It served 256K contexts and is sized toward a 1M-context memory target.
@ViC305 measured KL divergence of 0.082388 nats and BF16 top-1 agreement of 91.1523% over 10,240 scored positions kept out of calibration. @WescheNex1q reproduced the 753B recipe on a four-Spark cluster after four fixes. The list: build CUDA kernels before loading to avoid a warm-up OOM, one NFS copy of the 319 GB pack, hand-written hosts to fix cloned machine-ids, and swap off. The cluster logged 84.4, scripts open.
The goal, @ViC305 writes, is the highest-fidelity full GLM-5.3 possible on four Sparks without giving up the memory that 256K to 1M contexts need. @cfontes funded the compute behind the release. Drafted replies matched serial decoding token for token. @WescheNex1q credits @ViC305 for the quant and recipe, TensorFold, and @Zai_org’s DFlash2 drafter.