New GLM 5.3 Flash Quant Arrives for Two DGX Sparks
@MiaAI_lab's 4-bit quant cuts 4-bit expert error by 28-46%; two-Spark builds decode at 57.4 tok/s.
@MiaAI_lab shipped a new 4-bit EXL3 quant of GLM 5.3 Flash built for TensorFold, the same format and size as the TR3 4bpw build most owners ran. @plotarmordev reports the calibration removes 28-46% of the error the 4-bit experts add and sits 2-18% closer to the full model on 7 of 8 test sets. The lab counts up to 37% fewer confident wrong picks.
@StevenDarlow put the weights on two DGX Sparks and recorded 57.4 tok/s median decode standard and 55.3 abliterated. An earlier run held 53 tok/s across a 1M-token context on the abliterated build. The recipe, the Hugging Face weights and PR #52 are public, so an owner with two Sparks can reproduce the numbers.
The lab says the quant is equal in coding, better in everything else, and thinks about 10% less than the old TR3 build; replies on coding tests run about 10% shorter. @MiaAI_lab answered a calibration challenge by posting that every full-precision tensor is byte-identical to zai-org's BF16 checkpoint, verified across all 1,618 of them.