TensorFold Recipes Arrive for GLM 5.3 Flash and Qwen3.8 27B
Mia's AI Lab ships two TensorFold recipes: 2.7M KV tokens on two Sparks, 220 tok/s on one.
TensorFold, Ash Hart’s engine, headlined October 1 on the Spark timeline. @MiaAI_lab published a recipe for GLM 5.3 Flash EXL3 on two DGX Sparks. Defaults: 1M context, a 2.7M-token KV cache pool and four concurrent streams. Prose decode runs 60 tok/s single stream and 108 tok/s at four streams, with prefill near 1,950 tok/s. She thanks @ashxhart for the engine and calls it the best model to run on two Sparks.
The same lab followed with Qwen3.8 27B on one Spark: 256k context by default, extendable to 1M with YaRn, a 2.5M-token KV cache and eight concurrent sessions. Prose decode runs 58.3 tok/s single stream, 108.5 at two streams and 220 at eight, which @MiaAI_lab puts at 2x faster single stream with TensorFold. Full vision support, image and video, ships with the GLM recipe.
@ashxhart, the engine’s author, reports 63 tok/s decode on GLM 5.3 across two Sparks, and @markargyelan_ measured the pair drawing 37 to 45 watts. Asked whether decode could reach 100 tok/s, he answers “I do think it’s possible.” @datachad calls the 1,950 tok/s prefill the line that matters, against the 13 minutes a cold 262k fill takes on his M3 Pro.