EXL3 Recipes Mapped for Every VRAM Tier
An independent teacher-logit panel puts EXL3 at 0.004 nats from BF16 on GLM-5.3-Flash.
@yume_arasaki publishes one EXL3 recipe per VRAM tier, from 8 GB cards to four Sparks. On the independent teacher-logit panel he cites for GLM-5.3-Flash, EXL3 at 4 bits per weight sits 0.004 nats from the uncompressed BF16 teacher; NVFP4 sits at 0.06, 2.5x further. His picks: Qwen3.8-27B at 2.2bpw for a 3060 12GB, 155 to 212 tok/s on an RTX 5090, DeepSeek-V4.1-Flash at 45.5 to 51.5 tok/s per stream on 2x DGX Spark, and a four-Spark Pollard pack at 54.7 tok/s single stream with 1M context.
EXL3 Outruns NVFP4 on a Single DGX Spark
Same GB10 hardware: 78.3 vs 31.0 tok/s single request, 47 s vs 200+ s cold load.
@Oluwaphilemon1 and @ViC305 post the same head to head on Qwen3.8-Flash-Next over a DGX Spark GB10: EXL3 at 3.05 bpw versus NVFP4 through vLLM. Single-request decode runs 78.3 vs 31.0 tok/s, per-token time 13.2 vs 53.4 ms, and a 96-token answer finishes in 1.80 s vs 3.55 s. At 8-way concurrency the aggregate favors NVFP4, 64.8 vs 52.0 tok/s, and both warn the ~600 vs ~150 figures are harness-reported metrics, not wall-clock throughput.
MiMo-V2.6-Flash Gets Two Runtimes and Full Omni
EAGLE wins prose at 35 tok/s; DFlash takes code to 190 tok/s at eight streams.
@MiaAI_lab ships MiMo-V2.6-Flash for 2x DGX Sparks with native 1M context and a 2.9M KV cache pool. EAGLE MTP decodes 35 tok/s prose and 46 code single stream, 120 and 138 at eight streams; DFlash trades prose for code at 26 and 70 single, 190 code at eight. Prefill reaches up to 2500 tok/s. @Tech2Wild updates the repo with image, video and audio, 159 tok/s aggregate at six streams and 0.33s TTFT.
Gemini Flash 3.8 Sessions Went Off the Rails
Users saw degraded sessions; Google's Logan Kilpatrick points to a hardware serving failure.
@doodlestein documents Gemini Flash 3.8 breaking down mid-session on a routine repo sync prompt, then reporting a "severe processing error". He links a string of users who hit the same behavior the same day. Logan Kilpatrick of Google replies that teams are on it and a hardware serving failure appears to be causing issues like this.
Aikido Opens Weights on Altar-1 Security Model
@pilvar222 calls it GLM-5.3-level cybersecurity that enterprises can run on their own hardware.
Aikido Security introduced Altar-1, its first open-weight security model, and @pilvar222 describes it as GLM-5.3-level cybersecurity running locally for sensitive environments. In replies he sizes realistic serving at 4x H200 and says the team also uses the model to fix its own product. @sethforprivacy is testing it against a 4x Spark deployment.
A 4B Pirate Model in Seven Minutes of Training
@jvr0x distills Qwen3.6-35B-A3B answers into Qwen3-4B with 743 examples on a DGX Spark.
@jvr0x walked through fine-tuning a 4B model to speak like a pirate captain on his DGX Spark: 743 training examples, 7 minutes 20 seconds of training, no system prompt. The trick is distillation, with Qwen3.6-35B-A3B served locally as teacher through his lmswitch tool. His first run taught nothing: 60 steps on the generic FineTome-100k covered 480 of 100,000 examples.