Gemma 4 Arrives in Four Sizes, All Fine-Tunable Locally
@Sumanth_077 walks through fine-tuning all four Gemma 4 variants with Unsloth, from 8GB VRAM up.
Google released Gemma 4 in four sizes, E2B, E4B, 26B-A4B, and 31B, all Apache 2.0 and all multimodal. @Sumanth_077 reports AIME 2026 math at 89.2%, up from 20.8%, and LiveCodeBench at 80.0%, up from 29.1%. His Unsloth guide trains E2B LoRA on 8-10GB of VRAM, E4B LoRA on 17GB, and the 31B with QLoRA on 22GB, 1.5x faster with 60% less VRAM than standard training. Gemma 4 supports 140 languages.
DeepSeek V4.1 Flash Squeezes Onto One DGX Spark at 24.7 tok/s
@ViC305’s 1.59-bit recipe runs DeepSeek V4.1 Flash on one Spark; NVIDIA ships official NVFP4.
@Blackwellboy reports that Victor, posting as @ViC305, runs DeepSeek-V4.1-Flash on a single 128GB Spark at up to 24.7 tok/s with 1.59-bit SAGE-EXL3 experts, 91.2% top-1 agreement with the native FP4, and 97.9% on code. Model load takes about 40 seconds. @jvr0x adds that NVIDIA published an official NVFP4 version of DeepSeek V4.1 Flash on Hugging Face at 491GB. One commenter, @jayleaton, could not get it running outside a headless setup.
Kernel Rewrites Push Dual-Spark DeepSeek V4.1 Flash Up 50%
@wei_wang’s Cooperative MoE kernel lifts the EXL3 2.9bpw dual-Spark setup from 32 to 42 tok/s.
@wei_wang reports the dual DGX Spark DeepSeek V4.1 Flash setup sped up again: single-path prose went from about 32 tok/s to 42, and two-stream throughput from 42.5 to 63.7 tok/s, gains of about 33% and 50%. The new Cooperative MoE kernel batches the small expert matrix operations that MoE decoding spawns at low concurrency. Weights are unchanged, still EXL3 at 2.9 bpw, and 32K prefill barely moved. Real code tasks gained about 11% and inference about 29%.
Builders Show Jev-Style Decoding Works on Open Weights
@anderslie explains the fork-and-logits trick; @harshagundal ships a 1B model doing it.
@anderslie argues Jev’s speed comes from the inference path: label the choices, prefill the shared context, fork it per question, and read logits constrained to valid labels in one parallel pass. Jev’s own model, he notes, is trained to perform well in exactly that setting. @harshagundal shipped an open version, Qwen-2.5-1B-RLCD on Hugging Face, claiming 5x faster on-device inference for type-safe JSON workloads with no new training, demonstrated on an M4 MacBook and later playing Doom at 150ms latency.
Jev Reviews Pull Requests for $0.00007 Each
@redp314 runs 14 typed checks per diff at half a second, 7 cents per 1,000 PRs.
@redp314 wired Jev into pull-request review: one call to @typesafeai per diff returns 14 typed checks as probabilities, from hardcoded secrets to broken APIs, and anything between 0.35 and 0.65 confidence escalates to a human or a bigger model. He reports 6 real PRs at $0.00007 each, 1,000 PRs for 7 cents against roughly $14.50 on Opus 5, with answers in half a second.