Vol. I · No. 1Edition: Mid-morningEst. 2026AboutSearchRSS

The Sand Paper

Finding grains of sand with grains of sand.
A Journal of Intelligence Transfer
ArchiveSeptember 2026
Lead Story · Models & Hardware

Seven Qwen3.8-27B Recipes, No Single Winner on a Spark

@0xBakeer ran all seven public Qwen3.8-27B recipes; the fastest alone is slowest in a crowd.

@0xBakeer ran all seven public recipes for serving Qwen3.8-27B on a DGX Spark, same prompts, two hours each, logging every row to his inference-atlas. The READMEs claim 48 to 152 tok/s. Measured alone, the spread runs 16.5 to 33.4 tok/s per request: r0b0tlab’s EXL3 build tops single-stream work at 33.4, while hiceron’s vLLM recipe sits at the bottom at 16.5.

Under load the order flips. OpenZeka, the slowest of the four SGLang recipes alone, delivers 132.8 tok/s at 8 chat streams and 171.2 at 16, because it offers 8 draft tokens instead of 16 and runs 12 requests at once. r0b0tlab stays flat at 47 to 52 while its per-request decode falls to 7.3 tok/s at 8 streams. The drafter is the dial: recipes keep 1.9 to 3.2 tokens per verify step, at 96 to 128 ms each.

The code-quality gap turned out to be a token cap, not the models. Full-length thinking tripped the 4,096-token output cap on 18 to 26 code items out of 140; scored on finished items, darkdatter passed 121 of 122 and OpenZeka 112 of 114. hasso5703, the one recipe serving a lean reasoning level, averaged 418 output tokens on code and scored 0.979. The lesson @0xBakeer draws: set a reasoning budget before comparing recipes on quality.

From @0xBakeer

Agents & Coding

Harness Choice Moves Cost More Than Accuracy

Across 7 models, @melissapan’s study finds harness choice drives cost more than success rate.

@melissapan and collaborators evaluated 7 models on Claude Code, Codex, and Pi. On SWE-bench Lite, Fable 5 hit 97.8% accuracy at $1.33 per rollout in Claude Code against 96.7% at $0.67 in Pi, twice the cost for a 1.1-point gain. Pi reached the Pareto frontier with four tools: read, write, edit, and bash. Claude Code’s mean initial context ran over 10x Pi’s, and GPT-5.6 Sol scored higher in Pi than in Codex.

From @melissapan

A 17-Person Company Runs on Hermes and a $60-a-Year Server

Artie runs the open-source Hermes agent harness from @NousResearch on a $60-a-year machine in Germany.

@JacquelineSYC19 describes how Artie’s 17-person team shares Hermes profiles for engineering, sales, design, and BizOps, with skills versioned in Git and a human reviewing every PR before it merges. The box cost $60 a year at Hetzner. Each night the agents “dream”: a cron job reviews the day’s work, promotes useful lessons into memory, and emails the engineer a report. Evals run on self-hosted Arize Phoenix with Datadog underneath.

From @JacquelineSYC19

DeepSeek 4.1 Flash Codes Well but Misses the Big Picture

@burkov finds the model a good coder on OpenCode that needs every small detail spelled out first.

@burkov tested DeepSeek 4.1 Flash in OpenCode and calls it a good coder that “doesn’t easily see the bigger picture”: every requirement must be stated before it will code, and role-play prompts such as “imagine you are a X” get taken literally. @buswe_com replied that writing the plan to a file with steps and file paths worked better than a role.

From @burkov

Models & Hardware

Gemma 4 Arrives in Four Sizes, All Fine-Tunable Locally

@Sumanth_077 walks through fine-tuning all four Gemma 4 variants with Unsloth, from 8GB VRAM up.

Google released Gemma 4 in four sizes, E2B, E4B, 26B-A4B, and 31B, all Apache 2.0 and all multimodal. @Sumanth_077 reports AIME 2026 math at 89.2%, up from 20.8%, and LiveCodeBench at 80.0%, up from 29.1%. His Unsloth guide trains E2B LoRA on 8-10GB of VRAM, E4B LoRA on 17GB, and the 31B with QLoRA on 22GB, 1.5x faster with 60% less VRAM than standard training. Gemma 4 supports 140 languages.

From @Sumanth_077

DeepSeek V4.1 Flash Squeezes Onto One DGX Spark at 24.7 tok/s

@ViC305’s 1.59-bit recipe runs DeepSeek V4.1 Flash on one Spark; NVIDIA ships official NVFP4.

@Blackwellboy reports that Victor, posting as @ViC305, runs DeepSeek-V4.1-Flash on a single 128GB Spark at up to 24.7 tok/s with 1.59-bit SAGE-EXL3 experts, 91.2% top-1 agreement with the native FP4, and 97.9% on code. Model load takes about 40 seconds. @jvr0x adds that NVIDIA published an official NVFP4 version of DeepSeek V4.1 Flash on Hugging Face at 491GB. One commenter, @jayleaton, could not get it running outside a headless setup.

From posts by @Blackwellboy, @jvr0x

Kernel Rewrites Push Dual-Spark DeepSeek V4.1 Flash Up 50%

@wei_wang’s Cooperative MoE kernel lifts the EXL3 2.9bpw dual-Spark setup from 32 to 42 tok/s.

@wei_wang reports the dual DGX Spark DeepSeek V4.1 Flash setup sped up again: single-path prose went from about 32 tok/s to 42, and two-stream throughput from 42.5 to 63.7 tok/s, gains of about 33% and 50%. The new Cooperative MoE kernel batches the small expert matrix operations that MoE decoding spawns at low concurrency. Weights are unchanged, still EXL3 at 2.9 bpw, and 32K prefill barely moved. Real code tasks gained about 11% and inference about 29%.

From @wei_wang

Builders Show Jev-Style Decoding Works on Open Weights

@anderslie explains the fork-and-logits trick; @harshagundal ships a 1B model doing it.

@anderslie argues Jev’s speed comes from the inference path: label the choices, prefill the shared context, fork it per question, and read logits constrained to valid labels in one parallel pass. Jev’s own model, he notes, is trained to perform well in exactly that setting. @harshagundal shipped an open version, Qwen-2.5-1B-RLCD on Hugging Face, claiming 5x faster on-device inference for type-safe JSON workloads with no new training, demonstrated on an M4 MacBook and later playing Doom at 150ms latency.

From posts by @anderslie, @harshagundal

Jev Reviews Pull Requests for $0.00007 Each

@redp314 runs 14 typed checks per diff at half a second, 7 cents per 1,000 PRs.

@redp314 wired Jev into pull-request review: one call to @typesafeai per diff returns 14 typed checks as probabilities, from hardcoded secrets to broken APIs, and anything between 0.35 and 0.65 confidence escalates to a human or a bigger model. He reports 6 real PRs at $0.00007 each, 1,000 PRs for 7 cents against roughly $14.50 on Opus 5, with answers in half a second.

From @redp314

Industry

China Telecom Open-Sources a 29B Agent Model, Apache 2.0

@jun_song flags China Telecom’s Xing4.0-29B-A4B, a 29B MoE activating 4B parameters per token.

@jun_song frames the release as the pace story: while the US argues about pacing the frontier, companies across China keep shipping open weights, following Meituan. Citing @ModelScope2022, he reports China Telecom’s Xing4.0-29B-A4B is a 29B MoE that activates 4B parameters for long-horizon agents, licensed Apache 2.0, and leads both comparison models on Claw-Eval and Terminal-Bench 2.1.

From @jun_song

Sources

  1. @0xBakeer on X
  2. @Sumanth_077 on X
  3. @melissapan on X
  4. @JacquelineSYC19 on X
  5. @Blackwellboy on X
  6. @jvr0x on X
  7. @wei_wang on X
  8. @anderslie on X
  9. @harshagundal on X
  10. @redp314 on X
  11. @jun_song on X
  12. @burkov on X
Wednesday, September 16, 2026Back to the ArchiveFriday, September 18, 2026