Models & Hardware
An Experimental Kernel Lifts Qwen3.8-Flash-Next to 150 Tok/s on a Mac
@ashxhart reports 230 tok/s on code on his M3U Mac Studio, up from about 110.
Same Mac, same model, a new kernel: about 40% faster on prose, by his numbers.
@ashxhart says Qwen 3.8 Next Flash at 4 bits now hits over 150 tok/s on prose and 230 on code on his M3U Mac Studio, up from around 110. He calls it an experimental kernel he has been working on. @MiaAI_lab shared it: “150 tokens per sec on prose with Qwen3.8-Flash-Next.”
Separately, @ashxhart shipped TensorFold 1.1.3. It fixes image-chat caching for Flash Next, tool calls, reasoning and checkpoint loading, and restores Windows builds.
Sources
- @MiaAI_lab on X · Oct 23, 4:49 PM PT
- @ashxhart on X · Oct 23, 4:26 PM PT
- @ashxhart on X · Oct 23, 2:40 PM PT
- @MiaAI_lab on X · Oct 23, 4:31 PM PT