Gradio Distills Qwen's 9B Image Rewriter for About $16
ML Intern in HuggingChat ran the whole project unattended in about 11 hours and pushed everything open.
Qwen-Image 2.1 draws its best pictures after a 9B prompt rewriter expands the request. Gradio says that teacher runs 20 GB in bf16, works from a 1,700-word system prompt, and thinks for about 1,600 tokens first. The team trained two students: a 0.8B at 812 MB as a GGUF and a 2B, each answering in about 450 tokens, 28% of the teacher's.
The pipeline was built by ML Intern, an agent living in HuggingChat. It wrote 8,797 requests in 18 languages, labelled them with Qwen's original 9B teacher, trained both students with TRL, and evaluated on text and rendered images. Total budget came to about $16: $0.75 for 30 minutes of training on one A10G, $6.54 for labels, $3.45 for evaluating 160 rendered images. About 80% of the cost was data and evaluation.
Everything is open: both models, the 8,797-request dataset with teacher thinking traces, every eval prediction, and the training and eval code, under the non-commercial Qwen Research License. Two Gradio Spaces let anyone compare the 9B teacher against the 0.8B and 2B students side by side on the same seed. A Rewriter Arena adds 40 pre-rendered comparisons against the raw prompt.