A frozen 0.6B model runs LoRA adapters compiled from English

ProgramAsWeights compiles a plain-English task description into a LoRA adapter, then runs it on a frozen 0.6B parameter model, per a University of Waterloo project described on r/MachineLearning.

The split matters for production classification work, where the task rarely changes but the inputs always do. Most setups still pay a large model's inference cost on every single call regardless.

A finetuned Qwen3-4B model acts as the compiler. It generates a task-specific LoRA adapter for a frozen Qwen3-0.6B interpreter. Alongside the adapter, it also produces a pseudo-program, a cleaned version of the task description plus a set of few-shot examples.

The interface is one function call. paw.compile_and_load("Classify urgent emails") compiles the task, then inference runs on CPU with no external API calls.

The post doesn't say how the 0.6B interpreter's accuracy compares to the 4B compiler's, or how often a task description needs a rewrite. Recompiling means running the 4B model again, and there's no data yet on how that scales.