University of Waterloo's ProgramAsWeights team claims its project compiles English function descriptions into locally callable CPU models, potentially replacing repeated API inference for narrow Python tasks.
state: seedheat: lowuncertainty: highconvergesscott: mediumlocal-inference small-model-specialization llm-toolingUniversity of Waterlooyuntiandeng
What is this?
Program-as-Weights (PAW) is a University of Waterloo-associated research project and Python package that turns English specifications for narrow, fuzzy text tasks into reusable neural artifacts callable locally as Python functions, without per-call API requests. The supplied author listing names Wentao Zhang, Liliana Hotsko, Woojeong Kim, Pengyu Nie, Stuart Shieber, and Yuntian Deng; the original paper describes a 4B compiler producing programs for a fixed 0.6B interpreter rather than fine-tuning separately for each task. The results also include a distinct “Compile by Training” repository that generates teacher examples and fine-tunes a small model, so its mechanism should not be conflated with the original compiler. CPU execution is described in a secondary snippet, but the supplied excerpts do not establish independently measured task accuracy, speed, or cost savings.
Why it matters to Scott
Waterloo-associated PAW converges with Scott’s code-callable, reusable AI capabilities and extends his existing Ollama bulk-classification setup with a concrete alternative worth benchmarking: compile narrow English task specifications into local neural artifacts rather than repeatedly prompting a general model. This is not established as a replacement—accuracy, CPU speed and amortized savings remain unverified, and neural artifacts do not establish the regeneration guarantees required by The Prompt Is Source; the radar’s AgentJIT and compiled-agent-skills pages track adjacent approaches, not this development.
ip:framework.code-first-architectureip:framework.the-prompt-is-sourcedev:technology.ollamadev:concept.model-to-model-delegationradar:agentjit-trajectory-compilationradar:compiled-agent-skills-token-reductionradar:concept.local-inferenceradar:concept.small-models
queries asked of Scott's wikis
- local inference economics versus repeated API calls
- task-specialized small models versus general LLMs
- natural-language specifications compiled into executable artifacts
- reusable AI functions in coding-agent tooling
- evaluation and reproducibility of fuzzy text functions
- local neural functions for RAG ranking and log filtering
Measured heat
now 0 pts/hpeak 0 pts/hcomments 0/hpeers p50momentum: steady2 platformsage 4322h
points/hour across evidence · reading as of 2026-10-12 02:59:37.977291+11:00 · deterministic, not a model opinion
How the heat travelled
Evidence (3) — ⭐ canonical anchor
Interpretation history
2026-09-25T05:27:28Z
A first-hand attempt to run the compiler locally found the MLPProgramPrefixMapper component absent from the public repo, apparently deployed only on the authors' hosted compiler server — so PAW's 'compile once' step is not fully local or open even though compiled programs still run locally. This reframes the case from a fully-local pipeline to local-runtime/server-compiled, weakening the local-first pitch; accuracy and savings remain unverified.
2026-09-20T00:23:20Z
The added post is another announcement by the same project author, not independent corroboration or a new release. Its Python example clarifies the interface but does not establish whether compilation delivers useful accuracy or savings over repeated inference.
2026-09-20T00:22:25Z
evidence attached: reddit.post.1wl13eu — This independently surfaces the released ProgramAsWeights artifact and clarifies its compile-once, local-runtime workflow.
2026-09-18T20:33:18Z
grounded: converges/medium — Waterloo-associated PAW converges with Scott’s code-callable, reusable AI capabilities and extends his existing Ollama bulk-classification setup with a concrete
2026-09-18T20:24:55Z
origin walked (codex/luna, conf 0.91): anchor reddit.post.1wk0w5b -> echo.other.383078fe13 by Yuntian Deng (@yuntiandeng)
2026-09-18T20:23:47Z
case created — The builder describes a concrete compile-once execution path distinct from the existing Jev episode, although implementation and performance evidence remain sparse.
Decision trace
- 10-07 21:39review_dormantscheduled targets exhausted or 28 quiet days
- 10-07 21:39drop_targetsquiet through full ladder or over cap 8
- 09-25 15:27repriceA first-hand attempt to run the compiler locally found the MLPProgramPrefixMapper component absent from the public repo, apparently deployed only on the authors' hosted compiler server — so PAW&#
- 09-25 15:26jev_reprice_gatechanges_anything noul=0.68 would_skip=False
- 09-25 15:26review_screenA new first-hand report states a compiler component (MLPProgramPrefixMapper) is missing from the public repository and exists only on the hosted compiler server. This is new evidence contradicting the
- 09-25 15:26review_screenjev screen borderline (noul=0.64) — luna review
- 09-23 02:21sensor_dirtycomment_update
- 09-22 09:24review_screenjev screen: no material development (noul=0.04)
- 09-21 14:20sensor_dirtycomment_update
- 09-20 18:26review_screenThe changes add only speculative questions about determinism, tool calls, and LoRA training; they provide no new implementation results, independent evidence, or consequential changes.
- 09-20 10:23repriceThe added post is another announcement by the same project author, not independent corroboration or a new release. Its Python example clarifies the interface but does not establish whether compilation
- 09-20 10:22attachThis independently surfaces the released ProgramAsWeights artifact and clarifies its compile-once, local-runtime workflow.
- 09-20 10:22propose_attachThis independently surfaces the released ProgramAsWeights artifact and clarifies its compile-once, local-runtime workflow.
- 09-19 06:33groundWaterloo-associated PAW converges with Scott’s code-callable, reusable AI capabilities and extends his existing Ollama bulk-classification setup with a concrete alternative worth benchmarking: compile
- 09-19 06:24promote_anchororigin walk conf 0.91
- 09-19 06:23createThe builder describes a concrete compile-once execution path distinct from the existing Jev episode, although implementation and performance evidence remain sparse.