2026-10-11 18:02 UTC

The ARC-AGI Without Pretraining author claims ARC-AGI tasks can be solved competitively without pretrained foundation-model knowledge, challenging pretraining as a prerequisite for abstract reasoning.

state: expiredheat: lowuncertainty: highconvergesscott: mediumarc-agi reasoning-research

What is this?

CompressARC is a 76K-parameter neural model that starts from random initialization and trains separately on each target ARC-AGI puzzle at inference time, using minimum description length rather than pretrained knowledge or an external dataset. The supplied research post and arXiv snippet report scores of 34.75% on the training set and 20% on the evaluation set, with roughly 20 minutes of processing per puzzle on an RTX 4070. The author, identified in the supplied sources only by the handle “iliao2345,” presents this as evidence that abstract generalization on ARC-AGI can emerge from compression-driven test-time learning without foundation-model pretraining; the snippets do not independently validate the claimed competitiveness or broader implications.

Why it matters to Scott

CompressARC extends Scott’s inference-time-scaling position from structured search and verification into per-task weight adaptation: useful reasoning may be assembled during inference rather than residing entirely in pretrained priors. If independently validated, its tiny randomly initialized model and compression objective could inform Scott’s reasoning-system and local-inference experiments, but the supplied evidence is still a single author’s unverified benchmark claim; the radar tracks adjacent ARC-AGI and test-time-learning work, not this same development.
ip:concept.inference-time-scalingip:source.the-hidden-architecture-of-better-ai-reasoningdev:concept.serial-intelligence-loopdev:concept.hardware-aware-local-inferenceradar:concept.arc-agiradar:ttt-discover-test-time-learningradar:littlelearner-pretraining-capability-ceilingradar:pathway-recurrent-arc-efficiency
queries asked of Scott's wikis
  • test-time training versus pretrained reasoning
  • compression and minimum description length as intelligence
  • small task-specific models versus foundation models
  • ARC-AGI and abstract generalization benchmarks
  • inference-time learning and model adaptation
  • reasoning without retrieval or prior knowledge

Measured heat

no measured readings yet — the hourly heat pass fills this in

How the heat travelled

no chain yet — the hourly chain pass fills this in

Evidence (2) — ⭐ canonical anchor

sourceobjectauthorscorecomments
🟧 hnARC-AGI Without Pretraining (2025)newsuser10
🟧 echo.blog ⭐This is the original research post, introducing CompressARC and arguing that “lossless information compression is sufficient to produce inteIsaac Liao and Albert Gu——

Interpretation history

Decision trace