Reddit builder KangarooAnxious9394's pre-registered experiments claim escalating a cheap coding agent (Haiku) to a strong model (Sonnet) only when it repeats mistakes added 7 successes in 63 runs at ~1.3x cost, beating an always-on advisor; independent replication on unseen repos would establish repeat-mistake-triggered escalation plus fact-reporting verification as a standard cheap-agent harness pattern.
state: seedheat: lowuncertainty: mediumconvergesscott: highagent-harnesses model-escalation cost-optimization
What is this?
A Reddit user (KangarooAnxious9394) cross-posted to r/codereview and r/LocalLLaMA a writeup titled 'I tested 20+ ways to make a cheap coding model act like an expensive one,' reporting that the winning intervention was selective escalation: a stronger model (Haiku → Sonnet) that only intervenes when the cheap agent repeats a mistake, adding +7 successes across 63 runs at roughly 1.3x cost, reportedly beating an always-on advisor setup. The snippets confirm the headline numbers only via the poster's own text — no independent replication, no details on methodology, task suite, or repos — so the claims are currently single-source self-reports.
Why it matters to Scott
An independent builder arrives at Scott's Model Barbell territory with a refinement his canon doesn't yet hold: mistake-recurrence as the escalation trigger (vs. budget, confidence, or task-type triggers he documents in cost-tiered routing and risk-based triage), plus a pre-registered beats-always-on-advisor number (+7/63 at ~1.3x) that is dated ammunition for his cheap-front-door economics. It is directly actionable — the trigger would slot into his LiteLLM tier chain and `ask` harness, and he already owns the fixtures (trace-backed comparison, brief A/B) to replicate it — though the note's caveat stands: single-source self-report, no independent replication yet, and the modest delta is itself evidence for his Scout–Senior claim that escalation routing alone is adjacent, not sufficient.
ip:concept.model-barbellip:concept.risk-based-triagedev:concept.cost-tiered-llm-routingdev:concept.cheap-model-front-doordev:concept.trace-backed-agent-comparisondev:project.askdev:technology.litellmradar:concept.model-routingradar:concept.inference-economicsradar:concept.agent-memoryradar:learned-router-task-identityradar:dynamic-model-switching-evaluationradar:haiku-sonnet-task-length-gapradar:multi-model-orchestrator-worker-agents
queries asked of Scott's wikis
- escalation routing cheap-to-strong model handoff in agent harnesses
- repeat-mistake detection as agent memory signal for triggering stronger models
- Haiku vs Sonnet cost-per-solved-task coding agent benchmarks
- selective critic/advisor pattern vs always-on verifier cost economics
- pre-registered experiment methodology for agent harness comparisons
Measured heat
now 0 pts/hpeak 0 pts/hcomments 0/hpeers p0momentum: steady1 platformsage 139h
points/hour across evidence · reading as of 2026-10-12 02:59:37.977291+11:00 · deterministic, not a model opinion
How the heat travelled
pace: p47 vs 1247 stories at the 96h mark (now 139h old) — ahead of aws-agentcore-credential-exposure-containment-failure (1.1x), behind asksary-liveloop-stateful-editing (0.9x)
Evidence (1) — ⭐ canonical anchor
Interpretation history
2026-10-06T01:13:35Z
grounded: converges/high — An independent builder arrives at Scott's Model Barbell territory with a refinement his canon doesn't yet hold: mistake-recurrence as the escalation trigger (vs
2026-10-06T01:06:41Z
case created — Quiet, downvoted post but unusually rigorous pre-registered methodology with directly transferable escalation-pattern numbers worth a cheap seed.
Decision trace
- 10-08 16:42review_screenjev screen: no material development (noul=0.29)
- 10-06 12:13groundAn independent builder arrives at Scott's Model Barbell territory with a refinement his canon doesn't yet hold: mistake-recurrence as the escalation trigger (vs. budget, confidence, or task-
- 10-06 12:06createQuiet, downvoted post but unusually rigorous pre-registered methodology with directly transferable escalation-pattern numbers worth a cheap seed.