2026-10-11 18:03 UTC

Byte-exact KV-cache grafting on frozen models will independently reproduce the reported routing improvement from 76.7% to 90.0% on AIME 2025 and generalize beyond Gemma 4.

state: expiredheat: lowuncertainty: highconvergesscott: mediumkv-cache-grafting agent-memory knowledge-persistence inferenceAGI Summit

What is this?

A preprint attributed in the snippets to Sietse Schelpe proposes storing verified solutions as byte-exact KV-cache state artifacts and grafting them into fresh inference contexts, improving a frozen model without weight updates or retrieval. For Gemma-4 12B, the supplied sources report conflicting AIME 2025 gains—76.7% to 90.0% in the Reddit post versus 80.0% to 93.3% in the AI Weekly summary—while the paper page claims bit-exact restoration under a pinned deterministic configuration. The snippets do not establish independent reproduction or generalization beyond Gemma 4; they only describe author-reported results and a planned AGI Summit pitch.

Why it matters to Scott

The reported mechanism converges with Scott’s Frozen Model Paradox and Scaffolding Hypothesis by moving adaptation into reusable artifacts around a frozen model, while potentially extending his long-running-agent architecture from semantic checkpoints to cached inference state. If independently reproduced across models it could affect his memory and local-inference designs, but the conflicting author-reported benchmark figures and lack of demonstrated portability keep it below high relevance.
ip:concept.frozen-model-paradoxip:concept.scaffolding-hypothesisip:framework.long-running-agentsip:concept.prefix-caching-economicsdev:concept.hardware-aware-local-inference
queries asked of Scott's wikis
  • persistent agent memory via KV-cache state
  • KV-cache portability and deterministic inference
  • frozen-model capability augmentation without retraining
  • verified knowledge artifacts versus RAG
  • benchmark validity for cached solutions
  • inference-state routing and reusable computation

Measured heat

no measured readings yet — the hourly heat pass fills this in

How the heat travelled

no chain yet — the hourly chain pass fills this in

Evidence (2) — ⭐ canonical anchor

sourceobjectauthorscorecomments
🟠 reddit ⭐Byte exact KV cache grafting on frozen Gemma 4
LocalLLaMA
MindPsychological1406726
🟠 redditWhat if OpenAI bought tech like byte-exact KV grafting to slash API token costs?
OpenAI
MindPsychological14003

Interpretation history

Decision trace