2026-10-11 17:12 UTC

RV Embedded reports training a GPT from scratch in C on a RISC-V microcontroller without an FPU using 37KB of code, potentially providing a reproducible reference for model training on severely constrained hardware.

state: expiredheat: lowuncertainty: highnovelscott: lowembedded-ml tiny-models risc-vRV Embedded

What is this?

The case attributes to RV Embedded a report of training a GPT from scratch in C on a RISC-V microcontroller without a floating-point unit (FPU). The directly relevant web snippet is a first-person Reddit claim of GPT training with no FPU in “37KB of Memory,” whereas the case’s evidence titles say “37KB of code”; the supplied snippets do not resolve that distinction or independently establish the RV Embedded attribution. They also provide no model size, training results, runtime, or source-code availability, so reproducibility and practical usefulness remain unestablished.

Why it matters to Scott

No meaningful intersection found with Scott’s documented positions or builds: his hardware-aware local inference work concerns runtime policy, not microcontroller training, and scarce hardware memory does not establish a connection to his attention-budget framework. The radar tracks related tiny-model and plain-C training developments, but not this report; unresolved code-versus-memory accounting and absent training results or source availability leave no demonstrated reason to change what Scott builds or argues.
radar:trip-plain-c-transformer-stackradar:webgpu-direct-gguf-trainingradar:concept.tiny-modelsradar:concept.risc-vradar:concept.microcontrollers
queries asked of Scott's wikis
  • on-device training versus inference constraints
  • tiny language models resource-constrained hardware
  • local AI compute memory economics
  • minimal C model implementations reproducible training
  • embedded systems RISC-V projects

Measured heat

no measured readings yet — the hourly heat pass fills this in

How the heat travelled

no chain yet — the hourly chain pass fills this in

Evidence (2) — ⭐ canonical anchor

sourceobjectauthorscorecomments
🟧 hnTraining a GPT from scratch in C on a RISC-V MCU with no FPU, in 37KB of codearmstrongsubero32
🟧 echo.blog ⭐The linked article is titled “Training a GPT from scratch in C on a RISC-V MCU with no FPU, in 37KB of code.”RV Embedded——

Interpretation history

Decision trace