2026-10-11 18:00 UTC

Independent replication will determine whether GitHub pull requests and scheduled Actions can coordinate decentralized language-model training beyond a toy 15M-parameter run without dedicated infrastructure or centralized training control.

state: expiredheat: lowuncertainty: highnovelscott: noneopen-models collaborative-training github-actionscommonsense-ai

What is this?

The evidence titles describe a commonsense-ai repository that coordinates community training of a 15M-parameter language model through Hugging Face pull requests, DiLoCo pseudo-gradient submissions, and a scheduled GitHub Actions job. The supplied web snippets establish that decentralized training has reached 10B parameters and beyond using specialized aggregation, networking, and substantial GPU resources, but they do not independently verify this GitHub-based experiment or show that its infrastructure-free coordination pattern scales beyond the toy run. Independent replication and scaling therefore remain an open hypothesis in the supplied material.

Why it matters to Scott

No intersection found in Scott’s wikis, and no radar page already tracks this experiment, actor, or coordination pattern. The supplied material leaves replication and scaling beyond the 15M-parameter toy run unresolved.
queries asked of Scott's wikis
  • Git-native coordination for distributed compute
  • DiLoCo and low-bandwidth collaborative training
  • CI/CD systems as agent or training infrastructure
  • permissionless open-model training strategy
  • decentralized training trust and contribution verification
  • community compute economics versus dedicated clusters

Measured heat

no measured readings yet — the hourly heat pass fills this in

How the heat travelled

no chain yet — the hourly chain pass fills this in

Evidence (2) — ⭐ canonical anchor

sourceobjectauthorscorecomments
🟧 hnStrangers pretrained a language model with HF PRs and a cron jobsomevyn10
🟧 echo.github ⭐The repository’s root commit is titled “bootstrap: community-trained LM via DiLoCo pseudo-gradient PRs” and describes workers submitting psePierre Guirguis——

Interpretation history

Decision trace