2026-10-11 17:21 UTC

Independent evaluation will determine whether Unbounded Labs’ released 2.82B-parameter Bart model, trained from scratch on 20.1B tokens of pre-1931 English, provides a useful testbed for historical-language behavior and novel-idea generation.

state: expiredheat: lowuncertainty: highknownscott: lowopen-models small-language-models training-dataUnbounded Labs

What is this?

The case describes “Bart,” a 2.82B-parameter model allegedly trained from scratch by Unbounded Labs on 20.1B tokens of pre-1931 English, intended for experiments in historical-language behavior, idea generation, and controlled-data evaluation. However, the supplied search results instead document “Talkie,” a different 13B-parameter open-weight model associated with Alec Radford, Nick Levine, and David Duvenaud and likewise trained on pre-1931 text. The snippets therefore support the broader research pattern—historically bounded corpora as low-contamination testbeds—but do not independently establish Bart’s release, specifications, ownership, or claimed research value.

Why it matters to Scott

Scott’s Future-Leakage Rule already captures the core position: temporally freeze available knowledge to avoid contamination during historical evaluation. Bart would be another possible implementation of that principle, but the supplied material neither establishes the model’s release nor provides evaluation results that would extend or challenge Scott’s position.
ip:concept.future-leakage-ruleip:concept.cognitive-provenanceradar:concept.model-evaluationradar:concept.benchmark-integrityradar:concept.open-model-trainingradar:concept.small-models
queries asked of Scott's wikis
  • historically bounded training data and contamination-free evaluation
  • small language models as controlled experimental testbeds
  • training-data cutoffs and knowledge provenance
  • novel idea generation versus memorization
  • open-weight models for scaling-law research
  • dataset curation and temporal knowledge boundaries

Measured heat

no measured readings yet — the hourly heat pass fills this in

How the heat travelled

no chain yet — the hourly chain pass fills this in

Evidence (2) — ⭐ canonical anchor

sourceobjectauthorscorecomments
🟠 reddit ⭐Bart: A vintage llm
LocalLLaMA
soggydoggy812836
🟠 redditBart- A vintage llm [R]
MachineLearning
soggydoggy87523

Interpretation history

Decision trace