2026-10-11 16:38 UTC

ColorsOfCosmos claims a hands-on mini-benchmark of three Qwen 3.8 variants across four thinking-effort levels on recent AtCoder problems shows material performance differences that should inform local coding-agent model selection on consumer GPUs.

state: seedheat: mediumuncertainty: mediumnovelscott: mediumqwen38-thinking-effort local-coding-benchmarks consumer-gpu-inferenceColorsOfCosmos

What is this?

The web results confirm Qwen 3.8 exists in multiple variants โ€” a 2.4T parameter Max model (cloud-scale, not consumer-runnable), a 27B model (targeted for local deployment), and Qwen3-Coder-Next (3B activated / 80B total MoE, designed for local coding agents). Qwen3's architecture includes controllable 'thinking effort' via reasoning budget, which the Qwen blog describes as scalable performance correlated with thinking depth. However, none of the returned snippets mention ColorsOfCosmos or a specific mini-benchmark across three variants ร— four thinking-effort levels on recent AtCoder problems. The case's central claim โ€” a hands-on controlled comparison by this author โ€” is not corroborated in the supplied material.

Why it matters to Scott

The case claims a first controlled benchmark of Qwen 3.8 thinking-effort tradeoffs for local coding agents on consumer GPUs โ€” territory that directly bears on Scott's model-selection framework (cost-tiered routing, task-aware routing, plan-forecast routing), his hardware-aware local inference policy, and his trace-backed agent comparison methodology. However, the grounding stage found no corroboration of the ColorsOfCosmos benchmark in the supplied material, so the claim remains unverified. If validated, it would inform routing decisions for his Ask agent and gamepc model zoo; as-is, it's a relevant but unconfirmed signal.
dev:concept.hardware-aware-local-inferencedev:project.gamepcdev:technology.ollamadev:concept.cost-tiered-llm-routingdev:concept.trace-backed-agent-comparisondev:concept.task-aware-model-routingdev:technology.litellmdev:project.askdev:concept.plan-forecast-model-routingradar:claude-code-effort-controlsradar:program-of-layers-dynamic-inferenceradar:ornith-15-open-model-validationradar:airllm-low-vram-model-streamingradar:edge0-streaming-moe-releaseradar:agent-review-studio-local-evaluationradar:addom-local-coding-harness
queries asked of Scott's wikis
  • local-coding-benchmark-methodology thinking-effort tradeoffs
  • consumer-gpu-inference model-selection framework coding-agents
  • qwen-model-family evaluation local-deployment
  • reasoning-budget control evaluation harnesses
  • atcoder competitive-programming benchmark local-models

Measured heat

now 0 pts/hpeak 2 pts/hcomments 0/hpeers p18momentum: steady1 platformsage 22h
points/hour across evidence ยท reading as of 2026-10-12 02:59:37.977291+11:00 ยท deterministic, not a model opinion

How the heat travelled

10-10 18:10โญ origin directly observedI asked 3 Qwen 3.8 models to solve recent AtCoder problems at 4 thinking efforts
ColorsOfCosmos on r/LocalLLaMA
โ€”
10-10 18:10amplified on r/LocalLLaMA ๐Ÿ‘‘reddit.post.1x2ly4g
ColorsOfCosmos
peak 3 ยท 7 comments ยท 101% of case engagement
10-10 18:35our radar first saw it ยท +0.4hdiscovery anchor: reddit.post.1x2ly4gโ€”
pace: p59 vs 923 stories at the 12h mark (now 22h old) โ€” ahead of agent-incidental-xmrig-detection (1.2x), behind github-git-agent-scale-infrastructure (0.9x)

Evidence (1) โ€” โญ canonical anchor

sourceobjectauthorscorecomments
๐ŸŸ  reddit โญI asked 3 Qwen 3.8 models to solve recent AtCoder problems at 4 thinking efforts
LocalLLaMA
ColorsOfCosmos07

Interpretation history

Decision trace