2026-10-11 17:12 UTC

Independent testing will determine whether Unsloth’s Kimi K3 GGUF quantizations enable stable local inference on consumer or workstation hardware at useful speed and quality.

state: resolvedheat: lowuncertainty: mediumnovelscott: lowkimi-k3 gguf local-inference open-modelsUnsloth

What is this?

Kimi K3 is described as Moonshot AI’s 2.8-trillion-parameter open-weight model, aimed notably at coding and agentic workloads, with third-party estimates putting its unquantized weights near 1.4 TB. The supplied results establish that Unsloth previously produced aggressively compressed GGUF builds for Kimi K2, but they do not directly verify the claimed Kimi K3 GGUF release or demonstrate stable, useful local performance. Given conflicting availability claims and the model’s extreme hardware demands, independent tests are still needed to establish speed, quality, memory requirements, and stability on consumer or workstation systems.

Why it matters to Scott

No Scott-wiki or radar intersection was found. The case concerns his general local/open-model territory, but it currently offers only an unverified testing hypothesis rather than results that would change what he builds or argues.
queries asked of Scott's wikis
  • GGUF quantization quality versus capability loss
  • local inference economics for frontier open models
  • consumer hardware limits for sparse mixture-of-experts models
  • open weights versus practically runnable models
  • local coding-agent model evaluation harnesses
  • memory offloading and multi-device inference

Measured heat

no measured readings yet β€” the hourly heat pass fills this in

How the heat travelled

no chain yet β€” the hourly chain pass fills this in

Evidence (6) β€” ⭐ canonical anchor

sourceobjectauthorscorecomments
🟠 redditUnsloth Kimi-K3 is out
LocalLLaMA
synth_mania68
🟧 echo.github ⭐Unsloth released GGUF distributions of Kimi K3.Unslothβ€”β€”
🟠 redditI got Kimi-k3 running.....
LocalLLaMA
Aroochacha10974
🟠 redditUnsloth has begun dropping Kimi K3 GGUFs. The MXFP4 (it's 1.5 TB) and mmproj are already there.
LocalLLaMA
_TheWolfOfWalmart_443109
🟧 hnRunning Kimi K3 on a M1 Mactito12685
🟧 hnRan Moonshot's 2.8T-parameter Kimi K3 on a GPU-less mini-PCmanuelslemos10

Interpretation history

Decision trace