2026-10-11 17:21 UTC

Independent testing will determine whether Lumabri can practically distribute storage and inference for very large MoE models across ordinary networked computers.

state: expiredheat: lowuncertainty: highconvergesscott: mediumdistributed-inference local-inference mixture-of-expertsJustVugg

What is this?

Lumabri is a Show HN project, apparently presented by JustVugg, proposing a Napster-like network that pools storage, compute, and model components from ordinary computers to run models too large for any one machine. The supplied background confirms that distributed inference can shard large models across nodes, but also identifies high-bandwidth communication—and especially MoE all-to-all traffic—as a major bottleneck. Despite the web answer’s assertion, none of the supplied snippets documents independent testing of Lumabri itself, so its practical performance, latency, reliability, and cost on ordinary networks remain unestablished.

Why it matters to Scott

Lumabri independently applies the volunteer-computing pattern Scott encountered through ChessBrain to his active territory of hardware-aware local inference, extending it from distributed chess search to sharded MoE execution on ordinary machines. This is more than a generic infrastructure example because credible benchmarks could inform whether his local model-serving work can practically scale beyond one machine, but Lumabri itself remains untested and the radar already follows adjacent distributed-loading and MoE-inference experiments.
work:project.chessbrain-netdev:concept.hardware-aware-local-inferencedev:project.gamepcradar:concept.moe-inferenceradar:concept.local-inferenceradar:llama-cpp-rpc-parallel-loading
queries asked of Scott's wikis
  • peer-to-peer distributed inference on commodity hardware
  • MoE communication bottlenecks and expert routing
  • local inference beyond single-machine memory limits
  • heterogeneous unreliable compute pooling
  • model sharding over ordinary networks
  • decentralized AI infrastructure economics

Measured heat

no measured readings yet — the hourly heat pass fills this in

How the heat travelled

no chain yet — the hourly chain pass fills this in

Evidence (2) — ⭐ canonical anchor

sourceobjectauthorscorecomments
🟧 hnShow HN: Lumabri – What if LLMs worked like Napster?vforno88
🟧 echo.github ⭐Lumabri proposes pooling storage, compute, and model components across a network of ordinary computers to run models too large for one machiJustVugg——

Interpretation history

Decision trace