2026-10-11 17:21 UTC

Independent deployments will determine whether Lumabri and Colibri can serve mixture-of-experts models across peer-to-peer commodity machines with practically useful throughput and reliability.

state: expiredheat: lowuncertainty: highknownscott: mediumdistributed-inference moe-models local-inferenceLumabriColibriJustVugg

What is this?

Colibrì is an open-source inference engine from JustVugg that runs very large mixture-of-experts models on commodity hardware by staging only the routed experts across VRAM, RAM, and storage instead of keeping the full model in fast memory. Lumabri is presented as a peer-to-peer layer for distributing weights and executing experts across multiple machines, but the supplied snippets provide little independent detail about its implementation or measured reliability. Available reports characterize Colibrì as a proof of concept with a steep performance penalty—potentially useful for offline workloads, but currently too slow for ordinary real-time chat—and do not establish that independent Lumabri deployments have achieved practical throughput or reliability.

Why it matters to Scott

The radar already tracks this exact unresolved development in `radar:lumabri-peer-to-peer-moe-inference`, including the need for independent throughput and reliability testing. It still bears directly on Scott’s hardware-aware local-inference work and self-hosted GPU substrate—and echoes his ChessBrain distributed-computing experience—but the supplied evidence does not yet add a validated result that would change his builds or position.
dev:concept.hardware-aware-local-inferencedev:project.gamepcwork:project.chessbrain-netip:concept.ai-unit-economicsradar:lumabri-peer-to-peer-moe-inferenceradar:concept.distributed-inferenceradar:concept.moe-inferenceradar:concept.local-inference
queries asked of Scott's wikis
  • peer-to-peer distributed inference across commodity machines
  • mixture-of-experts expert routing and weight streaming
  • local inference memory hierarchy and storage economics
  • distributed inference reliability and heterogeneous peers
  • model sovereignty through pooled consumer hardware
  • benchmarks for practical local-model throughput

Measured heat

no measured readings yet — the hourly heat pass fills this in

How the heat travelled

no chain yet — the hourly chain pass fills this in

Evidence (2) — ⭐ canonical anchor

sourceobjectauthorscorecomments
🟧 hnShow HN: Lumabri – Run Moe Models on a P2P Swarm with Colibrivforno4419
🟧 echo.github ⭐The first substantive Lumabri commit describes “P2P weight distribution” and peers executing experts, with identical-token measurements. TheVincenzo Fornaro——

Interpretation history

Decision trace