inclusionAI claims its released Realtime-Venus-Omni 9B checkpoint continuously watches and listens, decides when to respond, and generates synchronized text and speech, potentially enabling self-hosted audiovisual agents beyond turn-based interaction.
state: seedheat: mediumuncertainty: mediumconvergesscott: mediumrealtime-multimodal-agents open-audio-visual-models streaming-inferenceinclusionAI
What is this?
The case describes inclusionAI’s claimed release of Realtime-Venus-Omni, a 9B audiovisual checkpoint that continuously processes audio and video, chooses when to respond, and produces synchronized text and speech. InclusionAI’s publication page lists research attributed to “Inclusion AI, Ant Group,” including unified multimodal perception and generation, but the supplied web snippets do not cover this specific release. The case’s evidence titles point to a Hugging Face repository and a quoted model card mentioning adaptation from MiniCPM-o 4.5; without the card’s contents, the release details, capabilities, licensing, and practical self-hosting requirements remain unverified.
Why it matters to Scott
The claimed continuous listening and selective response converge with Scott’s Ambient conversation copilot, which defaults to silence, and could offer a backend to evaluate for Practice Trainer and his local GPU laboratory rather than another turn-based speech pipeline. This remains a candidate evaluation, not a demonstrated replacement: the supplied evidence does not verify capabilities, licensing or hardware requirements, and the radar’s related voice-interaction episodes do not establish prior coverage of this release.
dev:project.listendev:concept.ambient-conversation-augmentationdev:project.sales-trainerdev:project.gamepcradar:openai-gpt-live-voice-architectureradar:tavus-sparrow-2-conversational-flowradar:concept.multimodal-agentsradar:ling-flash-vl-release
queries asked of Scott's wikis
- continuous perception agents versus turn-based interaction
- voice agent turn detection interruption response timing
- self-hosted multimodal models inference hardware economics
- streaming audio video agent runtime integration
- synchronized speech text generation latency evaluation
Measured heat
now 0 pts/hpeak 0 pts/hcomments 0/hpeers p0momentum: steady2 platformsage 553h
points/hour across evidence · reading as of 2026-10-12 02:59:37.977291+11:00 · deterministic, not a model opinion
How the heat travelled
pace: p72 vs 1032 stories at the 336h mark (now 553h old) — ahead of intern-s2-397b-release (1.0x), behind anthropic-antspace-deployment-discovery (1.0x)
Evidence (2) — ⭐ canonical anchor
Interpretation history
2026-09-18T16:29:30Z
grounded: converges/medium — The claimed continuous listening and selective response converge with Scott’s Ambient conversation copilot, which defaults to silence, and could offer a backend
2026-09-18T16:23:29Z
case created — A distinct downloadable audiovisual model is a concrete release, although the truncated evidence does not establish sustained-operation quality or memory capabilities.
Decision trace
- 10-09 08:26review_dormantscheduled targets exhausted or 28 quiet days
- 10-09 08:26drop_targetsquiet through full ladder or over cap 8
- 09-21 03:25review_screenThe change only removes a reminder comment and adds another speculative hardware-use question; it provides no new implementation result, capability evidence, or access change.
- 09-19 10:30review_screenThe only addition is a brief reaction expressing interest in the audio capability; the removed hardware/phone question is discussion rather than new evidence and its deletion does not change evidentia
- 09-19 08:20sensor_dirtycomment_update
- 09-19 02:29groundThe claimed continuous listening and selective response converge with Scott’s Ambient conversation copilot, which defaults to silence, and could offer a backend to evaluate for Practice Trainer and hi
- 09-19 02:23createA distinct downloadable audiovisual model is a concrete release, although the truncated evidence does not establish sustained-operation quality or memory capabilities.