Fully local voice assistant for Home Assistant on a gaming GPU
Ming Voice runs a speech-to-speech model on your own Radeon GPU and controls Home Assistant, with about 230ms to first audio.
Ming Voice is a speech-to-speech assistant that runs entirely on a GPU in your own machine and controls Home Assistant by voice. You can interrupt it mid-sentence and follow up with things like “now turn it off”. The builder measures about 230ms from the end of your speech to the first audio on an RX 7900 XTX.
It’s built on the Ming-3.0-audio-tiny model, a 9.3B mixture-of-experts with 2.7B parameters active. It talks to Home Assistant through the API with a long-lived token, and a Wyoming bridge lets Assist pipelines use it too. The post doesn’t say whether an AI coding assistant was involved.
You’ll need a 16GB+ card (Radeon RX 6800 or newer; NVIDIA is experimental), Linux or Windows with WSL2, and about 30GB of disk for the model. There are install scripts for both. Code is on u/JMS1717’s GitHub, MIT licensed, with the original post on Reddit.
All credit to u/JMS1717. The full story is at the original source.
