Rhasspy is an open source, fully offline voice assistant toolkit

Author here, happy new year HN! Glad to answer any questions (also see <a href="https:&#x2F;&#x2F;community.rhasspy.org" rel="nofollow">https:&#x2F;&#x2F;community.rhasspy.org</a>)<p>Bit of background: Rhasspy was originally designed for Home Assistant (<a href="https:&#x2F;&#x2F;www.home-assistant.io" rel="nofollow">https:&#x2F;&#x2F;www.home-assistant.io</a>), but now works with lots of home automation projects (Hass.io, Node-RED, OpenHAB, Jeedom). Its sister project, voicej2son (<a href="http:&#x2F;&#x2F;voice2json.org" rel="nofollow">http:&#x2F;&#x2F;voice2json.org</a>), is for command-line use and has fewer options.<p>With Snips.ai being bought by Sonos, we&#x27;re now focusing on compatibility with its MQTT protocol (<a href="https:&#x2F;&#x2F;docs.snips.ai&#x2F;reference&#x2F;hermes" rel="nofollow">https:&#x2F;&#x2F;docs.snips.ai&#x2F;reference&#x2F;hermes</a>) so existing plugins&#x2F;skills will just work. Supporting Snips-like number&#x2F;duration&#x2F;dateTime slots across over a dozen languages is going to be a major challenge, so please reach out if you speak a language besides English* :)<p>* Also consider donating to the Common Voice project: <a href="https:&#x2F;&#x2F;voice.mozilla.org" rel="nofollow">https:&#x2F;&#x2F;voice.mozilla.org</a>

This looks like a lot of fun to hook up to something like this 6 mic hat for the Raspberry Pi<p><a href="https:&#x2F;&#x2F;respeaker.io&#x2F;6_mic_array&#x2F;" rel="nofollow">https:&#x2F;&#x2F;respeaker.io&#x2F;6_mic_array&#x2F;</a>

This is really cool!<p>Does anyone know if there&#x27;s a way to hack an Echo Dot and use it as the speaker&#x2F;mic for Rhasspy? Rolling out our own hardware that is as effective as a Dot would probably be very difficult?

Similar project: Voice2JSON<p>Website: <a href="https:&#x2F;&#x2F;voice2json.org" rel="nofollow">https:&#x2F;&#x2F;voice2json.org</a><p>GitHub: <a href="https:&#x2F;&#x2F;github.com&#x2F;synesthesian&#x2F;voice2json" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;synesthesian&#x2F;voice2json</a><p>(I am not affiliated but am using it in my own pet project)

I recently came across Rhasspy, and while I haven&#x27;t had time to play with it, I&#x27;m super excited. Often I like the sound of certain projects but want to plug in my own parts. Rhasspy appears to glue all the parts of a modern voice assistant together, but let you swap out any of the parts.

Have you considered Mozilla&#x27;s DeepSpeech for Speech2Text? Since version 0.6 it seems to be a viable option for a raspberry pi.<p><a href="https:&#x2F;&#x2F;hacks.mozilla.org&#x2F;2019&#x2F;12&#x2F;deepspeech-0-6-mozillas-speech-to-text-engine&#x2F;" rel="nofollow">https:&#x2F;&#x2F;hacks.mozilla.org&#x2F;2019&#x2F;12&#x2F;deepspeech-0-6-mozillas-sp...</a>

This is inspiring hopefully I find some time in the new year to dig into this stuff. I feel like there will be a sort of arms race between open source and top tech companies around AI and privacy. Projects like this are needed imo

How good is the recognition?

Does anyone know if this is viable on a pi zero?

Mmm if there were only IP microphones to connect to something like a Raspberry Pi (An Odroid H2 in my case) to have multiple mics, one on each room without the need for multiple servers...

How is that useful? Most of the things I use assistants for is locating data online while I&#x27;m not on my phone.

Kalliope, another open-source voice assistant (<a href="https:&#x2F;&#x2F;github.com&#x2F;kalliope-project&#x2F;kalliope" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;kalliope-project&#x2F;kalliope</a>) also has the option to use an offline wake-word backend like snowboy.

Neat! This also looks a little related to a (very much) toy project of mine (<a href="https:&#x2F;&#x2F;github.com&#x2F;iamsrp&#x2F;dexter" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;iamsrp&#x2F;dexter</a>). I might try to look to see if I can hook them together..!

This looks great!<p>I&#x27;m curious about extensibility - would it be possible integrate with a C# app running on Windows, for example?<p>I&#x27;m particularly interested for accessibility reasons, looking for ways to control tools like JetBrains Rider without shifting my hands from keyboard to mouse.

Similar project (quite old): CMU Sphinx

I too am super interested in an offline-only voice assistant but really don&#x27;t want to bother with setting up a mic connected to a pi. Even tough it&#x27;s not super hard, it&#x27;ll never be as good as the commercially available options.<p>I think this project would really benefit from taking one of the excellent existing voice assistant&#x2F;speakers on the market (Google home, echo dots, etc., and flashing them with some custom firmware.