{"id":485,"date":"2021-02-19T04:34:06","date_gmt":"2021-02-19T04:34:06","guid":{"rendered":"http:\/\/kiphaynes.com\/?p=485"},"modified":"2025-08-28T15:33:36","modified_gmt":"2025-08-28T15:33:36","slug":"locally-controlled-open-source-home-assistant-with-voice-control","status":"publish","type":"post","link":"https:\/\/kiphaynes.com\/?p=485","title":{"rendered":"Locally Controlled Open Source Home Assistant – With Voice Control!"},"content":{"rendered":"

 <\/p>\n

Have you ever bought a product or service and were forced to create an online account to access some or all of it’s functionality? Have you ever wondered if it’s possible to have 100% local, off grid control over your smart home devices?<\/p>\n

Like many people, I’ve always been uncomfortable with those Amazon Alexa and Google Nest speakers listening to everything you say in the privacy of your home. In fact, I think many people willingly forgo the convenience of smart home devices simply because they are not willing to invite Google, Amazon or Apple to listen in to every word spoken in the privacy of the home. In most cases, the user is forced either integrate with one of the big three smart home integrators, or load a different app for each brand of device with less than stellar functionality and UI, while being subject to 3rd party cloud dependency.<\/p>\n

Most any smart device you purchase includes a dedicated cloud service attached to it, and it will often not be fully functional without connecting to your wifi. This dedicated cloud-based component may be a server in another country providing automation services, controlling your device and relaying your commands to smart home services including Google or Amazon. It’s difficult to know what other data the device may be collecting and transmitting to it’s mothership in the cloud. Additionally, if the company stops supporting the device or goes out of business, or even if it’s cloud servers go down for a time,<\/a> your smart device may cease to function at all!<\/p>\n

Recently my curiosity about all this led me to test out the open source driven Home Assistant project<\/a>.<\/p>\n

\"\"<\/p>\n

Home Assistant, or HASS, is a free and open-source home automation software designed to be the central home automation control system for smart home technology. Both the Home Assistant “core” application itself and its software extensions are written in Python. Its main focus is on local control and privacy. –Wikepedia<\/a><\/em><\/p>\n

HASS runs in a linux environment and is designed for Raspberry Pi. It sits on your local lan (or cloud server of your choosing) and provides a high level of automation and control of many smart devices in your home. Out of the box, HASS provides integration with a wide variety of devices…<\/p>\n

\"\"
Home Assistant Web Dashboard<\/figcaption><\/figure>\n
\"\"
Home Assistant Mobile App<\/figcaption><\/figure>\n

Home Assistant can work with cloud controlled devices just like Amazon Alexa or Google Nest. However, if you want total local control, you can replace the firmware in many devices with open source firmware, giving you, the homeowner and purchaser of such devices, 100% local and private control of your home. It turns out that many small IOT device on the market (at least when it comes to smart light dimmers and switches) are controlled by the same MCU: The ESP8266:<\/p>\n

\"\"
ESP8266.. totally hackable!<\/figcaption><\/figure>\n

Most of these chips have 1MiB internal memory, WIFI, 16 GPIO pins<\/a> and can be easily re-flashed with custom firmware. And, it just so happens, that there are a lot of people doing just that! There are two popular open source firmware packages available for this chip, Tasmota<\/a> and ESPHome<\/a>.<\/p>\n

\"\"<\/p>\n

 <\/p>\n

 <\/p>\n

 <\/p>\n

 <\/p>\n

 <\/p>\n

I chose to work with Tasmota, as it appears to be a little more user friendly, while ESPHome requires you to compile a binary with all configuration options, while Tasmota spins up a web host right on the device allowing you to change configurations more easily. Until recently, one could flash many devices over the air without having to open the device at all, but now most devices are locked down and require access to the serial data pins on the MCU to re-flash the device. Here is a photo of me flashing a few smart 3-way dimmers with the serial pins on a pi.<\/p>\n

\"\"<\/p>\n

\"\"
Flashing Open Source Firmware on a ESP8266 based Smart Dimmer<\/figcaption><\/figure>\n
\"\"
De-soldering the ESP<\/figcaption><\/figure>\n

Here is my current home setup:<\/p>\n

\"\"<\/p>\n

\"\"<\/p>\n

And a little video!<\/p>\n

\nhttps:\/\/kiphaynes.com\/wp-content\/uploads\/HomeSmart2-HB.mp4<\/a><\/video><\/div>\n

My next quest was to add voice control. Home Assistant natively supports an open Source voice assistant called Almond<\/a>, but the actual voice recognition is not included and must be sent to the cloud<\/a>.\u00a0 I wanted a 100% off cloud voice controlled home assistant. I found another voice\/assistant\/intent tech stack called Rhasspy<\/a> that supports Home Assistant integration.<\/p>\n

\"\"Rhasspy has a nice collection of speech to text, text to speech, intent handling and authoring tools that allow highly customizable approach to voice control for Home Assistant. It will run just fine on a Raspberry pi 3 or later, although depending on how you use it, it can be slow. I used this USB microphone<\/a> with the pi with great success.<\/p>\n

<\/p>\n

\"\"<\/p>\n

Rhasspy accepts your custom voice commands and tries to determine the logical intent of your statement. For example, here are a few sentences that I wrote with logic operators in parenthesis:<\/p>\n

\"\"<\/p>\n

And here is an example output of the intent engine when I ask “What time is it”..<\/p>\n

\"\"<\/p>\n

Over in Home Assistant, I created several automatons and actions to handle intent, and create the voice responses here as well. Notice the responsetext, which I send back to Rhasspy:<\/p>\n

\"\"<\/p>\n

Now that I have integrated voice control, I want to expand home assistant to control and automate more devices in my home. My GE Smart Washer and Dryer will be the next victim! The native app interface is not a great experience, and I would like to see this and other appliance usage in my histogram. There is an integration available using the If This Then That protocol<\/a>, but I believe it still requires cloud integration.<\/p>\n

\"\"
GE Smart Appliances<\/figcaption><\/figure>\n
\"\"
My Home IOT Histogram. Find the hidden correlations.<\/figcaption><\/figure>\n

I also will be testing a Sense Sensor<\/a> soon, this will allow more detailed usage analytics based on electrical noise caused by various appliances and devices in the home. There is even a nice plugin available for Home Assistant!<\/p>\n

\"\"<\/p>\n

\"\"<\/p>\n

What have I learned from this experience? Mostly that off grid automation is possible, useful and very stable! Unfortunately I don’t think that this kind of setup is available to most people that don’t have a high degree of technical skills and patience. I don’t want to even say how much time I’ve put into this project. I think there is a real market opportunity for more locally controlled IOT devices and services. I also think that home and personal data is a powerful resource and commodity, and should be protected and controlled by the owner.\u00a0 I had a great time learning about the communication protocols between devices, and I’m excited to get a taste of what a highly personalized responsive home of the future might look like!<\/p>\n

 <\/p>\n","protected":false},"excerpt":{"rendered":"

  Have you ever bought a product or service and were forced to create an online account to access some or all of it’s functionality? Have you ever wondered if it’s possible to have 100% local, off grid control over your smart home devices? Like many people, I’ve always been uncomfortable with those Amazon Alexa<\/p>\n

…<\/span>Read More<\/a><\/p>\n","protected":false},"author":2,"featured_media":527,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-485","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-uncategorized","xf__entry"],"_links":{"self":[{"href":"https:\/\/kiphaynes.com\/index.php?rest_route=\/wp\/v2\/posts\/485","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/kiphaynes.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/kiphaynes.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/kiphaynes.com\/index.php?rest_route=\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/kiphaynes.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=485"}],"version-history":[{"count":15,"href":"https:\/\/kiphaynes.com\/index.php?rest_route=\/wp\/v2\/posts\/485\/revisions"}],"predecessor-version":[{"id":617,"href":"https:\/\/kiphaynes.com\/index.php?rest_route=\/wp\/v2\/posts\/485\/revisions\/617"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/kiphaynes.com\/index.php?rest_route=\/wp\/v2\/media\/527"}],"wp:attachment":[{"href":"https:\/\/kiphaynes.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=485"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/kiphaynes.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=485"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/kiphaynes.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=485"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}