pleeplydocs

Run it yourself

Use a local LLM with Home Assistant

Updated 3 min read View .md

Home Assistant can use a local language model as its conversation agent through the built-in Ollama integration. You run Ollama on a machine in your network, point Home Assistant at it, and Assist answers questions and — as an experimental feature — controls the devices you expose, with no cloud AI service involved.

What you need#

  • A Home Assistant server.
  • Ollama on the same machine or another one on your network (it listens on port 11434). For quick answers use a machine with a GPU or Apple Silicon; a Raspberry Pi works with small models, slowly.
  • Local speech: the Whisper (speech-to-text) and Piper (text-to-speech) add-ons. If your server is too weak, Home Assistant can send speech to its paid cloud instead.
  • A voice device, such as the Home Assistant Voice Preview Edition.

Set it up#

  1. Install Ollama and download a model that supports tool calling, for example ollama pull qwen2.5:7b. If Ollama runs on another machine, make it listen on the network with OLLAMA_HOST=0.0.0.0.
  2. In Home Assistant, open Settings → Devices & services → Add integration, choose Ollama and enter the server URL, for example http://192.168.1.20:11434.
  3. Pick the model. Home Assistant downloads it if it isn't there yet.
  4. Open Settings → Voice assistants, edit your assistant and set the conversation agent to Ollama. Choose Whisper and Piper for speech.
  5. Optionally allow it to control Home Assistant (experimental) and expose only the devices it needs — Home Assistant recommends fewer than 25.

Settings that matter#

SettingWhat it doesRecommendation
ModelThe Ollama model that answersMust support tools to control devices; larger models make fewer mistakes
Context window sizeHow many tokens the model seesHome Assistant defaults to 8k (Ollama's own default is 2k); bigger homes need more, smaller values save RAM
Max history messagesHow much of the conversation is keptFewer is faster and lighter
Keep aliveHow long the model stays in memoryKeep it loaded for quick replies
Think before respondingLets reasoning models think firstSlower; off by default

Keep commands fast#

Small local models can struggle to chat and control devices at the same time. Two patterns help:

  • Let Home Assistant handle plain commands itself. Its built-in intent matching handles "turn off the kitchen lights" instantly; only requests it doesn't understand need the language model.
  • Use two agents. Home Assistant's docs suggest two Ollama configurations with the same model: one for conversation without device control, one with control enabled for commands.

What the Voice Preview Edition is#

The Home Assistant Voice Preview Edition is a $59 voice satellite: an ESP32-S3 with a dual-microphone array, an XMOS XU316 audio processor for echo cancellation and noise suppression, a small speaker for prompts, a 3.5 mm output and a hardware mute switch. It needs a Home Assistant server — speech recognition and the language model run there, either locally or through Home Assistant Cloud.

FAQ#

Can Home Assistant voice work without the internet?#

Yes, if speech-to-text, the language model and text-to-speech all run on your own machines — Whisper, Ollama and Piper. With a weaker server, Home Assistant can send speech to its cloud service instead.

Which Ollama model should I use with Home Assistant?#

One that supports tool calling, as large as your hardware can run quickly. Home Assistant notes that smaller models make more mistakes when controlling devices.

Does the Voice Preview Edition run the AI itself?#

No. It captures audio and plays answers; speech processing and the language model run on your Home Assistant server and your Ollama machine.

How many devices should I expose to the LLM?#

Home Assistant recommends exposing fewer than 25 entities to keep local models accurate.

Sources#

Want this without building a server?

pleeply is an early project: a speaker with a built-in computer that runs open models at home. There's no prototype yet, and your answers decide what we build first.

Answer 5 quick questions →30 seconds · only email is required · no payment

pleeply Community

Keep going with the community

Running AI at home is easier with people who've already done it. On the pleeply forum you can:

  • ask about local models, hardware and Home Assistant, and get answers from people running them;
  • vote on what pleeply should do first;
  • show your own local-AI setup and get feedback;
  • hear first about test builds and reservations.

Free · no email needed

This page is also available as Markdown. For the full docs index, see llms.txt.