A practical, step-by-step bilingual guide for deploying XiaoZhi (小智) — the open-source AI voice assistant — on your own hardware and server. It covers the whole local deployment workflow: server deployment, LLM / ASR / TTS configuration, firmware build & flash, MCP extension, digital human module, and troubleshooting.
XiaoZhi is an open-source AI voice assistant ecosystem:
- ESP32 device (firmware) — captures audio, detects the wake word offline, plays replies, and shows status on a display
- xiaozhi-server — handles speech recognition (ASR), LLM conversation, text-to-speech (TTS), OTA, and MCP tool management
- LLM API — Qwen, DeepSeek, or any OpenAI-compatible model
- MCP endpoint (optional) — connects external tools (calculator, weather, smart home, ...) to your assistant
- Digital human module (optional) — browser-based avatar page with local wake-word runtime for testing/display
ESP32 device (firmware) ⇄ WebSocket ⇄ xiaozhi-server (ASR + LLM + TTS) → LLM API
⇄ MCP ⇄ mcp-endpoint-server → custom tools
⇄ digital-human (browser test page)
- Deploy the server (Chapter 2)
- Configure the LLM (Chapter 6)
- Build and flash the firmware (Chapter 5)
- Provision Wi-Fi and start talking
- Extend with MCP tools (Chapters 3 & 4) or the digital human module (Chapter 8)
- 78/xiaozhi-esp32 — ESP32 firmware
- xinnan-tech/xiaozhi-esp32-server — voice server
- xinnan-tech/mcp-endpoint-server — MCP endpoint server
- 78/mcp-calculator — MCP calculator example
MIT — see LICENSE.