xiaozhi-esp32-server

xiaozhi-esp32-server is the backend service for the open-source xiaozhi-esp32 smart hardware project, implemented in Python, Java and Vue according to the Xiaozhi communication protocol. It was led by a team at South China University of Technology. It supports MQTT with UDP and WebSocket protocols, MCP endpoints, voiceprint recognition and a knowledge base, and is meant for people who already own ESP32 hardware and want to host their own backend instead of using a shared one.

Two deployment modes are offered: a minimal install for low-spec environments with a single agent and settings kept in config files (no database), and a full-module install with multi-user and multi-agent management, a web control console and database storage, each available as Docker or from source. The component list covers many LLM, vision, text-to-speech, voice-activity-detection, speech recognition, voiceprint, memory, intent and RAG options. The README is clear that the project is incomplete, has not passed a network security evaluation and should not be used in production, and that it has no commercial relationship with, and gives no guarantee about, any third-party API provider.