Multilingual OpenWakeWord Toy Integration

Замовник: AI | Опубліковано: 25.10.2025

I’m building a small hardware toy that wakes up to the custom word “boboloo,” understands what a child says in Hindi or English, and replies with a warm, kid-friendly synthetic voice. To make future language expansion easy, every component must be fully open-source and cleanly documented. Here’s what I need: • A custom OpenWakeWord model trained on “boboloo,” packaged so it runs efficiently on an embedded Linux SBC (Raspberry Pi 4 or ESP or similar) with clear latency and false-accept metrics. • An STT pipeline—Whisper, Vosk, or any equally permissive stack—that reliably handles Hindi and English today but is architected so I can drop in additional language models later without touching the toy’s firmware. The complete code of this will be going to the cloud. • A children-tuned TTS model (Coqui-TTS or comparable) producing a friendly, non-robotic voice. Please include guidance on voice cloning or fine-tuning in case I ever want alternate characters. This code will also be going to cloud. • End-to-end integration scripts: wake-word → streaming STT → my cloud LLM (REST endpoint) → TTS playback, returning only audio feedback to the child. All calls to the LLM should be abstracted behind a simple Python class so I can swap providers. • Clear build instructions, Dockerfiles (if helpful), and a lightweight demo CLI so I can test each step on a laptop before flashing the toy. Acceptance criteria 1. Saying “boboloo” at normal room volume activates the toy >95 % of the time, with <2 % false triggers over 1 hour of background chatter. 2. STT word error rate ≤15 % for Hindi and English children’s speech (sample clips provided). 3. End-to-end round-trip (wake-word to audio reply) ≤1.5 s on Raspberry Pi 4. 4. All code, models, and training notebooks delivered under OSI-approved licenses in a public Git repository. If you’ve trained custom wake words, deployed Whisper/Vosk on edge devices, or tuned Coqui voices before, I’d love to see examples in your proposal.