All hacks

Handheld ESP32-S3 voice assistant with an animated face, answered by Claude

A pocket voice assistant on a XIAO ESP32-S3 Sense: radar wake-up, OLED face, Deepgram for speech and Claude Haiku for answers.

Handheld ESP32-S3 voice assistant with an animated face, answered by Claude
Handheld ESP32-S3 voice assistant with an animated face, answered by Claude, as posted by u/fishyhappysad
Photo: u/fishyhappysad, from the original post.

Pocket is an 8 x 5.5 cm handheld box that answers spoken questions out loud while a face on a small OLED screen listens, thinks and talks. Say “Pocket” and a question, and it replies. It runs from an 18650 cell over home Wi-Fi or a phone hotspot.

It’s built on a XIAO ESP32-S3 Sense. The builder’s first version used a classic ESP32 with no PSRAM and could only record about six seconds of audio, so the S3’s 8 MB of PSRAM, built-in PDM mic and USB-C LiPo charger won out. Deepgram handles speech to text and the voice, and Claude Haiku writes the replies, streamed and spoken sentence by sentence. There’s no wake-word library: an LD2410S radar only lets it listen when someone is near. An IR blaster learns and replays remote buttons.

It’s still a work in progress. The TV ignores the IR LED and the camera isn’t detected yet. No code is posted, but the post lists the libraries and the gotchas, like the amp sounding fuzzy on 5V. See the original post on Reddit.

All credit to u/fishyhappysad. The full story is at the original source.

Cracked something open?

Send us your hack. Clever, useful or gloriously pointless, we want to see it.

Submit a hack