All hacks

ESP32 desk robot that logs tasks and events by voice using Gemini

A 3D-printed cube on an ESP32-S3 that hears 'Hey Pamk', sends the audio to Gemini and speaks back from 174 recorded clips.

ESP32 desk robot that logs tasks and events by voice using Gemini
ESP32 desk robot that logs tasks and events by voice using Gemini, as posted by ConferenceFew7697
Photo: ConferenceFew7697, from the original post.

Pamk is a 3D-printed cube on a custom ESP32-S3 board, with a 1.69 inch screen for a face, an INMP441 mic and a small speaker. Say “Hey Pamk” and give it a task or an event, and it adds it to your day. It runs Pomodoro sessions too.

The wake word was trained on the builder’s own voice with Edge Impulse. Once it triggers, Pamk records up to 15 seconds of 16 kHz audio and sends it straight to Gemini, which handles the speech recognition and the understanding in one request and replies with JSON. There’s no text-to-speech: answers are stitched together from 174 pre-recorded clips, and if Gemini stalls, the request is retried on a fallback model.

The Reddit post lists the libraries, the partition layout and the hurdles, and there’s a full build video in French with English subtitles. No code is linked yet. Credit to ConferenceFew7697 for the original post.

All credit to ConferenceFew7697. The full story is at the original source.

Cracked something open?

Send us your hack. Clever, useful or gloriously pointless, we want to see it.

Submit a hack