I am making something similar. Also been using Kokoro for TTS. Very cool project!

Gemma 4 is kinda too heavyweight even with E2B. I am sticking with qwen 0.8B at the moment.