Watching the OpenClaw/Molbot craze has been entertaining. I wouldn't use it - too much code, changing too quickly, with too little regard for security - but it has inspired me.
I often have ideas while cleaning around, cooking, etc. Claude Code (with Opus 4.5) is very capable. I've long wanted to get Claude Code working hands-free.
So I took an afternoon and rolled my own STT-TTS voice stack for Claude Code. The voice stack runs locally on my M4 Pro and is extremely fast.
For Speech to Text, Parakeet v3 TDT: https://huggingface.co/nvidia/parakeet-tdt-0.6b-v3
For Text to Speech, Pocket TTS: https://github.com/kyutai-labs/pocket-tts
Custom MCP to hook this into Claude Code, with a little bit of hacking around to get my AirPods' stem click to be captured.
I'm having Claude narrate its thought process and everything it's doing in short, frequent messages, and I can interrupt it at any time with a stem click, which starts listening to me and sends the message once a sufficiently long pause is detected.
I stream the Claude Code session via AirPlay to my living room TV, so that I don't have to get close to the laptop if I need extra details about what it's doing.
Yesterday, I had it debug a custom WhatsApp integration (via [1]) hands-free while brushing my teeth. It can use `osascript` for OS integration, browse the web via Claude Code's builtin tools...
My back is thankful. This is really fun.
On one hand, I think this project is super cool and something I would use and/or would have loved to build myself for my own use.
On the other hand, it makes me wonder if we’re just heading for a future where everyone is just always working, at all times, even while doing other things.
“Wow look at our daughter taking her first steps! She’s doing so… wait hold on… No, Claude. I said to name the class “potatoes”, not “‘pot’ followed by eight ‘O’s,” you dumb robot!”
I don't disagree, but I think there is the otherside of that same coin... What if we could do other stuff while remaining productive.
Rather than the example of missing first steps, what if we had, "Ok Claude, prepare a few slides for my presentation, I'm going to watch my childs mid-day recital..." maybe you get a success/failure ping and maybe even need to step out for part of the event, but in another world you couldn't have gone at all.
I expect the opposite, where if you are not exploiting your newly freed time with more work, you will be left behind.
This is the premise of the comic Power Nap.
https://www.powernapcomic.com/powernap/
we kind of already are with our phones and Slack, the difference at this point is negligible. i personally won't have airpods in 24/7 with my kid (or ever) so if i were doing something like this, it would be through my phone, which is already something i use fairly often. not too much difference there IMO (at least anecdotally speaking)
I don't know what kind of work you do on a daily basis. But, the difference between sending a Slack message and sending a message to kick off an agent to chain a bunch of tasks together is a vastly lower activation barrier. I think many people will jump over that lower barrier out of FOMO, to avoid being outcompeted by those who already jumped.
As an IC though, me sending a slack message is perhaps less impactful than a PL responding to a report :)
you basically just described management, where you send a slack message and kick off a bunch of tasks to your team
I got into a bike accident yesterday and injured both of my arms. Fortunately the damage wasn't too severe, but it was bad enough that using a computer is rather difficult. So now I'm spending some of my idle time playing around with different options for voice control. Like you I am a little wary of OpenClaw so I might try something similar to your setup as an alternative. So far I have gotten to the point where I can use voice dictation in notepad to write comments and commands, but copying and pasting the text is enough of a struggle (compounded by the fact that my cat is competing with me for the keyboard and I am in no state to fend her off) that I am aiming to push things a bit further. Sucks being injured but having a nice distraction to keep my mind occupied has so far been a great way to pass the time.
repo?