10Hz is still a 0.1s of latency, which doesn't seem like a lot until you realize that an Arduino typically runs at 16 Mhz, which is literally a million times faster than running a full LLM.
So, yeah, for complex reasoning and sensory processing, LLMs are the correct choice, and Gemini is especially strong at spatial reasoning over ChatGPT/Claude. But for actual motion/actuation? LLMs are the wrong tool for the job, probably easier to have LLMs program a reusable workflow in a script for repeated tasks instead of invoking LLMs after the first time.
For this operating domain the latency comparison is human reaction time and not arduino reaction time.
Also the process that’s running at 16MHz is not the same as a full VLA. VLA is much more expressive. You think the processor that is running the VLA system is running at 10Hz or some GHz?
10Hz is still a 0.1s of latency, which doesn't seem like a lot until you realize that an Arduino typically runs at 16 Mhz, which is literally a million times faster than running a full LLM.
So, yeah, for complex reasoning and sensory processing, LLMs are the correct choice, and Gemini is especially strong at spatial reasoning over ChatGPT/Claude. But for actual motion/actuation? LLMs are the wrong tool for the job, probably easier to have LLMs program a reusable workflow in a script for repeated tasks instead of invoking LLMs after the first time.
For this operating domain the latency comparison is human reaction time and not arduino reaction time.
Also the process that’s running at 16MHz is not the same as a full VLA. VLA is much more expressive. You think the processor that is running the VLA system is running at 10Hz or some GHz?
16 MHz is the chip's clock speed. Arduino PID is more like 100 Hz to 1 kHz.
Human deliberate movement runs around 2-10 Hz I think.