Are there any agentic models like this that would work for controlling input in arbitrary video games? I've been wanting to have an AI play Kerbal Space Program because I think it would just be pretty hilarious.
Are there any agentic models like this that would work for controlling input in arbitrary video games? I've been wanting to have an AI play Kerbal Space Program because I think it would just be pretty hilarious.
> I've been wanting to have an AI play Kerbal Space Program because I think it would just be pretty hilarious.
people have been experimenting with this since early Opus days.
Check out kRPC. Get it running (or make your agent get it running) and it's trivial for any of the decent models to interface with it
When I tried it with Opus3 I got a lot of really funny urgent messages during failures like "There has been an emergency, initiating near-real-time procedures for crew evacuation.." and then it's just de-couple every stage and ram into the ground.
Makes for a fun ant-farm to watch though.
[0]: https://krpc.github.io/krpc/
https://deepmind.google/blog/sima-2-an-agent-that-plays-reas...
(not a local model)
I might suggest looking at Alibaba's open source AgentEvolver. It doesn't specifically target video games, but it's an agentic system designed around a more OODA loop evolutionary system than the kind of train/inference system, has potential, could be exciting to see.
I like how they classifythr sub problems of their work. Environment/ self questioning -> task / self questioning -> trajectory / self evaluation. OODA-esque.
https://arxiv.org/abs/2511.10395 https://github.com/modelscope/AgentEvolver with thanks to Sung Kim who has been a great feed https://bsky.app/profile/sungkim.bsky.social/post/3m5xkgttk3...
i'm curious what would happen if you got it to play online poker...