I there a way to make this work with macOS hosts, preferably without having to install a Linux toolchain inside the VM for the language the agent will be writing code in?

This is a similar macOS solution:

https://github.com/lynaghk/vibe/