I'm surprised people don't use Lima (quick headless local VMs where you can mount a folder). [1]

[1] - https://lima-vm.io/docs/examples/ai/

What's the difference between lima and vagrant?

According to _looking it up_ Lima is tailored to macOS. I encourage to look it up yourself!