>. I have an M3 Ultra with 256GB of memory,
Im sorry but spending this kind of money when you could have just built yourself a dual 3090 workstation that would have been better for pretty much everything including local models is just plain stupid.
Hell, even one 3090 can now run Gemma 3 27b qat very fast.
Are you aware that your 3090s have nowhere close to 256GB of VRAM? Or maybe you are not aware that on macs you have unified memory (working both as RAM and VRAM).
> a dual 3090 workstation that would have been better for pretty much everything
Doesn't run macOS
Except if you are living in a region where electricity is quite expensive :/