So a minimum of 3x RTX Pro 6000 to run 1-bit at ~76% accuracy or MacStudio 512GB RAM to run 4-bit at ~97% accuracy.
No. Unsloth has CPU offloading. It'll be slow but it'll work even with SSD offloading.
No. Unsloth has CPU offloading. It'll be slow but it'll work even with SSD offloading.