Any idea what kind of vram is needed to run this on Nvidia?
It runs natively on the Photos app in Vision Pro, which shares 16GB of ram with GPU and CPU.
The Python process peaks at about 15 GB, so maybe a 24 GB GPU works. But others seem to have problems wih Nvidia: https://github.com/apple/ml-sharp/issues/84
The smallest Nvidia gpu I've run Sharp on is an Nvidia T4 which I think has 16 GB on the chip
It runs natively on the Photos app in Vision Pro, which shares 16GB of ram with GPU and CPU.
The Python process peaks at about 15 GB, so maybe a 24 GB GPU works. But others seem to have problems wih Nvidia: https://github.com/apple/ml-sharp/issues/84
The smallest Nvidia gpu I've run Sharp on is an Nvidia T4 which I think has 16 GB on the chip