The AMD 395 supports up to 128GB unified RAM. So still not enough even at 1-bit quant unfortunately.
96gb vram is the max it supports.
That's the max you can statically allocate in the BIOS. It's best to leave that at the minimum (500 MB I think), and let the drivers dynamically allocate. You can use up to about 120 GB on Linux.
Under Linux it is allegedly 110GB, but I’m not sure.
96gb vram is the max it supports.
That's the max you can statically allocate in the BIOS. It's best to leave that at the minimum (500 MB I think), and let the drivers dynamically allocate. You can use up to about 120 GB on Linux.
Under Linux it is allegedly 110GB, but I’m not sure.