Can we somehow make them work with 1 TB PCIes so we can churn through way more data?
Have you heard of the "Radeon Pro SSG" ??
It must have failed because I never heard of an update to this GPU. But AMD definitely made a GPU with 4x NVMe SSDs attached to the GPU.
You are able to use GPU Direct Storage to communicate between the GPU and PCIE storage devices. It's nice, but it's not typically as performant as one would like, in comparison to the onboard memory.
https://docs.nvidia.com/gpudirect-storage/
https://github.com/microsoft/DirectStorage/tree/main
linux has P2P-DMA for this. The drivers, devices and bus topology need to support it though.
https://docs.kernel.org/driver-api/pci/p2pdma.html
I think GP means 1TB of PCIe bandwidth, instead of 1TB of PCIe NVMe drives.
Have you heard of the "Radeon Pro SSG" ??
It must have failed because I never heard of an update to this GPU. But AMD definitely made a GPU with 4x NVMe SSDs attached to the GPU.
You are able to use GPU Direct Storage to communicate between the GPU and PCIE storage devices. It's nice, but it's not typically as performant as one would like, in comparison to the onboard memory.
https://docs.nvidia.com/gpudirect-storage/
https://github.com/microsoft/DirectStorage/tree/main
linux has P2P-DMA for this. The drivers, devices and bus topology need to support it though.
https://docs.kernel.org/driver-api/pci/p2pdma.html
I think GP means 1TB of PCIe bandwidth, instead of 1TB of PCIe NVMe drives.