Hmm, coing PCIe -> NIC -> NIC -> PCIe seems a bit silly, couldn't both devices communicate directly over PCIe?
You need Non-Transparent Bridging (NTB) for that; I don't know if AMD has it.
You need Non-Transparent Bridging (NTB) for that; I don't know if AMD has it.