Tesla V100 SXM2 16GB is NOT DGX class as the author writes. It's HGX class. The V100 comes in two classes, SXM2 and SXM4, the latter coming with a Max of 80gb on board memory. Typically these are installed 8×A100 80GB SXM4 on an HGX riser, and what that gives you is NVSwitch fabric and 640GB of pooled HBM2e (on package stacked memory /w ~2 TB/s of memory bandwidth). 2u standard rack footprint too.
What on earth are you talking about? Your comment makes no sense.
The V100 and A100 are different generations altogether.
The V100 does not have 2TB/s.
I have no idea what you are trying to say.
V100 came as sxm2 and sxm3. And it was 16 and 32gb.
HGX is DGX with extra toppings.
No. DGX is when it's Nvidia's design, HGX when it's a 3rd party design.