“For AI workloads: The 245TB Micron 6600 ION provided up to 84 times better energy efficiency”
How big of a deal is this part in relation to the initial upfront costs? I’m not privy to the cost of power for SSD
“For AI workloads: The 245TB Micron 6600 ION provided up to 84 times better energy efficiency”
How big of a deal is this part in relation to the initial upfront costs? I’m not privy to the cost of power for SSD
A big consideration for efficiency and TCO calculations is the number of servers required to house the drives. NVMe drives tend not to be in external JBOF enclosures.
Fewer servers means fewer cpus, less RAM, fewer fans, and maybe fewer switches.
It means you don't have as much to cool.
Getting rid of 30 watts of heat is trivial compared to say, 300 (I don't quite know how to read that ratio since a 2.5kW SSD seems a little high to me).
Given that 2.91TB SSDs are a common enterprise size, perhaps they're saying the 1x245TB SSD uses 1/84 the power of 84 2.91TB SSDs ;p
With a modern CPUs hitting 400W it's already a problem to fill a rack top down with servers like you could do before: too many heat to dissipate and transfer, too much power to provide in the first place.
Just imagine something like 2S 9565 in at least 2U machines: with 10 server x 2U x 2 CPU you would have 8kW in the processors alone and you didn't even fill half of the 42U rack.
https://www.amd.com/en/products/processors/server/epyc/9005-...