Some resell group is going to have to make this easier. The shear amount of these cards otherwise heading towards the landfill is staggering. That is if Big Tech don't destroy them to prevent model weights from leaking.
Some resell group is going to have to make this easier. The shear amount of these cards otherwise heading towards the landfill is staggering. That is if Big Tech don't destroy them to prevent model weights from leaking.
Things like this have started to show up on eBay: https://www.ebay.com/itm/198383386991
terrible deal
Yeah. Not linking as an endorsement -- I do think it's cool, but it's not worth it for that price.
How would destroying the GPUs prevent the model weights from leaking? By the time you get your hands on them the memory is powered off for a long enough time that a cold-boot style attack is impossible.
Would you bet your trillion dollar company on that? Or would you smash up the garbage [to you] memory chips to be sure.
It's volatile memory, not flash.
> The shear amount of these cards otherwise heading towards the landfill is staggering.
The thought of throwing away working cards sounds so bizarre to me. I can't believe companies would dispose them into the landfill like that, it is at least worth giving away for refuse.
There’s a long history of corporations doing evil things to ensure their business model succeeds
I genuinely hope that is the case. The market is absolutely bananas now. I actually now own devices that went up in 'value' since purchase. This is not normal ( and a little scary ). This, on the other hand, is an invitation to properly recycle otherwise unwanted hardware.
Isn't this the same thing with 32 GB already on a PCIe socket?
https://www.ebay.com/itm/166850431555
kinda, they put that on a PCIe socket, but it's passive. Meaning no fan. If you try inference on that it overheats in 1 minute unless you have it inside a server case.