Minimum hardware to run this model?? doable in consumer hardware?
2x 128GB unified memory machines with RDMA could run this at Q4. Not very fast.
The price of that kit is rapidly approaching $10k.
[flagged]
2x 128GB unified memory machines with RDMA could run this at Q4. Not very fast.
The price of that kit is rapidly approaching $10k.
[flagged]