I am looking forward for the AMD 395 max+ PCs to come down in price.
The inference speed locally will be acceptable in 5-10 years thanks to those generation of chips and finally we can have good local AI apps.
I am looking forward for the AMD 395 max+ PCs to come down in price.
The inference speed locally will be acceptable in 5-10 years thanks to those generation of chips and finally we can have good local AI apps.
They don’t have the memory bandwidth
256 GB/s memory bandwidth is low but it still does around 40 tokens per sec with gpt-oss, good enough for local apps