I'm sure that is the future. But we're still pretty far away from being able to put a 32B model in memory right? The whole industry is on that trajectory. Just give it another decade and the standard for base memory will likely be 64GB or more.
I'm sure that is the future. But we're still pretty far away from being able to put a 32B model in memory right? The whole industry is on that trajectory. Just give it another decade and the standard for base memory will likely be 64GB or more.