new | ask | show | jobs
AureliusMA 4 hours ago  [ - ]

How large would a 1 billion token kv even be ?!

AntiUSAbah 3 hours ago  [ - ]

30TB for 4 bit, 60tb for 8bit res