I run the same card and you're going to wish you'd gotten just a bit more VRAM :(
20GB is just barely not enough unless you want to live with 32k context, which just isn't enough.
I run the same card and you're going to wish you'd gotten just a bit more VRAM :(
20GB is just barely not enough unless you want to live with 32k context, which just isn't enough.