Llama would be nice for the ggufs. Any specific flags or tutorials I should look at?
The docs are a great start.
https://github.com/ggml-org/llama.cpp/blob/master/docs/backe...
The docs are a great start.
https://github.com/ggml-org/llama.cpp/blob/master/docs/backe...