Use llama.cpp or better yet Unsloth Studio