Why are you using Ollama? Just use llama.cpp

MLX?

Then use oMLX or MTPLX or Rapid MLX.