But you can't just switch between installed models like in ollama, can you?
llama-swap? https://www.nijho.lt/post/llama-nixos/
llama-swap? https://www.nijho.lt/post/llama-nixos/