Shoutout to project nomad.
its got a ton of useful options, preconfigured, integrates pretty easily, and can use any local LLM or data.
Shoutout to project nomad.
its got a ton of useful options, preconfigured, integrates pretty easily, and can use any local LLM or data.
Interesting. I have a mac mini I run headless dedicated for LLM inference. Do you know if I could run project nomad on a linux box but use qwen on the mac for the AI stuff? I can't find any info on if this configuration is possible.
Sure can. I did similar.