> You need to setup a harness that works against your model - You might need to setup additional websearch tools, image tools, etc since harnesses like pi don't come with the model

Pi has a nice guide on it (https://pi.dev/docs/latest/llama-cpp) and it is really not that hard.

How is that hypocrisy? Self hosting is somehow anti AI? Its not anti AI. Its literally using AI!

…and honestly, at a higher technical level than slapping your wallet against a token provider and running prompts in a hosted sandbox you can't even see the prompts in.