You can run OpenAI compatible servers locally. vLLM, ollama, LMStudio and others.
https://news.ycombinator.com/item?id=44436031
https://news.ycombinator.com/item?id=44436031