> let's self host LLMS from 2 years ago on FreeBSD

Sounds brilliant. 2024 LLMs were great, and hosted in gigantic datacenters. South Park did an episode on ChatGPT in 2023 to assist with the timescales.

If we can run Free LLMs on a desktop PC that's competitive with 2024 a massive win.

Unless of course you believe that AI will continue to increase exponentially, in which case we're heading for such a different world in 10-15 years that it's meaningless to worry about it and you might as well have fun before the AI decides to kill us all