Decent LLMs can run on anything now: https://github.com/he-be/turbo-fieldfare
Kiwix is great, but I'd also like a language model to be able to deeply interrogate all of that information much faster than I can read.
Just arrange its harness so that its responses are grounded in the source material and require source citations for everything. Then read the citations to confirm it's not a hallucination.
>can run on anything now: (link to turbo fieldfare)
Except the build process there requires a specific recent version of swift. Hardly a good definition of "anything"
I like this "both / and" approach. Restructure this project to have the LLM source from local Kiwix data you've selected to make available offline, rather than a source of data you're unfamiliar with. References point directly to your Kiwix library.