Hacker News

points by x3haloed 2 days ago | 0 comments

Decent LLMs can run on anything now: https://github.com/he-be/turbo-fieldfare

Kiwix is great, but I'd also like a language model to be able to deeply interrogate all of that information much faster than I can read.

Just arrange its harness so that its responses are grounded in the source material and require source citations for everything. Then read the citations to confirm it's not a hallucination.

[–] iAMkenough 2 days ago

I like this "both / and" approach. Restructure this project to have the LLM source from local Kiwix data you've selected to make available offline, rather than a source of data you're unfamiliar with. References point directly to your Kiwix library.

[–] xamuel 2 days ago

>can run on anything now: (link to turbo fieldfare)

Except the build process there requires a specific recent version of swift. Hardly a good definition of "anything"