Hacker News

points by dvt 2 days ago | 0 comments

Or just.. download the books, and slap a search engine on top of them. It'll be like 10x smaller than the model. "Survival LLM" is absolutely a non-relevant use case.

[–] saaaaaam 2 days ago

When you’re living in an igloo trying to stay warm in the hollowed out belly of a cow having a few books around the place is probably more useful than some files on a laptop that ran out of battery just before it got morbidly damp. Plus you can burn them if you really need to.

[–] drusepth 2 days ago

On the other hand, the laptop struggling to power a good-enough LLM will probably be a great heat source for you in that igloo... for about 45 minutes.

[–] saaaaaam 2 days ago

As I said elsewhere, you can always burn the books! And eating a laptop is considerably crunchier and more fraught than chewing through some good old fashioned leather facings, horse glue and nice heavy 120gsm wove.

[–] recursive 2 days ago

On the other hand, if you know enough to build an igloo, you're probably going to be ok regardless.

[–] octoberfranklin 2 days ago

"cow in an igloo" sounds like something an LLM would hallucinate.

[–] saaaaaam 2 days ago

Yes I slightly mangled that one. But I’m sure there is a survival technique that involves crawling into the body cavity of a hollowed out cow. You probably wouldn’t want to do that in an igloo though. I’m not even sure you could get a cow into an igloo. If standard issue humans are this flawed it’s hardly surprising that top flight LLMs get things so wrong sometimes.

[–] natebc 1 day ago

I'd have gone with Bantha in an ice cave myself.

[–] taneq 2 days ago

And/or install Kiwix and grab an offline copy of Wikipedia.

[–] lossyalgo 1 day ago

Wikipedia rarely (never?) gives enough information to actually build or accomplish anything - it just has a nice clean summary of lots of things.

[–] scotty79 2 days ago

If you have AI model there it can make any search engine for you as per your needs.

[–] anthk 1 day ago

Recoll it's far smaller and it runs on a potato. It's a desktop search engine which can parse tons of files. Under GNU/Linux just install all the recommended dependencies for APT/RPM. Or just use Flatpak and to hell with transitive dependencies.