Hacker News

points by jvanderbot 2 days ago | 0 comments

Shoutout to project nomad.

https://www.projectnomad.us/

its got a ton of useful options, preconfigured, integrates pretty easily, and can use any local LLM or data.

Interesting. I have a mac mini I run headless dedicated for LLM inference. Do you know if I could run project nomad on a linux box but use qwen on the mac for the AI stuff? I can't find any info on if this configuration is possible.

[–] jvanderbot 2 days ago

Sure can. I did similar.

[–] KiwiJohnno 1 day ago

Sweet, I'll give it a go! Thanks dude.

[–] ciefa 1 day ago

This looks cool! My thought in OPs post was "Why now use Kiwix?" and Nomad seems to do! Also BYOM is better imho.