Hacker News

points by jack_pp 4 days ago | 0 comments

isn't it the same using the same model you host locally but through a cloud provider? does the $ math favour a local setup then?

Cloud models sometimes get degraded. You can trust your local model and know what you are running.

seems like a stretch, especially when you could choose from 10 of them if u feel they're dropping off.

Also, it's not like you're running any full models on local without shelling out 20k+