points by heroiccocoa 2 days ago | 0 comments
How useful would that actually be for local inference, when the bottleneck is, essentially, always memory size? I think the sweet spot is somewhere around 64 to 128 GB. That ought to be enough for almost all uses, like Qwen3.8-Flash-Next at a decent quant.
[–] kridsdale1 2 days ago
> I think the sweet spot is somewhere around 64 to 128 GB. That ought to be enough for almost all uses
This will be the “640kb ought to be enough for anybody” Bill Gates quote of our era.
[–] smallmancontrov 2 days ago
You can order a 128GB MacBook Pro today -- though point taken, memory size probably does belong in the three part plan :-)
[–] skohan 2 days ago