points by kylehotchkiss 1 day ago | 0 comments
I have one. It can run lots of smaller models really well. I’ve been loving Gemma4 especially. My needs more more large scale information extraction and not trying to replace Claude code locally though.
If anything the interesting models that can run in about 64gb of memory are increasing because most people can’t access more memory than that. I’m especially excited for clef and cleric as they continue to improve. Yeah, you don’t get 1mil token context length, but even frontier models can lose focus at that level
I've been tempted to just get the M5 Max instead and just innovate with smaller models myself.