points by ac29 3 days ago | 0 comments
Yeah, I spent the last week with Deepseek Flash 4.1-1017, Kimi 3, and GLM 5.3 (and 5.3-flash). None of them were literally useless but also none of them were capable of making progress on the main project I am working on where Opus, Sol, and even Gemini Flash have all done very good work. Benchmarks might have you believe open models are only barely behind the big US labs in intelligence, but it feels much worse in practice.
[–] joshheitzman 3 days ago
As a counter-example, I use Deepseek v4.1 Flash to make progress on multiple projects (Python, C++, CUDA) every single day.
[–] jacquesm 3 days ago