points by anakaiti 2 days ago | 0 comments
The drop for K3.1 Pro & MiMo V2.6 Pro is quite surprising. Are they benchmaxxed?
[–] prodigycorp 2 days ago
Transparently so. MiMo's training dashboard showed the DeepSWE hillclimb in real time.
[–] throwa356262 1 day ago
That's not benchmaxing.
You need a method to show you RL is improving the model that is separate from the training data.
[–] simianwords 2 days ago
I keep seeing that MiMo is in the frontier in terms of performance and cost but I see very few talking about it and the only ones that do talk about it are doing it in context of AA
[–] brainwad 2 days ago
It's also dog slow at AA index tasks compared to other models in its class. Makes me think they optimised for getting on the intelligence/cost frontier at the cost of real world usability.
[–] simianwords 2 days ago
I’d bet on this
[–] wyre 2 days ago
I used MiMo for a couple of days waiting for my Codex sub to reset. I really liked it, its communication style was a breath of fresh air compared to how stale gpt-sol is.
[–] adg001 2 days ago
[–] gobdovan 2 days ago
[–] adg001 2 days ago
[–] gobdovan 1 day ago