points by fy20 3 days ago | 0 comments
Yes but you are missing the point. It's the case where Luna is not good enough, and Sol is too much. The problem is that on benchmarks Luna xhigh is typically comparable to Sol low in terms of capability. So where does Terra fit in?
[–] h14h 2 days ago
[–] dannyw 3 days ago
World knowledge, factual recall without grounding, more complex instruction following, etc.
Benchmarks don’t really tell you much. For API best will always be a model+effort sweep on your internal evals (and if you don’t have internal evals, do that first).
For individual coding harnesses, honestly I just go with vibes. The best workflow is the one that works for you.
Terra 6.1 on low reasoning outperforms Luna 6 on max reasoning, while costing half as much per task and completing each task over 10x faster (per AA v5).
Luna 6.1 will likely close the intelligence & cost gaps, but that speed advantage will remain.