In general, LLM performance is incredibly multidimensional. There's no guarantee of a fixed ordering where the model that is best at math is also the model that's best at jokes. Despite that complexity, much of the variation in performance is explained by just a single variable: model size. In general, models that are bigger will (a) be more performant / reliable, (b) cost more per token, and (c) have better recall of esoteric facts. As you note, our models are ordered:
Luna < Terra < Sol < Astra
Even today, I'd recommend this as a general starting point for picking models. If you care about quality only, pick Astra. If you're a bit price sensitive, pick Sol. If you're very price sensitive, pick Terra or Luna.
Of course, model size doesn't capture all variation. Models that are trained later might have new data or new techniques or new architectures that earlier models lack. You can see this with models from all providers - Sonnet 5.5 outperforms Fable 5.1 in ways, and Gemini 3.8 Flash outperforms 3.1 Pro in ways.
In the case of GPT-6.1 Terra, I'd say Terra is probably better than Astra and Sol at technical communication, similar on vision and computer use (but much faster!), and a bit worse on most other things. For API developers, it's a nice midrange option if you want something cheaper than Sol but a lot smarter than Luna (especially for vision / computer use / communication). For subscribers, it's not a bombshell release - if you're hitting usage limits, maybe it helps you go a bit further, and if you want clearer communication or faster computer use, it can be a nice option to select.
If you have suggestions on how to name our products better, I'm all ears. Our intention is to make things clear and simple, even if we miss the mark sometimes.
Unfortunately, a lot of the complexity is somewhat irreducible and due to to the actual complexity of the products. Scaling model size is different from scaling reasoning effort which is different from scaling multi-agent count. So if we just swept all of those under a single name of "more IQ", it would make the naming simpler but the experience much worse, as important details would be obfuscated from end users.
[–] atombender 3 days ago
[–] tedsanders 3 days ago
I don't know, to be honest. Technical documentation is such a multidimensional skill, and I also don't know your budget. I'd imagine Terra might have the most readable prose, but Astra might be more likely to catch bugs or mistakes to highlight. If the documentation is about a more esoteric language or situation, Astra might have a greater edge than if it's a common language or situation. If you have a long list of documentation guidelines, that might also give more of an edge to Astra. I wouldn't want to make a recommendation without doing a lot of testing, and I haven't done a lot of testing.
[–] flockonus 3 days ago
[–] tedsanders 3 days ago
But to assess whether my preference on my problem is going to generalize across other people, other programming languages, other documentation types/formats, etc., and then analyze statistical significance is a thornier question that I don't have the data to answer. I'd rather make no recommendation than a weakly informed recommendation.
[–] mrandish 2 days ago
That's what users currently end up having to do on their own. Or they just give up in confusion, which presents in your site analytics as either bounce, buy later or buy less.
Why not have a model comparison site? Visitors choose from a dozen-ish broad categories of work (eg technical documentation, market communications, etc), then pick from a dozen sample prompts across typical tasks in that category, and see the model responses with avg time and approximate cost. Especially helpful would be having a toggle overlay with annotation highlighting relevant differences, then if they have (or create) an account, they can edit the annotations and add their own with a sharing link.
If my job was to actually help my co-workers and friends make better informed choices they feel more confident in, I'd be doing something like that. The extra credit version would help users narrow down to two models and then let them convert to a 'Test Drive' trial - same workflow but from their own prompts, side-by-side A/B response comparisons with annotation and sharing link.
As you said, the answer to "Which model is best for me?" is actually complicated, conditional and inevitably a bit confusing. When that's the reality, the right pattern isn't 'Communicate to Convert', it's 'Build credibility and confidence with maximum clarity and genuine helpfulness'.
[–] tedsanders 2 days ago
People vote on pairs of model responses and they aggregate everyone's votes into a leaderboard.
One thing to be aware of that the distribution of prompts on arena.ai can be pretty different than real-world usage. The people who spend time on that website casting votes tend to be more interested in entertainment than professional productivity. And turn-based voting can punish useful behavior like asking clarifying questions instead of guessing at assumptions.
[–] mrandish 2 days ago
[–] scarab92 3 days ago
It’s overkill most of the time, but frankly all these models are “cheap”, and I’d rather waste compute than brain cycles trying to discern which dials are best for each individual as-hoc query.
[–] selestify 3 days ago
[–] hsuduebc2 3 days ago
[–] junnan 3 days ago
[–] thirtygeo 3 days ago
[–] lazharichir 3 days ago
Create a realistic eval suite for your use case using your actual data that you manually label, with easier, more complex, rarer samples, and run each model you are considering against it and decide based on the usual confusion matrix, cost, latency, or whatever metrics matter to you. There's really no other way to know – and you might be surprised that cheaper models can often perform your task(s) relatively well at a fraction of the cost.
[–] awb 3 days ago
I’d imagine there’s only a tiny percentage of users that can or want to do this.
[–] aacid 3 days ago
but if you want to use some LLM agent for anything commercial and you want to get the best and at the same time you don't want to overpay the easiest and the surest would be to create your own benchmark for your specific use case.
[–] CSMastermind 3 days ago
Every model I've tried is just abysmal at this, for what it's worth.
If any do it well please let me know and I'll give it a spin.
[–] zenoprax 3 days ago
I recently experimented with some image generation models and I was surprised at how much context/prompting is needed to get something that doesn't look Lovecraftian. There was seemingly no downside to adding more and more detail up to the limit. Prose sits between code and images in terms of fuzziness and I wonder if promptmaxxing is the winning strategy for technical documentation.
I've been thinking that fine-tuning a model to write differently shouldn't be that hard (tedious, perhaps) and if I had the resources I would consider doing it myself.
[–] ilaksh 3 days ago
[–] no-name-here 3 days ago
It's high-level (and doesn't break out coding/writing etc), but https://developers.openai.com/api/docs/models says:
> If you're not sure where to start, use GPT-6 Astra, our flagship model for complex reasoning and coding. Choose GPT-6.1 Sol to balance intelligence and cost, or GPT-6 Luna for cost-sensitive, high-volume workloads.
That page also seems to be updated after each new release.
[–] saagarjha 3 days ago
[–] atombender 3 days ago
I do not use agents to write on behalf of myself. I write my won technical write-ups and my own slide presentations. A lot of people don't; and it shows. There's much that agents can do better than humans now, but not everything.
[–] saagarjha 3 days ago
[–] atombender 3 days ago
[–] GodelNumbering 3 days ago
Thanks. I think the very response you wrote here is a better form of marketing for the software engineers than what openAI puts out there. When everything is groundbreaking and everything tops charts, nothing is.
I suspect a lot of target demographic (developers) prefer simpler and honest communication about not just the models high points but low points too. With the linked Terra post, if I saw 1 chart that clearly highlighted the usecases for which Terra is _worse_ than higher tier models, I would be more convinced overall.
Everything trying to occupy the top spot in my brain's limited "top model" representation space is not helpful.
[–] vineyardmike 3 days ago
The website linked starts out with:
> We’re introducing GPT-6.1 Terra, a fast, efficient model that combines detailed visual reasoning and precise computer use alongside clearer, more natural writing. A significant step up from GPT‑5.6 Terra, it excels at the communication and computer-based tasks that fill the workday, from drafting proposals and interpreting technical drawings to filling out forms and editing videos.
If you go father down, it has graphs and details with specifics of this, including:
> We measured GPT-6.1 Terra’s computer-use capabilities... At medium reasoning effort, GPT-6.1 Terra scores 15 percentage points higher than GPT-5.6 Terra at about one-third the cost. It even performs on par with GPT-6 Astra at only one-tenth its price per token.
and
> On MMMU-Pro... It even nearly matches the scores of our most capable frontier model, GPT-6 Astra, and GPT-6.1 Sol at much lower cost.
[–] elxr 3 days ago
Terra and Luna are dirt cheap and good enough for 50% (or more) of the typical junior dev's workload, and great for routine work. Sol and Astra have so much written about them at this point that it should be obvious what those are good at. The large/gigantic models for things that need full intelligence and slightly more branching thinking.
[–] margalabargala 3 days ago
Luna < Terra < Sol < Astra, fine. But does Terra 6.1 beat Sol 6? Does Fable 5.1 beat Opus 5.5? If I build something around this Terra 6.1 release, then when Luna 6.2 is released in a month, should I swap?
[–] cdirkx 3 days ago
[–] Closi 3 days ago
If they were called iPhone 14 Luna and iPhone 16 Sol then this is less clear.
Or on the flipside, if the models were called GPT 6.1 Mini and GPT 6.1 Max, nobody would be arguing about the names being hard to grok. The words 'mini' or 'small' are more descriptive than 'Luna' or 'Terra'.
[–] lukeschlather 3 days ago
If you look back the naming problem started around the point that OpenAI started doing reasoning models (o1, 4o) where they had to describe this fork in model behavior that let a smaller model think longer and be smarter.
You can come up with naming schemes that don't clash, but there's something to be said for this approach where the thinking level is like you describe and the model name requires you to learn that Astra is the largest model.
[–] rpeden 3 days ago
* Luna (Moon)
* Terra (Earth)
* Sol (Sun)
* Astra (Galaxy/Universe)
The relative sizing seems dead simple.
[–] no-name-here 3 days ago
1. Even more dead simple if it just used Moon instead of Luna, Sun instead of Sol, etc. - one less quick translation in the head.
2. Or even more dead simple if it just used "Small", "Large", etc. - removing another quick translation in the head. (On the other hand, all these suggestions are English - maybe Luna, etc. is more understandable for non-English speakers?)
[–] Closi 2 days ago
[–] margalabargala 3 days ago
You're right! The relative sizing of models is dead simple. This doesn't help when there are improvements between release numbers, and models are released one at a time instead of as a family.
When Sol 6.4 comes out and the latest Astra is still 6.1, which do you use?
[–] arcfour 3 days ago
Or I might try both and pick whichever I prefer for a given task...
[–] Closi 2 days ago
Is a sunburst supposed to be bigger than a flare? I mean you get solar flares too? Or is a solar flare bigger than a sun 'burst' which usually just means some sun coming through clouds.
[–] margalabargala 3 days ago
Sure, in a hypothetical world where the latest Max phone is two generations older than the latest Mini phone. In which case now you have to evaluate not only screen size but ALSO specs and component age and software support etc. How badly do you need the bigger screen? Etc
If you are comparing the iPhone 16 Max to the iPhone 16 Mini, everything is a lot easier.
[–] saagarjha 3 days ago
I wish
[–] nailer 3 days ago
[–] kridsdale1 3 days ago
[–] someguyiguess 3 days ago
[–] XCSme 3 days ago
[–] breezybottom 3 days ago
[–] someguyiguess 3 days ago
[–] elxr 3 days ago
I'll just stick to mostly Sol on low/medium/high and start experimenting with Terra tomorrow onward to see what it does noticeably better than Luna/Deepseek flash.
Any pareto frontier model, especially from the leading labs is guarnateed to be good enough for whatever your expectations are at this point. A quick few day test should be enough for anyone to make their own conclusions.
[–] margalabargala 3 days ago
[–] solyin 3 days ago
[–] imtringued 3 days ago
If you want to go optimize your mouth hygiene it is actually more important to use dental bristles (flossing is not as good), because most of the work is done by the mechanical cleaning action of the tooth brush and you need to reach the places where the tooth brush cant get into.
Once you have done that, the next step is alcohol-free xylitol based mouth wash. Caries bacteria have trouble digesting xylitol so this reduces the presence of them in your mouth.
Only after you have done that, are you ready for something better than fluoride. Fluoride is a remineralization agent. Your saliva also contains calcium that helps your teeth remineralize. So the next thing you need is a more potent remineralization agent. Basically your tooth paste acts as a more concentrated saliva. Because of that, it is actually better to use e.g. fluoride in the morning and a different agent in the evening.
The classic options are bioglass (novamin) or hydroxyapatite. The latter is also available as mouth wash.
[–] 2III7 3 days ago
[–] mc3301 3 days ago
[–] nailer 3 days ago
> Run your own evals then if you have this much of a need to "correctly" choose.
No. OpenAI want my money, it's on them to communicate properly.
[–] nharada 3 days ago
[–] nailer 3 days ago
[–] austhrow743 3 days ago
[–] ssl-3 3 days ago
[–] nailer 2 days ago
[–] ssl-3 2 days ago
But here we have LLMs, wherein: It depends. The smaller models can in fact outperform the bigger ones, and get some stuff done cheaper, better, and faster.
If the question is "Which one is best?" then the answer is "It depends on what the fuck you're doing."
(If that answer is found to be unfulfilling, then let it serve as an indication that a person may be better-served by improving their questions.)
[–] 0-_-0 3 days ago
[–] Majromax 3 days ago
I understand how it can be confusing, but I don't think that this is exactly a problem.
Luna through Astra offer qualitative descriptions of the model's size. Presumably OpenAI trains its biggest model (Astra-ish, maybe even larger) first, then distills it to smaller sizes.
Verison numbers reflect something about the architecture or training dataset. Again, they keep these details close to their chest, but we should expect that weight-for-weight higher versions should beat lower versions.
This offers us two axes of 'better', but these axes are also not directly comparable. An earlier but bigger model may or may not beat a newer but smaller model. This is where 'spiky' intelligence comes in.
This is also where calls to 'run your own evaluation' really do start to matter. If you care enough about this performance[1], then you also have specific problems that you care about. No generic benchmark can fully answer that question, hence the need for a specific evaluation.
[1] — And you don't have to! A casual user is probably served reasonably well by anything put out in the past six months. I think Microsoft is still serving GPT-4o under some Copilot branding.
[–] margalabargala 3 days ago
Whether they train the biggest model first or not is not relevant; what matters is what they release. Right now we've got 6.1 Sol and 6.0 Astra. Over at Anthropic they've got Opus 5.5 and Fable 5.1. The existence of a hypothetical Fable 5.5 that I'm not allowed to use doesn't help me.
[–] at1as 3 days ago
I wouldn't necessarily say that. Atmospheric mass may be obvious to us, but I suspect it's not nearly as universal knowledge as one may assume.
And I actually assumed at first that they were based on distance from us (terra < luna < sol), so I kept confusing terra and luna.
[–] someguyiguess 3 days ago
[–] torben-friis 3 days ago
- Understanding how effort and class interact (Is a high effort terra above a low effort Sol? Are larger models mostly always better regardless of effort?)
- understanding when (if ever) a new model tends to be better than an older but higher class one. Is an old astra better than a new terra?
If increasing effort and increasing model class produce improved results in a different way, I miss making it explicit in which way. In other words: What kind of issue warrants going up in effort? what kind of issue warrants going up in model class? What kind of issue is unlikely to be solved by either?
[–] tedd4u 3 days ago
[–] someguyiguess 3 days ago
[–] andai 3 days ago
Oh, easy:
Artificial Analysis has their own curves which are pretty similar.
[–] irthomasthomas 3 days ago
[–] aftbit 3 days ago
[–] dist-epoch 3 days ago
You can literally see this in the charts from the article
[–] __jl__ 3 days ago
Personally, I pretty much exclusively use claude for coding work (sorry!). Our application is running almost 100% on OpenAI API (except for some fallback models). It is the best API on the market. The models are excellent particularly for any application that is cost sensitive.
[–] mckirk 3 days ago
That could solve the 'more IQ' problem, because you'd actually have different dimensions (e.g. for 'raw intelligence', technical writing, emotional understanding, etc) that you could use to communicate the differences in models better.
(Of course people would instantly start complaining that the benchmarks numbers are probably fake etc, but it is what it is.)
[–] Yajirobe 3 days ago
[–] mckirk 3 days ago
[–] Iolaum 3 days ago
> Despite that complexity, much of the variation in performance is explained by just a single variable: model size.
please release model size :p
[–] mrandish 2 days ago
Ted,
I'm assuming you're not in the OAI marketing dept because leading with a simple thumbnail like "Luna < Terra < Sol < Astra" is helpful framing and dropping next-level bombs like:
> "Terra is probably better than Astra and Sol at technical communication, similar on vision and computer use (but much faster!), and a bit worse on most other things. For API developers, it's a nice midrange option if you want something cheaper than Sol but a lot smarter than Luna (especially for vision / computer use / communication). For subscribers, it's not a bombshell release - if you're hitting usage limits, maybe it helps you go a bit further, and if you want clearer communication or faster computer use, it can be a nice option to select."
Is just far too clear and useful! I'm kidding... but it's funny because it's a little bit true.
> Our intention is to make things clear and simple
Your post is the single best product marketing communication I've ever seen from OAI. Serious suggestion: maybe just say something like that on the website. Not buried in a blog post but above the fold.
[–] qhwudbebd 3 days ago
[–] mnicky 3 days ago
[–] sgerenser 3 days ago
[–] qhwudbebd 2 days ago
[–] p0sixlang 2 days ago
[–] robswc 3 days ago
I'm not the one you were talking with but catching you is godsend since I just ran into a lot of confusion on the naming myself. I think some of it has to do with how they are labeled in the app.
I think simple numbers in naming is great, even 6.1 is fine bc I understand that if I want the latest model, I just need to look for the biggest number. Where I got confused is in the "work" tab, I saw 'Astra' is set as the default. I see the label for it is:
"Frontier intelligence for your most demanding tasks."
To me that reads "this is the 'best' model." Then I see Sol-6.1 which is labeled:
"For coding and every day work."
Then Terra-6.1 is:
"Terra 6.1 Codex Model" (tbh this one might be the most confusing, I'm aware of codex the product but Sol is the one labeled good at coding)
From my POV as a basic plan-based user wanting to do something like...
> design a robust event-driven system, here's the details [...]
I honestly have no idea which one I should use.
Would Astra-6 produce a better design than Sol-6.1? Is the '.1' a big step up from Sol-6? (I'm guessing no but I truly have no idea). I would assume the answer is Astra-6 would produce the best one, even though the labels don't imply it is necessarily geared towards coding?
But tbh the "default" seems to always work for me... and after reading your comment, typing this one out, being forced to think about it... it doesn't seem too bad given your challenges in communicating the purposes of each model and wide audience of consumers. I'm also sure anyone could find a million problems with decisions I've made in software I've built so I try to not be too harsh :)
[–] osigurdson 3 days ago
<version>-<size>
Where <version>: 6.0, 6.1, etc., and <size>: xs | sm | md | lg
E.g. 6.1 Terra = 6.1-sm
If you eventually make specializations like "math" and "jokes" then I would call it something like 6.1-jokes-sm.
[–] 6thbit 3 days ago
We're probably headed to further specialized agents where a single ordering or even model size won't mean a lot.
[–] pietz 3 days ago
[–] ceroxylon 3 days ago
[–] CompoundEyes 3 days ago
A favorite…
Prompt: “Tell a joke about mother in laws”
Gemma2 response: “What’s the best kind of mother in law? A dead one.” 0_o
[–] NikolaNovak 3 days ago
I.e. are all version numbers independent and Model X 7.5 is not necessarily of the same generation or cut off as Model Y 7.5? Or do all of your 6.1 models have something in common - cut off data, generation, baseline technology, approach, architecture, or something else?
Thanks! :)
[–] tedsanders 3 days ago
Back in the day we used numbers to also sometimes indicate size, which could make it extra confusing: e.g., we launched GPT-4.1 (an incremental update on GPT-4) after GPT-4.5 (a new model that was a big jump over GPT-4).
[–] mchusma 3 days ago
With an optional flash mode.
Then as you release models, you pick the model and thinking level that you believe is pareto optimal for cost/performance.
So this auto updates each release, like Terra was probably off this list entirely, but maybe this would appear now in Auto medium or something like that.
I know from looking at charts that each model seems to have sweet spots (like I always use this model in this thinking level and if i want to go cheaper i go here). If you picked those for us, it would be interesting. I do think you should keep the model families for those wanting more consistent experiences, but for many devs they may want to just pick auto something and have it update over time. I think nice if it actually just said in parenthesis what it was, something like: Auto Medium (Terra 6.1 High)
I am not sure if everyone would agree here though. I'm obivously advocating for more naming schemes, and i understand the irony.
[–] mchusma 3 days ago
xlow = Luna Low
low = Luna xhigh
medium = Terra medium
high = Sol medium
xhigh = Sol xhigh
Max = Astra something?
[–] throw20261022 2 days ago
[–] jonplackett 3 days ago
It’s probably just unavoidable. Like when Apple release a new MacBook Air first and it is (in some ways) faster than the old MacBook Pro.
I think the planets thing is a bit confusing though. I hadn’t really thought about it being based on the size of the planet. I assumed it was based on how far away they were with terra therefore being the base one.
[–] ksec 3 days ago
>If you have suggestions on how to name our products better......
Too late for that. I hope you guys can at least stick to these naming scheme for at least another 2-3 years going forward. Not everyone follows AI / LLM intensely, and it seems there is a new naming changes every year or so.
At least conceptually OpenAI's naming is easier to understand than Claude.
It terms of capability, it would be great to make it clear somewhere that this is 6.1 Model "+" technical communication, vision and computer use improvements. So that at least we know what we should try with these new release and choose a better model for certain workload.
Right now, other than pricing, it is confusing as hell. And in hindsight I wonder if there are fatigue in choosing one people just go with Open Model and stick with it if it is good enough.
[–] user_7832 2 days ago
Is this really so/could you give a rough example please? I've not used a lot of Claude or ChatGPT, but 3.1 Pro always feels most grounded and intelligent. 3.8 Flash (in my very limited testing) isn't bad, but it feels less nuanced.
(Fwiw I don't use it for code, but ask maths and real world logic based questions.)
[–] miki123211 3 days ago
You have Luna, Terra, Sol and Astra, each with 4+ reasoning levels. That's ~20 options to choose from.
On a repetitive task like customer support or something, where you have decent benchmarks, you can plot cost versus performance, but you can't really do that on coding.
[–] nish__ 3 days ago
Maybe stop using version numbers then and just name models like you'd name children.
[–] ortonomy_ 3 days ago
Medium v10 vs Big v2 makes it look weird and confusing. Especially when there are a sea of influencers and twitters with vibe assessments who will tell you new models best olds models.
Can’t you just start at the top or bottom.
Release new big for paying customers -> release new medium for paying customers -> release new small for everyone
Rinse and repeat. We’d all be much happier
[–] krmmalik 3 days ago
I'm just worried the system design won't be as good if I choose a lesser model so to speak.
Edit: typos/grammar
[–] ssk42 3 days ago
[–] tedsanders 3 days ago
[–] pama 3 days ago
[–] jamiek88 3 days ago
[–] jasondigitized 3 days ago
[–] curiousObject 3 days ago
[–] breezybottom 3 days ago
[–] pavlus 3 days ago
This seems like one of those cases, where CalVer would be appropriate, and you likely have ideas what you aim for while training, so technical model names (ids?) could include aliases to most things you said. Like 2026q4-xlarge-researcher, 2026q4-medium-humanitarian, 2026q4-medium-coder, 2027q1-small-analyst etc.
[–] Closi 3 days ago
> If you have suggestions on how to name our products better, I'm all ears. Our intention is to make things clear and simple, even if we miss the mark sometimes.
How about naming the models:
"Small", "Medium", "Large" and "Very Large"
Or refer to them by parameter count like other companies (e.g. this is 6.1 5T)
If I have a clothing store, and rather than name the clothes sizes Small, Medium and Large I decide to call them Urgon, Planfar and Fangor I shouldn't be surprised if people think my size naming is confusing or silly. And IMO it's not a great explanation to say "oh it's easy, if you are skinny then you should get Urgon, but then if you are a bit more of a medium build you should get a Planfar, but if you want something a bit baggier than Fangor will really work out for you"
[–] tedsanders 3 days ago
As a point of comparison, GPT-3 was launched in a series of small, medium, large, and XL. Back then, XL meant a mere 1.3 billion parameters!
[–] Closi 3 days ago
You wouldn't - you would just put the version before it - 6.1 Small, 6.0 Medium etc. Not that complex.
Think of an iPhone 18 Pro - No need for 'iPhone 18 Even Better Super Pro' because the 'Pro' is relative with the version/generation.
[–] Bluestein 3 days ago
[–] switchbak 3 days ago
Of course we have far too many benchmarks (of questionable utility), but it would be helpful to get OpenAI's take on where it slots in, and how the landscape changes as these get rolled out.
[–] avazhi 3 days ago
Well you definitely missed that mark extremely badly here.
[–] tedsanders 3 days ago
[–] avazhi 3 days ago
I can’t tell you the difference between the 10 different versions of the current iPhone and I can’t you the difference between the 5-6 different models put out by the Anthropics/OpenAIs of the world. At this point I just try to track the flagship and then the cheapest one or worst case I just use the flagship.
I’m sure internally there’s data showing people want choice and options but decision fatigue is of course very real.
[–] tedsanders 3 days ago
[–] pmcarlton 3 days ago
[–] plaguuuuuu 3 days ago
Despite Opus 5.5 being newer and "better" if you read benchmarks, I've found Fable to be better for some things (subjective stuff)
[–] avaer 3 days ago
Have a model alias called "math", another "jokes". Quality labels/date suffixes to these obvious labels. Repoint as needed.
Something for people who don't want to play the cute "which part of the solar system is trending this week" game.
[–] tedsanders 3 days ago
Even "writing" as a single concept is very multidimensional. There's fiction writing, nonfiction for experts, nonfiction for learners, deep research, quick lookup Q&A, copyediting, writing in documents / artifacts, instruction following about style, and default quirks (e.g., em dashes, negation, loving the word "tapestry"). Some models are great writers but less diverse, meaning people prefer the first story they read but disprefer the tenth. How does one label such a model?
[–] avaer 3 days ago
But this is exactly what we have! Except it's worse, because the model usage recommendation isn't in the API, it's in some random person's X advice that's no longer current this week.
I understand AI companies wash their hands of this problem because it's hard, and they themselves barely understand the true capability matrix of the models they're selling.
I just don't think some effort to categorize models and expose that to users would be messier than what we have -- model selection driven by influencer voodoo bandwagons and analogies to literal astrology.
[–] Ntrails 3 days ago
I don't expect the vast majority of your users care. I would guess they want a rough proxy for "cost" and will assume cost=>capability are roughly linked in a linear fashion.
it is very possible that the users weighted by spend do, and I'm therefore simply wrong. But, 2c
[–] sin4ch 3 days ago
Also, I think the naming is great. Like you said, Anthropic faces the same issues you do. Opus is much better at Fable in a lot of stuff without being quite as huge or as smart.
Congrats on the launch.
[–] pizzafeelsright 3 days ago
Versions are good for backend but when communicating I want 2 or 3 levels of detail.
Class_Generation_Modifier
Astra_8_Fast
That's it.
This means: Class - Tells me what it can do, how well. Generation X end of life is ~18 months. Modifier: Variation of options.
And the modifier can be dropped if you add more classes.
[–] 0xbadcafebee 3 days ago
Tiny/2026-11. Medium/2026-6. Big/2026-10. XL/2026-01. It may not be sexy, but people know exactly what it is and what to use.
[–] alcidesfonseca 3 days ago
GPT 6.1 X > GPT 6.0 X GPT Y Astra > GPT Y Sol > GPT Y Terra > GPT Y Luna
This order is very important.
[–] deno 2 days ago
[–] mi_lk 3 days ago
Instead, we got Opus 5.5, Sonnet 5.5 and Haiku 5.5 released weeks apart, and so are Sol 6.1 and Terra 6.1?
[–] RussianCow 3 days ago
[–] manquer 3 days ago
all training runs have to at some level share the compute capacity ; while they have more than enough to run many large runs concurrently, they don’t have enough compute to run everything concurrently.
[–] misiti3780 3 days ago
[–] zahlman 3 days ago
[–] Sha1rholder 3 days ago
[–] greenavocado 3 days ago
Terra 2026.2
[–] someguyiguess 3 days ago
[–] Haunt1000 3 days ago
[–] ur-whale 3 days ago
Hire an actual marketing person instead of letting engineers / ML researchers do things they're clearly terrible at ?
[–] SoKamil 3 days ago
[–] thejazzman 3 days ago
it's almost like ya'll let the AI name it ;)
[–] signatoremo 3 days ago
[–] qlte 3 days ago
[–] nickv 3 days ago
[–] inopinatus 3 days ago
[–] throw20261022 2 days ago
That is false, considering Astra and Luna don't even exist for 6.1. Terra didn't exist for 6.1 until yesterday. You don't get to make up imaginary tiers. The inconsistency wrt their availability, starting with day 1 of a new model version, is precisely the problem. OpenAI is a user-hostile joke of a firm that users would do well to abandon.
[–] BodyCulture 3 days ago
You certainly know that it happened not by accident that traditional computers are producing reliable results, a lot of work went into this.
Computers must produce reliable results, they are simply not useful if not.
People will understand that at some point, but a lot of damage already has been done.
[–] halfmatthalfcat 3 days ago
For some reason, this is just hilarious to me. Idk if you're being serious or if this is passive aggressive but the thought of OAI actually taking advice from a random HNer and basing their naming scheme off that is peak.
[–] jaggederest 3 days ago
Where else would you go? I'm honestly scratching my head thinking of someplace that wouldn't run you out on a rail, but that would give serious feedback. Kernel mailing lists are out, maybe there's something like that which I can't remember off the top of my head, but...
Also, nomenclature is incredibly hard. There are only two hard problems in computer science: cache expiration and naming things.
[–] halfmatthalfcat 3 days ago
[–] jaggederest 3 days ago
The primary users of any API are the designers and engineers of the applications that use it. How many laypeople know what Postgresql is? How many of the applications they use run on it?
What's confusing to me in addition to the naming is that there are no published guidelines I can use, as far as I can see. Put yourself in the user's shoes. On what basis should one pick a model for a given task?
I can understand smaller models being dumber and faster. That aligns well with scenarios where you are willing to compromise; e.g. you're classifying content or asking a model to format text into a table.
But when you want "maximum intelligence, cost and time be damned", there's the implication that bigger models are smarter on a linear scale, and every provider's model release naming is currently conflicting with that expectation.
This isn't just a naming problem, but a communication problem. If I knew that Astra was the best at coding but a bit bad at writing, and Sol was almost as smart but better at technical writing, then that's the kind of thing I expect to be documented.
One possible way: A simple matrix with horizontal columns like "writing", "coding", "math", rows are the models, and each box is a number of stars from 1-5.
Instead, this sort of thing becomes lore, shared by word of mouth.