Hacker News

points by elxr 3 days ago | 0 comments

Run your own evals then if you have this much of a need to "correctly" choose. That'll make it clear.

I'll just stick to mostly Sol on low/medium/high and start experimenting with Terra tomorrow onward to see what it does noticeably better than Luna/Deepseek flash.

Any pareto frontier model, especially from the leading labs is guarnateed to be good enough for whatever your expectations are at this point. A quick few day test should be enough for anyone to make their own conclusions.

[–] margalabargala 3 days ago

Right, having products so poorly described that a customer needs to run their own evals to choose well is exactly what is being complained about.

[–] solyin 3 days ago

Or I'm going to give up and not use any. Consumers aren't perfectly rational. This isn't like toothpaste, where, despite being overwhelmed at the store, I still need to brush my teeth so ahhhhhh fuckit and just pick a toothpaste out of the 30 available. The alternative is I keep using Google search and think AI is stupid. Or just use Facebook's thing.

[–] imtringued 3 days ago

The irony with tooth paste is that out of those 30, probably 28 are exactly identical. If all you want is fluoride tooth paste then pick the cheapest tooth paste.

If you want to go optimize your mouth hygiene it is actually more important to use dental bristles (flossing is not as good), because most of the work is done by the mechanical cleaning action of the tooth brush and you need to reach the places where the tooth brush cant get into.

Once you have done that, the next step is alcohol-free xylitol based mouth wash. Caries bacteria have trouble digesting xylitol so this reduces the presence of them in your mouth.

Only after you have done that, are you ready for something better than fluoride. Fluoride is a remineralization agent. Your saliva also contains calcium that helps your teeth remineralize. So the next thing you need is a more potent remineralization agent. Basically your tooth paste acts as a more concentrated saliva. Because of that, it is actually better to use e.g. fluoride in the morning and a different agent in the evening.

The classic options are bioglass (novamin) or hydroxyapatite. The latter is also available as mouth wash.

[–] 2III7 3 days ago

The frontier toothpaste is the one with bioglass 45S5. Especially if you have sensitive teeth or your teeth are prone to caries.

[–] mc3301 3 days ago

Nano-HAp is good, too

[–] nailer 3 days ago

> > But does Terra 6.1 beat Sol 6?

> Run your own evals then if you have this much of a need to "correctly" choose.

No. OpenAI want my money, it's on them to communicate properly.

[–] nharada 3 days ago

What would you want to see instead? Not sure about you but my needs are specific enough that I don't think OAI has evals for them, and I wouldn't want to give them that data even if they wanted to run it for me.

[–] nailer 3 days ago

“ChatGPT 6.1 Max” would be simple.

[–] austhrow743 3 days ago

Then you're going to have ChatGPT 6.1 Max Low and ChatGPT 6.1 Max Max.

[–] nailer 2 days ago

No you're not.

[–] austhrow743 2 days ago

You're suggesting renaming the effort level as well?

[–] ssl-3 3 days ago

How does one more-properly articulate "it depends"?

[–] nailer 2 days ago

"New model, middle version" is already communicated well by Apple.

[–] ssl-3 2 days ago

That's a computer, wherein: More is better.

But here we have LLMs, wherein: It depends. The smaller models can in fact outperform the bigger ones, and get some stuff done cheaper, better, and faster.

If the question is "Which one is best?" then the answer is "It depends on what the fuck you're doing."

(If that answer is found to be unfulfilling, then let it serve as an indication that a person may be better-served by improving their questions.)

[–] 0-_-0 3 days ago

On what?