What market is going to care about the number of tokens somebody uses? That's like a market that cares about the number of if statements in a piece of code. It's nonsense.
But they don't. If that was how making money with LLMs worked, everyone would just generate models that generate tokens that do nothing. But of course that is not how it works and they don't.
It's just really bad to do something with a lot of waste that someone else can do with less waste.
So what you're saying is that they're not actually trying to maximize profit, they're just trying to maximize profit to prove that they can maximize profit for investors?
[–] adwn 21 hours ago
[–] jstummbillig 9 hours ago
It's just really bad to do something with a lot of waste that someone else can do with less waste.
[–] pessimizer 16 hours ago