[–] written-beyond 4 days ago
[–] chrisXOXO 4 days ago
[–] mike_hearn 4 days ago
The little companies inferencing DeepSeek have no advantage over any other company doing the same thing. Therefore, their margins should look like any competitive industry. Farming, supermarkets, airlines are my go-to example. Usually margins in the 3% to 5% range. Profit margin average across all industry including very profitable ones like tech or oil is only 10%.
The companies offering inferencing and nothing else are relying on subsidies by the open weight model providers. If those companies all stopped releasing open weights tomorrow the offerings on OpenRouter would see rapid traffic declines as the knowledge in the weights became stale and as other companies that invested in proprietary R&D overtake them. So being profitable on inferencing open weights is a very short term play, and there's no reason to think it's a great business in the long run.
[–] written-beyond 4 days ago
I am not an AI denier, I use it and I find it very useful. That said I can disagree with the current economics of the industry and their business model.
[–] eeedda 4 days ago
Its difficult for people to accept this because many want the model producers to succeed badly.
SOrry folks...
Also these third-party providers are running magnitude smaller models than what Anthropic and OpenAI's power users expect from them. Yes the average chat message isn't being routed to the 1+ Trillion param model but people running CC or Codex on Ultra probably are. Those are objectively more expensive.