Hacker News

points by smallmancontrov 4 days ago | 0 comments

Yes, but DeepSeek went absolute goblin-mode on optimization and I would not be shocked to discover that OpenAI and Anthropic were behind on that front.

[–] Art9681 4 days ago

OpenAI and Anthropic have more compute and the best frontier models to throw at the optimization problems. They have published articles on these efforts. For example, Dots, and Anthropic's upcoming "persistent agent" is because of these optimizations. Both companies often publish articles detailing a lot of their technical efforts. They just get buried among the flood of other news.

[–] smallmancontrov 3 days ago

That's just it: they have more compute. They have a "do more with more" lever in addition to a "do slightly less with much less" lever. DeepSeek can't win with the first lever, so they have committed everything to the second, while within the frontier labs the two levers fight for attention and frankly the first is clearly the favored child. I'm not accusing OpenAI and Anthropic of being slouches, but I am not sure that more resources + divided goals > singleminded pursuit of a singular goal.

[–] 332451b 4 days ago

Yes, I would not be shocked either.

Sonnet 5.5 is 16x more expensive at $10 per million output tokens. Kimi K3.1 is also $10 per million output tokens, and its number of active parameters is only 6.5x larger than V4.1 Flash (104B compared to 16B). These things are not directly comparable of course, but just to give an idea.

Even if inference of those models needs 16x, 32x, or 48x the number of GPUs compared to V4.1 Flash, still seems like potentially great revenue per GPU.

[–] eeedda 4 days ago

My friend you are looking at the wrong number.

Its cash flows to the GPU that matter. Not revenue.

[–] Gareth321 4 days ago

They published all/most of their work and it would be unbelievable if Anthropic had not already used that research in their own architecture.

[–] cactusplant7374 4 days ago

What is the TPS of DeepSeek? All of the LLMs I have tried are slow as molasses. \

[–] micw 4 days ago

I use TensorX (EU hosted) and get 330TPS

[–] selectodude 4 days ago

I pretty reliably get 200 tokens per second on deep infra.

[–] kristianp 2 days ago

Deepinfra has a "contact sales" link. I assume personal accounts aren't available.