Hacker News

points by cactusplant7374 4 days ago | 0 comments

What is the TPS of DeepSeek? All of the LLMs I have tried are slow as molasses. \

I use TensorX (EU hosted) and get 330TPS

I pretty reliably get 200 tokens per second on deep infra.

Deepinfra has a "contact sales" link. I assume personal accounts aren't available.