Hacker News

points by minraws 1 day ago | 0 comments

I don't want to sound rude but even at cache hit you are burning almost input * 0.10 * context amount of tokens multiple times.

If it happens 10 times you have already accepted the same cost as the entire session fresh prefill.

People on HN are either too rich or wayyy too rich

[–] odo1242 22 hours ago

But you also burn the exact same number of tokens (actually more) every time the model makes a tool call. It's an agent, it makes a lot of tool calls.

[–] kristjansson 22 hours ago

This is the right perspective. It costs as much as one additional tool call in the conversation. It’s a bit weird to do it on a timer, which inflates a bit over “just a tool call”, but not by much?

[–] brookst 17 hours ago

Tool calls don’t sent the full transcript? I think you mean one more turn?

[–] hedora 16 hours ago

Pretty much everything sends the full transcript. That’s how LLMs work, and why “compact before cache expiry” is now a default in Claude Code. Cache hits are incredibly cheap to service on the provider side.

[–] RockRobotRock 1 day ago

Who pays for their own tokens at full price?

[–] cheeseface 23 hours ago

All Claude Enterprise customers.

[–] krzyk 22 hours ago

Most claude code users, minority can still use subscriptions.

[–] serf 1 day ago

given that the subsidized plans from all companies are getting worse by the hour it's probably a smart thing to consider, at least.

[–] minraws 19 hours ago

I mean all big businesses (150+ peep) have to pay that much, it's the reality of the times. Getting some AI imho essential/good, one 200$ plan or spending 5000-7000$ per engineering team sure, 100$ plans or 3000$ for most semi technical staff definitely.

But if you are telling me I am wasting like a good 10-20% of my tokens on summaries I might as well stop using your service, worst part is claude doesn't let you use something else.

[–] simianwords 1 day ago

Isn’t it 0.2?

[–] minraws 1 day ago

It's 0.1 I think brain fart I typed the rest correctly though after 10 summaries you still burn the same amount of tokens