If they are literally sending the entire transcript and asking for a summary, wouldn't almost all of the tokens be cache hit, and therefore fairly cheap?
If it happens 10 times you have already accepted the same cost as the entire session fresh prefill.
People on HN are either too rich or wayyy too rich
But if you are telling me I am wasting like a good 10-20% of my tokens on summaries I might as well stop using your service, worst part is claude doesn't let you use something else.
Looks like what I remembered was a bug.
If they were doing that, then a cheaper (prompt-cache friendly) option is just to silently send the whole conversation with the summariser prompt appended
Do you disagree with the numbers and conclusion in the -pretty obviously bot-generated- Fine Article?
And I don't really get the point of this feature, I've always found it super annoying that the main agent creates a subagent with the clear description of "Fix tile cache" for example, and then after a while it turns into something generic like "Running browser tests"