Not everything should cost a token: the case for deterministic AI
What's happening
Teams building AI products are hitting unpredictable usage costs as API calls and contexts balloon, prompting a push for deterministic AI patterns where some operations do not consume tokens. Conversations point to cost spikes caused by retries, repeated tool calls, long-running workflows, and context growth across steps. The argument 'Not everything should cost a token' is emerging as engineers compare runaway API bills to the cost of the engineers themselves. Practitioners are looking through logs and traces to map workflows and figure out why a single step can suddenly cost 2x more than usual.
Why it's trending
Cost spikes from retries, repeated calls, and growing context are making token-based billing feel risky for production AI workflows right now.
SignalNewly emerging, confirmed across 2 independent source types.
Story volume
Stories per dayAngles you could write
If your AI bill is outpacing your engineers, maybe the problem is charging per token, not the model you chose.
+2 more angles for this topic with an account — all it takes is your email.
Original sources3
- Not everything should cost a token: the case for deterministic AIHackerNewsJul 6
- How do you Mapout AI workflows when one suddenly costs 2× more than usual?
After talking to a few teams building AI products, one pattern keeps coming up. Cost spikes are usually easy to notice, but understanding why they happened is much harder. Some examples I've heard: retries after failures repeated tool calls long-running workflows context growing over multiple steps Most people mentioned looking through logs or traces to reconstruct what happened. I'm curious how y
r/artificialJul 6 - When AI Costs More Than the EngineerHackerNewsJul 6
More rising in AI & Tech
- 'AI runs on semiconductors': Why chips have become the world's most valuable technologyClimbing2.4Climbing2.4 momentum
- AI leaders sign statement asking the government to do something about automated AIClimbing1.9Climbing1.9 momentum
- Google just had its first negative cash flow quarter due to massive AI spendingClimbing2.8Climbing2.8 momentum
- How AI guardrails are impeding the work of offensive cybersecurity researchersSteady0.8Steady0.8 momentum
- Korean chip stocks tumble with SK Hynix below US listing price amid China competition fearsClimbing1.9Climbing1.9 momentum
- AMD vs. Nvidia: What AMD’s Major $5 Billion AI-Chip Deal With Anthropic Means for InvestorsSteady0.5Steady0.5 momentum