Cost tracking is especially important for agentic applications because resource usage is determined dynamically by the agent itself. Our new cost-tracking upgrades give you:

• Granular Token Accounting: Track tokens across various dimensions including cached tokens, different token modalities (e.g., text, image), and a clear breakout of reasoning token costs.

• Flexible Cost Tracking: Track costs for arbitrary token types, ensuring precise spending visibility, no matter which models and which features you're using.

With these improvements, you'll know exactly your LLM spend is going—no matter which models and which features you're using.

Learn more about setting token-based costs in our developer documentation.