Input vs Output

Always design prompts to be concise. Output tokens are roughly 4-5x more expensive than input tokens.

Batch Everything

If it doesn't need to be instant (like summaries or logs), use Batch API to instantly cut your cost in half.

Caching Strategy

Turn on Caching for repeated system prompts or RAG contexts. It's the highest ROI optimization for high-traffic apps.