Quantifying LLM Cost Savings from Cache-Aware Inference Routing

1 comments

• zxy-action 6 hours ago ago

  I’m the founder of Auriko. We ran this study to measure how much cache-aware llm routing can reduce inference costs.

  Critique welcome.