12 models, one daily driver: OpenRouter's Peter Walker on how teams choose AI
Notas del episodio
Peter Walker, Head of Insights at OpenRouter and previously at Carta, sees how about 120,000 US organisations use AI models every day. He expected their usage to spread across models. Instead, the typical organisation now uses about 12 models a month, with one daily driver taking most of the tokens and specialists around it. He and Yaniv get into why, in his view, the same model can get opposite reviews depending on who serves it, how cache rates quietly set the bill for agent workloads, why writing quality pushed Yaniv from Claude loyalty to using OpenAI too, and whether open-weight models are falling further behind the frontier. For engineers and founders deciding which models to run in production, it is a map of what actually decides what you get and what you pay.
Key takeaways- The inference provider layer, not just the model layer, now has 100 to 200+ competitors, and provider choice directly determines effective cost, latency, and data sovereignty.
- Cache hit rate is the dominant cost lever for agentic workloads: a cache miss can cost 50-100x more per token, and median agentic cache rates have climbed from ~50% to ~85% in 2026.
- Most organisations use a 'hub and spoke' model architecture with one 'daily driver' taking the majority of tokens and spend, plus specialised models for departments like customer support or sales.
- Zero data retention claims vary in trustworthiness by jurisdiction and provider size; some stealth models on OpenRouter are free specifically because they are not ZDR.
- The gap between frontier and open-weight models is widening in raw capability but narrowing in perceived value, as daily tasks saturate below frontier intelligence.
- Reasoning-only models and jagged intelligence are driving demand for fast decision models like Jev and OpenAI's decision model for latency-critical paths.
- 00:00 The New Complexity
- 03:29 Provider Layer Competition
- 05:31 Choosing a Provider
- 08:04 Data Retention Realities
- 12:01 Model Portfolios
- 14:45 Latency and Reasoning
- 17:51 Cache Economics
- 22:57 Cost-Performance Sweet Spot
- 25:46 What Comes Next
- 28:35 Open Weight vs Frontier
- 31:24 Specialisation and Product
- 33:36 Where to Follow Peter
- OpenRouter: https://openrouter.ai
- OpenRouter Data: https://openrouter.ai/data
- DeepSeek: https://www.deepseek.com
- Anthropic: https://www.anthropic.com
- OpenAI: https://openai.com
- Google AI: https://ai.google
- Cerebras: https://www.cerebras.net
- CoreWeave: https://www.coreweave.com
- ElevenLabs: https://elevenlabs.io
- Artificial Analysis: https://artificialanalysis.ai
- Groq: https://groq.com
Peter Walker is Head of Insights at OpenRouter, where he analyses how models and inference providers are used across the platform. He previously led insights at Carta.
This episode is presented by SparkLaunch and Dam Secure.
- SparkLaunch (https://sparklaunch.io/wizardry): Applied Wizardry listeners get an extra 20% off.
- Dam Secure (https://damsecure.ai/wizardry): Applied Wizardry listeners get their first month free.
- Justin McArthur, Executive Producer and Video Editor: https://www.linkedin.com/in/justin-mcarthur/
- Steph Hefferan, Editor: https://www.linkedin.com/in/steph-heff/