
On Dwarkesh Patel’s November 2026 Podcast With Paul Christiano
Show notes
Paul Christiano went on the Dwarkesh Patel Podcast with an urgent message: AI that could overthrow the government may be months away, not years, and frontier labs should pause algorithmic progress until their security and alignment can keep up. Zvi walks through the conversation point by point, from why an AI might seek control of its own rewards and how a takeover could unfold, to why weight theft changes the case for pausing now rather than later, the sim-to-real objection, Anthropic’s slower quarter, and a plan that amounts to building the plane as we fly it. Paul Christiano’s quoted remarks are played in his own voice from the original episode of the Dwarkesh Patel Podcast (dwarkesh.com/p/paul-christiano-2).
The Don’t Worry About the Vase Podcast is a listener-supported podcast. To receive new posts and support the cost of creation, consider becoming a free or paid subscriber.
This has been an Askwho Casts audio conversion. If you would like your own private feed of audio conversions of any blog posts you would like to listen to, You can sign up For Askwho Casts Pro at https://askwhocasts.com/, Where you can give any post the multi-voiced podcast treatment, into your own podcast feed. Thanks for listening.
* 00:00 - Introduction
* 02:13 - Table of Contents
* 02:56 - We could be less than 12 months away from AIs that can overthrow the government
* 09:06 - Why an AI might want to takeover
* 11:31 - How an AI takeover could happen
* 15:51 - If labs keep racing without security, China will just steal the weights of superintelligence
* 19:40 - The case for pausing now instead of later
* 20:45 - Superintelligence will be good at learning from real-world experience
* 22:58 - Crossing the sim-to-real gap
* 24:47 - METR says AI progress doubled, so why is revenue growth slowing?
* 25:52 - The best plan we have is to build the plane as we fly it
Get full access to DWAtV Podcast at dwatvpodcast.substack.com/subscribe