Skip to content

David Duvenaud on the Cruxes and Possibilities of Post AGI Futures

October 7, 2025 · 1 h 2 min

Show notes

In this episode of the Existential Hope Podcast, Beatrice Erkers is joined by David Duvenaud, Associate Professor at the University of Toronto and former researcher at Anthropic.


We discuss David’s work on post-AGI civilizational equilibria and the widely discussed paper Gradual Disempowerment. David reflects on why liberalism may not hold up in a world where humans are no longer needed, how UBI could be Goodharted into absurdity, and what it would take to design institutions that protect humans even when incentives don’t.


We also cover:


- Forecasting the long-term future using LLMs trained on historical data

- Robin Hanson’s idea of futarchy (governance by prediction markets)

- Asymmetrical but beneficial relationships between humans and AI

- Uploading, cultural legacies, and the possibility of “worthy successors”

On the Existential Hope Podcast hosts Allison Duettmann and Beatrice Erkers from the Foresight Institute invite scientists, founders, and philosophers for in-depth conversations on positive, high-tech futures.


Full transcript, listed resources, and more: https://www.existentialhope.com/podcasts


Follow on X.

Hosted on Acast. See acast.com/privacy for more information.

All episodes of The Existential Hope Podcast

Settings

Display

Language

Decides which stations you see first on the home page.

History

Recently played stations and episodes and your latest searches are only stored in this browser.

Notifications

A short notice when a podcast you follow has a new episode. Turn off single podcasts with the bell on their page.

Account

Save favorites – in the app and on the website.

Keyboard shortcuts

/
Open search
Space
Play or pause
← →
In the player: back 15 s, forward 30 s (episodes) · in a row: next tile
↑ ↓
In a row: target within the tile
Home / End
In a row: first or last tile
Esc
Close window or menu
?
This overview
Now playing

Go to station page

Play next

    Add episodes with “Play next” – they play after the current episode.