
There’s ZERO Chance of AI Doom By 2050 — Debate with Prakash Narayanan, Host of AI in the AM
Notes de l’épisode
Prakash Narayanan is the man behind @8teAPi, an X account with nearly 60,000 followers that reacts to AI news from a techno-optimist perspective. He’s also the co-host of AI in the AM with friend-of-the-show Nathan Labenz.
He spent almost 20 years in investment banking and private equity, used to post anonymously, and had e/acc in his profile before deciding the movement wasn’t for him.
Now he’s stepping into the spotlight to defend the pro-AI position, which is more than I can say for most of the pro-AI voices on Twitter who like to snipe at me.
We actually agree on a lot about how the technology is advancing. Prakash expects recursive self-improvement within a year and says AI may already be smarter than any individual human. He even gives a 5% chance that every human body gets discarded for a silicon substrate by 2050. And yet his P(Doom) by 2050 is 0%. Not 1%. Not 1 in 100,000. “Literally zero.”
His reasoning is that AI is a multiplayer game. A market where somebody has to pay for every data center will keep any one AI from running away with the future. He even calls the doomer scenario a “perpetual motion machine.”
We debate whether humans have any power to lose in the first place, the feasibility of a nanomachine takeover, and why someone with zero fear of doom doesn’t just floor the accelerator.
This was a fun and occasionally high intensity debate. At one point, Prakash asked if I was “crazy” for doubting that most of humanity puts P(Doom) at zero. But my view is that his forecast falls outside the epistemological “sane zone.” Take a look and see who you agree with!
Watch on YouTube: https://www.youtube.com/watch?v=EmOYwV5k0SA
Timestamps
00:00:00 — Cold Open
00:01:24 — Introducing Prakash Narayanan
00:02:19 — How @8teAPi Went Viral
00:05:12 — Does Prakash Still Identify as e/acc?
00:07:05 — What’s Your P(Doom)?™
00:10:02 — Prakash Defends 0%: Most of Humanity Isn’t Worried
00:15:17 — Prakash’s Core Argument: AI Is a Multiplayer Game
00:20:36 — Bayesian Test: Can Anything Change Prakash’s Mind?
00:24:53 — Defining Doom
00:31:48 — The Parable of the Sliding Door
00:34:54 — Doom Train™: Will Superintelligence Outsmart Humanity?
00:42:38 — Do Humans Have Any Power to Lose?
00:54:05 — Are Doomers the Outliers?
00:56:03 — Will AI Have Empathy?
01:05:26 — Will AIs Keep Stable Goals?
01:10:41 — Hypothetical: The Paperclip Brain Laser
01:14:16 — Hypothetical: A Million Times More Change
01:19:04 — Debating Nanomachines in the Future
01:30:32 — Jobs, Status, and Prakash’s Real Fear
01:40:37 — Last Question: Why Not Floor the Accelerator?
01:52:49 — Wrap-Up
01:56:55 — March for an AI Treaty
01:58:25 — Donation Drive
Links
Nathan Labenz’s podcast, The Cognitive Revolution
Prakash’s viral 2023 thread on Palantir’s battlefield AI demo
Paul Christiano: “What failure looks like”
Eliezer Yudkowsky and Nate Soares: If Anyone Builds It, Everyone Dies
Comparative advantage (Ricardo’s law)
Effective accelerationism (e/acc)
Doom Debates: Liron on AI in the AM with Nathan Labenz and Prakash
Doom Debates: Top Economist Says P(Doom) Is 0.1% — Noah Smith vs. Liron Shapira Debate
March for an AI Treaty, Saturday, November 14
Doom Debates’ Mission is to raise mainstream awareness of imminent extinction from AGI and build the social infrastructure for high-quality debate.
Support the mission by subscribing to my Substack at DoomDebates.com and to youtube.com/@DoomDebates, or to really take things to the next level: Donate 🙏
Get full access to Doom Debates at lironshapira.substack.com/subscribe