Robert Wright: AI Alignment Is a Moral Problem, Not a Technical One

The real AI alignment problem is not technical. It is moral. You cannot align a superintelligence to human values if humans cannot agree on what those values are, and you cannot get that agreement without a level of global cooperation we have never managed before. Subscribe if you want science with evidence, not speculation.

The Tower of Babel is the AI parable nobody is reading. Technology that outpaces wisdom fragments the people building it. The Fermi paradox offers the grimmer version: civilizations that reach the capacity to blow themselves up typically do. Robert Wright has been watching this longer than almost anyone, he was reporting on neural networks in 1983, and his conclusion is not that the machines will fail the test. It is that we will.

Wright’s book argues that superintelligence is not the danger and AI alignment is not the solution unless it comes with a moral advance. Passing the God test requires something no lab can ship.

What you’ll hear:

-Why Wright thinks p(doom) fails as a scientific concept

-What the binding of Isaac and the Tower of Babel have in common as moral tests

-Why global cooperation is the only thing that can actually slow AI down

-What Lee Smolin’s cosmological natural selection has to do with the Fermi paradox

-What Wright thinks Eastern and Western enlightenment have in common and why it matters now

-Whether there is a role for humanity inside the global brain or only for the machines

“We face the kind of test that God would give.” — Robert Wright

CHAPTERS

00:00 The man who interviewed Hinton in 1983

05:04 The God test and its two meanings

08:36 Religious faith in technological progress

14:10 Hinton then versus Hinton now

19:38 Why slowing AI down requires international cooperation

26:02 How LLMs reverse-engineer the meaning of words

32:08 Brian's Einstein test: can Claude have a happy thought?

40:06 AGI is impossible. Here is why Brian thinks that.

47:04 The Fermi paradox as a moral filter

51:10 What passing the God test actually looks like

Get the transcript, fascinating bonus content, and my Monday M.A.G.I.C. Message: https://briankeating.com/yt

Have a .edu email and live in the USA? You automatically win a meteorite: https://BrianKeating.com/edu

Enter the debate: briankeating.com/ai

Subscribe: https://www.youtube.com/DrBrianKeating?sub_confirmation=1

Support Into the Impossible on Patreon, get my weekly M.A.G.I.C. Message, unfiltered bonus content, and live monthly Office Hours with me: https://www.patreon.com/drbriankeating

Join this channel for perks, monthly Office Hours, and your name in the Member Roster at the end of every episode: https://www.youtube.com/channel/UCmXH_moPhfkqCk6S3b9RWuw/join

Featured Guest:

The God Test (book): https://thegodtest.net

Robert Wright on Twitter/X: https://x.com/RWrighter

My books:

Losing the Nobel Prize (memoir): http://amzn.to/2sa5UpA

Think Like a Nobel Prize Winner: https://a.co/d/03ezQFu

Focus Like a Nobel Prize Winner: https://a.co/d/hi50U9U

Galileo’s Dialogue (first-ever audiobook): https://a.co/d/iZPi9Un

Twitter/X: https://x.com/BrianKeating

Substack: https://briankeating.substack.com

Blog: https://briankeating.com/blog

Audio-only: https://briankeating.com/podcast

#RobertWright #AIalignment #superintelligence #FermiParadox #briankeating #intotheimpossible #AI

Learn more about your ad choices. Visit megaphone.fm/adchoices