Humanity Could Survive AI If We Stop Within 10 Years | Nate Soares
Shownotes
Nate Soares, president of the Machine Intelligence Research Institute (MIRI) and co-author of If Anyone Builds It, Everyone Dies, joins MTS to discuss MIRI’s pivot from technical alignment to public advocacy and their new theater ad campaign, Do Not Accept. He argues that AI labs are building superhuman systems they cannot control, warns that current reactive safety fixes will fail past a critical cognitive threshold, and lays out what would convince him he is wrong about AI extinction risk. Check out our sponsor Lovable: https://lovable.dev. Turn ideas into software people love.
MTS chronicles the singularity, live. Monitoring the situation of tech and AI.
Follow MTS:
X | https://twitter.com/MTSlive
YouTube | https://www.youtube.com/@mtsituation
Spotify | https://open.spotify.com/show/4HUNNmV1pjV7CW6Lphm1rM
Apple | https://podcasts.apple.com/us/podcast/mts/id1891088763
Substack | https://mtslive.substack.com/
–
Brought to you by:
Mongo DB - Anyone can prototype an agent. Learn how to get them into production on September 30th in New York - register at https://www.mongodb.com/events/mongodb-local/nyc
Chargebee - Billing and monetization infrastructure for the AI era. https://www.chargebee.com/
Lovable - Turn ideas into software people love with Lovable. Start today at https://lovable.dev/
ElevenLabs - AI that communicates at human level across every channel and modality. https://elevenlabs.io/mts
Factory - A 24/7 system turning signals into production software. Visit https://factory.com/
Neon (by Databricks) - Scale your startup on Neon. The Postgres backend for apps and agents. Built by Databricks. https://neon.com/mts
Today’s stream is sponsored by VCX, the public ticker for private tech. Head over to http://getvcx.com to learn more
Kong - The AI connectivity platform. Connect APIs, LLMs, agents, and systems with serious security and governance. https://konghq.com
Larridin - Finally prove what your AI investment is worth. Head to https://larridin.com/ today to start measuring your AI’s bottom line.
Blitzy - Autonomous software development for enterprise codebases. Ship 5x faster. https://blitzy.com
Arena - Measuring AI performance in the real world. https://arena.ai/
AdQuick - Make your brand a billboard. Out-of-home advertising as easy to scale as digital. https://adquick.com
Clickhouse - The real-time database that keeps up with all of it. https://clickhouse.com/
–
Timestamps:
(00:00) Introduction
(00:42) MIRI’s Do Not Accept Ad Campaign
(03:36) Preventing AI Safety From Hyperpolarization
(07:03) Why MIRI Abandoned Technical Alignment Research
(09:24) Smoke Signals Versus an AGI Fire Alarm
(15:59) Pitching AI Extinction Risk to Everyday People
(21:04) What Would Prove AI Doom Wrong
(23:37) Defining the Early Internet Rationality Movement
–
Note: This podcast is not investment, legal, or tax advice, and is intended for informational and entertainment purposes only. Hosts and guests may hold positions in the companies and securities discussed; do your own research before acting on anything you hear.