Theo Jaffee: monitoring the "singularity"

Today Razib talks to Theo Jaffee, co-host of Monitoring the Situation, a show backed by Andreessen Horowitz that covers the rise of the "intelligence explosion" and AI. Jaffee is writer and podcaster who grew up in Boca Raton, Florida. He studied computer science and economics at the University of Florida. His writing on Theo's Substack explores artificial intelligence, technology, business, history, and philosophy. He has also contributed to Quillette and received an Emergent Ventures fellowship in 2024.

The podcast covers AI's accelerating capabilities, broader societal impact, and safety risks. Jaffee talks about estimates of a 10% probability of human technological civilization collapsing within ten years, distinguishing between the disempowerment of humanity and the potential continuation of civilization under AI control. But, he notes, coordination, political intervention, and the logistical difficulty of automating physical infrastructure can mitigate that catastrophic risk. Progress remains broadly on track with AI 2027 expectations, despite there being no predicted labor disruptions and Chinese consolidation failing to materialize as forecast. Jaffee notes events like the Hugging Face incident and an apparent Millennium Prize problem solution heighten concerns surrounding alignment and control. Razib and Jaffee also discuss how critical uncertainties persist over how rapidly recursive self-improvement might yield superintelligence, whether mounting political backlash will establish viable safeguards or trigger heavy-handed stagnation, and how society must ultimately evaluate AI consciousness and moral status.