Episodes Episode 1
Could AI End the World?
In September 2026, AI researcher Jacob Coxon quit his job at Anthropic and warned that AI could kill us all by the end of the decade. So could it actually happen? This episode looks at the three ways AI could go wrong, losing control, misuse and slow damage, and then at what we could gain if it goes right.
Chapters
- 00:00 Intro
- 01:09 The warning signs
- 03:06 1. Losing control
- 04:46 2. Misuse
- 09:03 3. Slow damage
- 11:22 What could we gain?
Sources and credits
SOURCES
The warning signs
Palisade Research, o3 shutdown tests, May 2025
https://x.com/PalisadeAI/status/1926084635903025621
Anthropic, Agentic Misalignment, Jun 2025
https://www.anthropic.com/research/agentic-misalignment
Anthropic, AI espionage campaign, Nov 2025
https://www.anthropic.com/news/disrupting-AI-espionage
1. Losing control
OpenAI, Faulty reward functions in the wild, Dec 2016
https://openai.com/index/faulty-reward-functions/
Apollo Research, o1 scheming tests, Dec 2024
https://www.apolloresearch.ai/science/frontier-models-are-capable-of-incontext-scheming
2. Misuse
International AI Safety Report 2026
https://internationalaisafetyreport.org/publication/2026-report-executive-summary
FBI, AI scams in the IC3 report, Apr 2026
https://www.fbi.gov/news/press-releases/cryptocurrency-and-ai-scams-bilk-americans-of-billions
CNN, Hong Kong deepfake video call scam, Feb 2024
https://www.cnn.com/2024/02/04/asia/deepfake-cfo-scam-hong-kong-intl-hnk
Anthropic, ASL-3 safeguards, May 2025
https://www.anthropic.com/news/activating-asl3-protections
RAND, AI and biological attacks red-team study, Jan 2024
https://www.rand.org/pubs/research_reports/RRA2977-2.html
3. Slow damage
IMF, AI and the global economy, Jan 2024
https://www.imf.org/en/Blogs/Articles/2024/01/14/ai-will-transform-the-global-economy-lets-make-sure-it-benefits-humanity
MIT News, Most work is new work, Apr 2024
https://news.mit.edu/2024/most-work-is-new-work-us-census-data-shows-0401
IEA, Energy and AI, Apr 2025
https://www.iea.org/reports/energy-and-ai/executive-summary
NPR, the Tesla deepfake argument, May 2023
https://www.npr.org/2023/05/08/1174132413/people-are-trying-to-claim-real-videos-are-deepfakes-the-courts-are-not-amused
What could we gain?
Google DeepMind, AlphaFold five years on, Nov 2025
https://deepmind.google/blog/alphafold-five-years-of-impact/
Nobel Prize in Chemistry 2024
https://www.nobelprize.org/prizes/chemistry/2024/summary/
BBC News, AI cracks superbug problem in two days, Feb 2025
https://www.bbc.com/news/articles/clyz6e9edy3o
Nature Medicine, rentosertib phase 2a trial, Jun 2025
https://www.nature.com/articles/s41591-025-03743-2
UC Davis Health, ALS speech brain implant, Aug 2024
https://health.ucdavis.edu/news/headlines/new-brain-computer-interface-allows-man-with-als-to-speak-again/2024/08
World Bank, AI tutoring in Edo State, Nigeria, Jun 2025
https://blogs.worldbank.org/en/developmenttalk/addressing-the-learning-crisis-with-generative-ai--lessons-from-
ECMWF, AI forecasts become operational, Feb 2025
https://www.ecmwf.int/en/about/media-centre/news/2025/ecmwfs-ai-forecasts-become-operational
Google Research, AI flood forecasts, Mar 2024
https://research.google/blog/using-ai-to-expand-global-access-to-reliable-flood-forecasts/
NEWS CLIPS (short excerpts, used for commentary)
BBC, Sunday with Laura Kuenssberg, 13 Sep 2026
https://www.youtube.com/watch?v=9norxWsFrOo
CNN, Anderson Cooper interview with Jacob Coxon, 9 Sep 2026
https://www.youtube.com/watch?v=i30jVPqQeOM
NBC News NOW, Top Story with Tom Llamas, 9 Sep 2026
https://www.youtube.com/watch?v=Dy2kbPEwoi4
NBC, Meet the Press with Kristen Welker, 13 Sep 2026
https://www.youtube.com/watch?v=cFOgef5x_ag
Fox News, Special Report with Bret Baier, 9 Sep 2026
https://www.youtube.com/watch?v=9mhq2vCxWjg
CBS News, How AI could destroy all humanity, 10 Sep 2026
https://www.youtube.com/watch?v=yaVtCQ3Qnbc
BBC News, Trump dismisses AI warnings, 13 Sep 2026
https://www.youtube.com/watch?v=K9-h8e2uxPQ
Associated Press, Trump in Doonbeg, 14 Sep 2026
https://www.youtube.com/watch?v=_RZO0qV7b-s
Photo of Yoshua Bengio by Jeremy Barande / Ecole polytechnique Universite Paris-Saclay, CC BY-SA 2.0
https://commons.wikimedia.org/wiki/File:Yoshua_Bengio_-_2017.jpg
The scam call scene around 06:01 uses AI-generated video and a cloned voice to show what these scams look like.
MUSIC (YouTube Audio Library)
Ready for More by Ezra Lipp
Level by The Grey Room / Density & Time
Stealth by Aakash Gandhi
Celestial Caravan by Patrick Patrikios
Science Montage by Jeremy Blake
Foggy by Nat Keefe
The Off-White Lotus by Ezra Lipp
Yacoby by Schwartzy
Sprightly Pursuit by Cooper Cannell
Marimba Chill by Jimena Contreras
Point - Counterpoint by John Patitucci
Turn In The Sun by Simon Herody
Sound effects from FilmCow and Pixabay.