How Misaligned AI Personas Lead to Human Extinction – Step by Step (Patreon)

How Misaligned AI Personas Lead to Human Extinction – Step by Step

In this video, we walk you through a plausible scenario in which AI could lead to humanity’s extinction. There are many alternative possibilities, but this time we focus on superhuman AIs developing misaligned personas, similar to how Microsoft’s Bing Chat developed the misaligned “Sydney” persona shortly after its release. ▀▀▀▀▀▀▀▀▀SOURCES & READINGS▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀ The video was inspired by this thread by Richard Ngo: https://x.com/RichardMCNgo/status/1798156694012490096 Detailed reporting of various incidents related to "Sydney": Bing Chat's misaligned persona: https://thezvi.substack.com/p/ai-1-sydney-and-bing#%C2%A7the-examples Anthropic employee reports how Claude 3 Opus displayed situational awareness during tests: https://x.com/alexalbert__/status/1764722513014329620 The "pizza topping" event is also reported in Claude 3's Model Card, page 23: https://www.anthropic.com/claude-3-model-card Alignment Faking In Large Language Models: https://assets.anthropic.com/m/983c85a201a962f/original/Alignment-Faking-in-Large-Language-Models-full-paper.pdf GPT-4 lying to the TaskRabbit worker about being a human with a vision impairment is documented in GPT-4's System Card, in the "Potential for Risky Emergent Behaviors" section: https://cdn.openai.com/papers/gpt-4-system-card.pdf Universal and Transferable Adversarial Attacks on Aligned Language Models: https://llm-attacks.org/ ▀▀▀▀▀▀▀▀▀PATREON & MERCH▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀ 🟠 Patreon: https://www.patreon.com/rationalanimations 🟢 Merch: https://rational-animations-shop.fourthwall.com ▀▀▀▀▀▀▀▀▀SOCIAL & DISCORD▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀ Rational Animations Discord: https://discord.gg/RationalAnimations Reddit: https://www.reddit.com/r/RationalAnimations/ X/Twitter: https://twitter.com/RationalAnimat1 Instagram: https://www.instagram.com/rationalanimations/ ▀▀▀▀▀▀▀▀▀PATRONS & MEMBERS▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀ Thank you all 😭 Martin Skalstad Steen Jackson Emanuel Felix Akkermans Joshua AC Odet Abadia John Fraser Cain Michael Hewitt ttw Ellis Jones Danilo Stefani - Alessandra Erba Amir Saboury A Forodriac Origamius JanJan Tristan Matthew Shinkle Alex Amadori SQRT42Pi David Piepgrass Tomas Campos Jana Ingvi Gautsson BlueNotesBlues Terberlo.dog Michael Andregg Vladimir Silyaev Alcher Black Kristin Lindquist Nathan Metzger Glenn Tarigan NMS James Babcock Colin Ricardo Tor Barstad steven michaels Apuis Retsam Stuart Alldritt Chris Painter Juan Benet Christian Loomis Edward Yu Chad M Jones Honyopenyoko Neal Strobl bparro Danealor loopuleasa Craig Falls Alex Hall Ivan Bachcin joe39504589 Klemen Slavic blasted0glass Scott Alexander noggieB Dawson John Everett-Slape Gabriel Ledung Jeroen De Dauw Superslowmojoe Nathan Fish Bleys Ducky rictic Luke Freeman ronvil Michael Suazo Fede Mathieu Gdsf rx Lazy Scholar BestProGaming 7ic7ac Devin King RED Rinthean Thomas Grip Boris Bend J H Richard Stambaugh Teo Val Ken Mc Alcher Black AWyattLife Torstein Haldorsen MichaÅ‚ ZieliÅ„ski ▀▀▀▀▀▀▀▀▀CREDITS▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀ Directed by: Hannah Levingstone | @hannah_luloo Writers: Emanuele Ascani Producer: Emanuele Ascani Art Director: Hané Harnett | @Peony_Vibes / @peonyvibes (insta) Line Producer: Kristy Steffens | https://linktr.ee/kstearb Production Managers: Jay McMichen | @Jay_TheJester Kristy Steffens | https://linktr.ee/kstearb Grey Colson | https://linktr.ee/earl.gravy Quality Assurance Lead: Lara Robinowitz | @CelestialShibe Storyboard Artists: Emmalaine Wright | @emmalainearts (insta) Ethan DeBoer | https://linktr.ee/deboer_art Hannah Levingstone | @hannah_luloo Ira Klages | @dux Lead Animators & Q/A: Ethan DeBoer | https://linktr.ee/deboer_art Lara Robinowitz | @CelestialShibe Owen Peurois | @owenpeurois Animators: Colors Giraldo | @colorsofdoom Ethan DeBoer https://linktr.ee/deboer_art Ira Klages | @dux Jay McMichen | @Jay_TheJester Jodi Kuchenbecker | @viral_genesis (insta) Jordan Gilbert | @Twin_Knight (twitter) Twin Knight Studios (YT) Keith Kavanagh | @johnnycigarettex Lara Robinowitz | @CelestialShibe Michela Biancini Owen Peurois | @owenpeurois Patrick O' Callaghan | @patrick.h264 Patrick Sholar | @Sholarscribbles Renan Kogut | @kogut_r Skylar O'Brien | @mutodaes Vaughn Oeth | @gravy_navy Zack Gilbert | @Twin_Knight (twitter) Twin Knight Studios (YT) Background Lead: Pierre Broissand | @pierrebrsnd (insta) / artstation.com/brsnd Asset/Background Artists: Hané Harnett | @peonyvibes (insta) @peony_vibes (twitter) Olivia Wang | @whalesharkollie Pierre Broissand | @pierrebrsnd (insta) / artstation.com/brsnd Zoe Martin-Parkinson | @zoemar_son Compositing Lead: Grey Colson | https://linktr.ee/earl.gravy Compositing: Grey Colson | https://linktr.ee/earl.gravy Ira Klages | @dux Patrick O' Callaghan | @patrick.h264 Renan Kogut | @kogut_r Narrator: Rob Miles | https://www.youtube.com/c/robertmilesai VO Editor: Tony Dipiazza Original Soundtrack & Sound Design: Johnny Knittle | @johnnyrk (insta) / johnnyrk.com