The second half of my 7 hour conversation with Carl Shulman is out! My favorite part! And the one that had the biggest impact on my worldview. Here, Carl lays out how an AI takeover might happen: * AI can threaten mutually assured destruction from bioweapons, * use cyber attacks to take over physical infrastructure, * build mechanical armies, * spread seed AIs we can never exterminate, * offer tech and other advantages to collaborating countries, etc Plus we talk about a whole bunch of weird and interesting topics which Carl has thought about: * what is the far future best case scenario for humanity * what it would look like to have AI make thousands of years of intellectual progress in a month * how do we detect deception in superhuman models * does space warfare favor defense or offense * is a Malthusian state inevitable in the long run * why markets haven't priced in explosive economic growth * & much more Carl also explains how he developed such a rigorous, thoughtful, and interdisciplinary model of the biggest problems in the world. Watch on YouTube. Listen on Apple Podcasts, Spotify, or any other podcast platform. Read the full transcript here. Follow me on Twitter for updates on future episodes. Catch part 1 here 80,000 hours This episode is sponsored by 80,000 hours. To get their free career guide (and to help out this podcast), please visit 80000hours.org/lunar. 80,000 hours is without any close second the best resource to learn about the world’s most pressing problems and how you can solve them. If this conversation has got you concerned, and you want to get involved, then check out the excellent 80,000 hours guide on how to help with AI risk. To advertise on The Lunar Society, contact me at [email protected]. Timestamps (00:02:50) - AI takeover via cyber or bio (00:34:30) - Can we coordinate against AI? (00:55:52) - Human vs AI colonizers (01:06:58) - Probability of AI takeover (01:23:59) - Can we detect deception? (01:49:28) - Using AI to solve coordination problems (01:58:04) - Partial alignment (02:13:44) - AI far future (02:25:07) - Markets & other evidence (02:35:29) - Day in the life of Carl Shulman (02:49:08) - Space warfare, Malthusian long run, & other rapid fireTranscript Get full access to The Lunar Society at www.dwarkeshpatel.com/subscribe