Mark Zuckerberg - Llama 3, Open Sourcing $10b Models, & Caesar Augustus
Listen now
Description
Mark Zuckerberg on: - Llama 3 - open sourcing towards AGI - custom silicon, synthetic data, & energy constraints on scaling - Caesar Augustus, intelligence explosion, bioweapons, $10b models, & much more Enjoy! Watch on YouTube. Listen on Apple Podcasts, Spotify, or any other podcast platform. Human edited transcript with helpful links here. Timestamps (00:00:00) - Llama 3 (00:08:32) - Coding on path to AGI (00:25:24) - Energy bottlenecks (00:33:20) - Is AI the most important technology ever? (00:37:21) - Dangers of open source (00:53:57) - Caesar Augustus and metaverse (01:04:53) - Open sourcing the $10b model & custom silicon (01:15:19) - Zuck as CEO of Google+ Sponsors If you’re interested in advertising on the podcast, fill out this form. * This episode is brought to you by Stripe, financial infrastructure for the internet. Millions of companies from Anthropic to Amazon use Stripe to accept payments, automate financial processes and grow their revenue. Learn more at stripe.com. * V7 Go is a tool to automate multimodal tasks using GenAI, reliably and at scale. Use code DWARKESH20 for 20% off on the pro plan. Learn more here. * CommandBar is an AI user assistant that any software product can embed to non-annoyingly assist, support, and unleash their users. Used by forward-thinking CX, product, growth, and marketing teams. Learn more at commandbar.com. Get full access to Dwarkesh Podcast at www.dwarkeshpatel.com/subscribe
More Episodes
Chatted with John Schulman (cofounded OpenAI and led ChatGPT creation) on how posttraining tames the shoggoth, and the nature of the progress to come... Watch on YouTube. Listen on Apple Podcasts, Spotify, or any other podcast platform. Read the full transcript here. Follow me on Twitter for...
Published 05/15/24
Published 05/15/24
Had so much fun chatting with my good friends Trenton Bricken and Sholto Douglas on the podcast. No way to summarize it, except:  This is the best context dump out there on how LLMs are trained, what capabilities they're likely to soon have, and what exactly is going on inside them. You would be...
Published 03/28/24