We will be recording a preview of the AI Engineer World’s Fair soon with swyx and Ben Dunphy, send any questions about Speaker CFPs and Sponsor Guides you have! Alessio is now hiring engineers for a new startup he is incubating at Decibel: Ideal candidate is an ex-technical co-founder type (can MVP products end to end, comfortable with ambiguous prod requirements, etc). Reach out to him for more! Thanks for all the love on the Four Wars episode! We’re excited to develop this new “swyx & Alessio rapid-fire thru a bunch of things” format with you, and feedback is welcome. Jan 2024 Recap The first half of this monthly audio recap pod goes over our highlights from the Jan Recap, which is mainly focused on notable research trends we saw in Jan 2024: Feb 2024 Recap The second half catches you up on everything that was topical in Feb, including: * OpenAI Sora - does it have a world model? Yann LeCun vs Jim Fan * Google Gemini Pro 1.5 - 1m Long Context, Video Understanding * Groq offering Mixtral at 500 tok/s at $0.27 per million toks (swyx vs dylan math) * The {Gemini | Meta | Copilot} Alignment Crisis (Sydney is back!) * Grimes’ poetic take: Art for no one, by no one * F*** you, show me the prompt Latent Space Anniversary Please also read Alessio’s longform reflections on One Year of Latent Space! We launched the podcast 1 year ago with Logan from OpenAI: and also held an incredible demo day that got covered in The Information: Over 750k downloads later, having established ourselves as the top AI Engineering podcast, reaching #10 in the US Tech podcast charts, and crossing 1 million unique readers on Substack, for our first anniversary we held Latent Space Final Frontiers, where 10 handpicked teams, including Lindy.ai and Julius.ai, competed for prizes judged by technical AI leaders from (former guest!) LlamaIndex, Replit, GitHub, AMD, Meta, and Lemurian Labs. The winners were Pixee and RWKV (that’s Eugene from our pod!): And finally, your cohosts got cake! We also captured spot interviews with 4 listeners who kindly shared their experience of Latent Space, everywhere from Hungary to Australia to China: * Balázs Némethi * Sylvia Tong * RJ Honicky * Jan Zheng Our birthday wishes for the super loyal fans reading this - tag @latentspacepod on a Tweet or comment on a @LatentSpaceTV video telling us what you liked or learned from a pod that stays with you to this day, and share us with a friend! As always, feedback is welcome. Timestamps * [00:03:02] Top Five LLM Directions * [00:03:33] Direction 1: Long Inference (Planning, Search, AlphaGeometry, Flow Engineering) * [00:11:42] Direction 2: Synthetic Data (WRAP, SPIN) * [00:17:20] Wildcard: Multi-Epoch Training (OLMo, Datablations) * [00:19:43] Direction 3: Alt. Architectures (Mamba, RWKV, RingAttention, Diffusion Transformers) * [00:23:33] Wildcards: Text Diffusion, RALM/Retro * [00:25:00] Direction 4: Mixture of Experts (DeepSeekMoE, Samba-1) * [00:28:26] Wildcard: Model Merging (mergekit) * [00:29:51] Direction 5: Online LLMs (Gemini Pro, Exa) * [00:33:18] OpenAI Sora and why everyone underestimated videogen * [00:36:18] Does Sora have a World Model? Yann LeCun vs Jim Fan * [00:42:33] Groq Math * [00:47:37] Analyzing Gemini's 1m Context, Reddit deal, Imagegen politics, Gemma via the Four Wars * [00:55:42] The Alignment Crisis - Gemini, Meta, Sydney is back at Copilot, Grimes' take * [00:58:39] F*** you, show me the prompt * [01:02:43] Send us your suggestions pls * [01:04:50] Latent Space Anniversary * [01:04:50] Lindy.ai - Agent Platform * [01:06:40] RWKV - Beyond Transformers * [01:15:00] Pixee - Automated Security * [01:19:30] Julius AI - Competing with Code Interpreter * [01:25:03] Latent Space Listeners * [01:25:03] Listener 1 - Balázs Némethi (Hungary, Latent Space Paper Club * [01:27:47] Listener 2 - Sylvia Tong (Sora/Jim Fan/EntreConnect) * [01:31:23] Listener 3 - RJ (Developers building Community & Content) * [01:39:25] Listener 4 - Jan Zheng (Austr