Nikolai Yakovenko: OpenAI in chaos, the future of artificial intelligence and effective accelerationism
Description
Today, Razib interviews Nikolai Yakovenko, already a three-time guest on his podcasts (A Twitter engineer on machine learning and his former company's prospects, GPT-3 and the rise of the thinking machines and AI and Biology). An artificial intelligence researcher based in Miami who has worked at Google and Nvidia, Yakovenko is the founder of DeepNews where he currently works.
Razib and Yakovenko talk about the economic, technological and socio-political implications of the leadership turmoil at OpenAI, the $86 billion dollar company that has supercharged the field of artificial intelligence with their product, ChatGPT. Yakovenko digs deep into the nuts and bolts of how artificial intelligence works today, from transformers to GPUs and different compute needs of training vs. inference. They also discuss the importance of shipping products at a tech company, in contrast to simply publishing papers as the measure of productivity in academic basic science research for example, and how on this count OpenAI succeeded where Google has not. Razib asks Yakovenko if OpenAI might now fall behind Google, whose corporate risk-aversion had squandered it an early lead in technology like transformers. Now that OpenAI is seized by such organizational chaos as to stop development, Google may have time to catch up. Yakovenko also talks about the likelihood of artificial intelligence becoming a corporate oligopoly due to the field's colossal compute needs. Finally, Razib and Yakovenko address the cleavages that arose at OpenAI due to the board’s adherence to effective altruism, while leadership and employees instead charted a shift toward effective accelerationism.
On this episode of Unsupervised Learning Razib talks to Cremieux, a Twitter anon who is regularly retweeted by the likes of Paul Graham, Noah Smith and Elon Musk. A data scientist and statistician, Cremieux specializes in visualizations and analyses that cut to the heart of social and cultural...
Published 11/07/24
On this episode of "Unsupervised Learning," Razib talks to Rachel Haywire, who writes at Cultural Futurist. Haywire is the author of Acidexia and began her career in futurism as an event planner for the Singularity Institute. She got her start as part of the "right-brain" faction around the Bay...
Published 11/05/24