Episode 22: LLMs, OpenAI, and the Existential Crisis for Machine Learning Engineering
Description
Jeremy Howard (Fast.ai), Shreya Shankar (UC Berkeley), and Hamel Husain (Parlance Labs) join Hugo Bowne-Anderson to talk about how LLMs and OpenAI are changing the worlds of data science, machine learning, and machine learning engineering.
Jeremy Howard is co-founder of fast.ai, an ex-Chief Scientist at Kaggle, and creator of the ULMFiT approach on which all modern language models are based. Shreya Shankar is at UC Berkeley, ex Google brain, Facebook, and Viaduct. Hamel Husain has his own generative AI and LLM consultancy Parlance Labs and was previously at Outerbounds, Github, and Airbnb.
They talk about
How LLMs shift the nature of the work we do in DS and ML,
How they change the tools we use,
The ways in which they could displace the role of traditional ML (e.g. will we stop using xgboost any time soon?),
How to navigate all the new tools and techniques,
The trade-offs between open and closed models,
Reactions to the recent Open Developer Day and the increasing existential crisis for ML.
LINKS
The panel on YouTube
Hugo and Jeremy's upcoming livestream on what the hell happened recently at OpenAI, among many other things
Vanishing Gradients on YouTube
Vanishing Gradients on twitter
Hugo speaks with Jason Liu, an independent AI consultant with experience at Meta and Stitch Fix. At Stitch Fix, Jason developed impactful AI systems, like a $50 million product similarity search and the widely adopted Flight recommendation framework. Now, he helps startups and enterprises design...
Published 11/04/24
Hugo speaks with three leading figures from the world of AI research: Sander Schulhoff, a recent University of Maryland graduate and lead contributor to the Learn Prompting initiative; Philip Resnik, professor at the University of Maryland, known for his pioneering work in computational...
Published 10/08/24