Solving the GPU shortage: software to 2-4X existing GPU utilization
Listen now
Description
GPUs are rare and expensive right now. Every company doing AI model training needs more, and NVIDIA can't build enough, especially of the NVIDIA H100 GPU. Run.ai CEO and co-founder Omri Geller says he has a software solution to this hardware problem. The key: GPUs are mostly idle, even in high-demand settings. According to Geller, his software 2X to 4Xs your GPU capacity on existing hardware, simply by streamlining workloads and maximizing GPU usage time. In this TechFirst, we chat about: - the GPU shortage - how many GPUs we need - what Open AI is using right now - whether OpenAI is getting dumber or not - and much more As always, get a full transcript and subscribe to the audio podcast at my website: https://johnkoetsier.com/category/tech-first/
More Episodes
Could you love an AI? What does love with "digital humans?" look like? Is this the future of relationships? In this TechFirst, we chat with Artem Rodichev, CEO of Ex-human and former head of AI at Replika. We dive into the concept of forming relationships with AI companions and the future of...
Published 11/07/24
Is AGI just a really dumb idea? Is the concept essentially meaningless? And are we entirely barking up the wrong tree? In this episode of TechFirst, host John Koetsier interviews Neil Lawrence, the DeepMind Professor of Machine Learning at the University of Cambridge and senior Fellow at the...
Published 09/26/24
Published 09/26/24