Building the AI Hyperscaler with Kubernetes
Listen now
Description
In this episode of the Kubernetes Bytes podcast, Bhavin sits down with Brandon Jacobs, an Infrastructure architect at Coreweave. They discuss how Coreweave has adopted Kubernetes to build the AI hyperscaler. The discussion dives into details around how Coreweave handles Day 0 and Day 2 operations for AI labs that need access to GPUs. They also talk about lessons learnt and best practices for building a Kubernetes based cloud.   Check out our website at https://kubernetesbytes.com/   Episode Sponsor: Nethopper Learn more about KAOPS:  nethopper.io For a supported-demo:  [email protected] Try the free version of KAOPS now!    https://mynethopper.com/auth   Cloud Native News: * https://siliconangle.com/2024/06/24/ollama-addresses-remote-execution-flaw-following-wiz-discovery/ * https://siliconangle.com/2024/06/18/suse-acquires-kubernetes-observability-startup-stackstate/   Show links:  * https://www.linkedin.com/in/brandonrjacobs/ * https://www.coreweave.com/   Timestamps:  * 00:01:39 Cloud Native News  * 00:05:30 Interview with Brandon  * 00:51:37 Key takeaways
More Episodes
In this episode of the Kubernetes Bytes podcast, Ryan and Bhavin sit down with Diego Devalle and Anoop Gopalakrishnan from Guidewire to talk about how they went through an application modernization journey and adopted Kubernetes and cloud over the last 5 years.   Diego and Anoop share their...
Published 11/07/24
Published 11/07/24
In this episode, we sit down with Nilesh Agarwal, co-founder of Inferless, a platform designed to streamline serverless GPU inference. We'll cover the evolving landscape of model deployment, explore open-source tools like KServe and Knative, and discuss how Inferless solves common bottlenecks,...
Published 10/24/24