Running Ray on Kubernetes with KubeRay
Listen now
Description
In this episode of the Kubernetes Bytes podcast, Bhavin sits down with Kai-Hsun Chen, Software Engineer at Anyscale and maintainer of the KubeRay project. The discussion focuses on how the open source Ray project can help organizations use a single tool for data prep, model training, fine tuning and model serving workflows, both for their predictive AI and generative AI models. The discussion also dives into the KubeRay project and how it provides three different Kubernetes CRDs for Data Scientists to deploy Ray clusters on demand.    Check out our website at https://kubernetesbytes.com/   Cloud Native News: * https://azure.github.io/AKS/2024/08/23/fine-tuning-language-models-with-kaito * https://orca.security/resources/blog/kubernetes-testing-environment/ * https://www.redhat.com/en/about/press-releases/red-hat-openstack-services-openshift-now-generally-available   Show links: * Kai's LinkedIn: https://www.linkedin.com/in/kaihsun1996/ * KubeRay doc: https://docs.ray.io/en/latest/cluster/kubernetes/index.html * Ray Summit registration: https://raysummit.anyscale.com/flow/anyscale/raysummit2024/reg/createaccount (code: KaiHsunC15) * KubeRay repository: https://github.com/ray-project/kuberay * Ray repository: https://github.com/ray-project/ray * Ray Slack workspace: https://docs.google.com/forms/d/e/1FAIpQLSfAcoiLCHOguOm8e7Jnn-JJdZaCxPGjgVCvFijHB5PLaQLeig/viewform   Timestamps:  * 00:02:40 Cloud Native News  * 00:07:20 Interview with Kai  * 00:49:15 Key takeaways
More Episodes
In this episode of the Kubernetes Bytes podcast, Ryan and Bhavin sit down with Diego Devalle and Anoop Gopalakrishnan from Guidewire to talk about how they went through an application modernization journey and adopted Kubernetes and cloud over the last 5 years.   Diego and Anoop share their...
Published 11/07/24
Published 11/07/24
In this episode, we sit down with Nilesh Agarwal, co-founder of Inferless, a platform designed to streamline serverless GPU inference. We'll cover the evolving landscape of model deployment, explore open-source tools like KServe and Knative, and discuss how Inferless solves common bottlenecks,...
Published 10/24/24