Episodes
Conversation with Dirk-Jan Kubeflow (vs cloud native solutions like SageMaker)
Dirk-Jan Verdoorn - Data Scientist at Dept Agency
Kubeflow. (From the website:) The Machine Learning Toolkit for Kubernetes. The Kubeflow project is dedicated to making deployments of machine learning (ML) workflows on Kubernetes simple, portable and scalable. Our goal is not to recreate other services, but to provide a straightforward way to deploy best-of-breed open-source systems for ML to diverse...
Published 01/29/22
Chatting with co-workers about the role of DevOps in a machine learning engineer's life
Expert coworkers at Dept
Matt Merrill - Principal Software Developer Jirawat Uttayaya - DevOps Lead The Ship It Podcast (where Matt features often) Devops tools
Terraform Ansible Pictures (funny and serious)
Which AWS container service should I use? A visual guide on troubleshooting Kubernetes deployments Public Cloud Services Comparison Killed by Google aCloudGuru AWS curriculum
Published 01/13/22
(Optional episode) just showcasing a cool application using machine learning
Dept uses Descript for some of their podcasting. I'm using it like a maniac, I think they're surprised at how into it I am. Check out the transcript & see how it performed.
Descript The Ship It Podcast How to ship software, from the front lines. We talk with software developers about their craft, developer tools, developer productivity and what makes software development awesome. Hosted by your friends at...
Published 11/07/21
Show notes: ocdevel.com/mlg/mla-17
Developing on AWS first (SageMaker or other)
Consider developing against AWS as your local development environment, rather than only your cloud deployment environment. Solutions:
Stick to AWS Cloud IDEs (Lambda, SageMaker Studio, Cloud9 Connect to deployed infrastructure via Client VPN
Terraform example YouTube tutorial Creating the keys LocalStack Infrastructure as Code
Terraform CDK Serverless
Published 11/06/21
Part 2 of deploying your ML models to the cloud with SageMaker (MLOps) MLOps is deploying your ML models to the cloud. See MadeWithML for an overview of tooling (also generally a great ML educational run-down.)
SageMaker Jumpstart Deploy Pipelines Monitor Kubernetes Neo
Published 11/05/21
Show notes Part 1 of deploying your ML models to the cloud with SageMaker (MLOps) MLOps is deploying your ML models to the cloud. See MadeWithML for an overview of tooling (also generally a great ML educational run-down.)
SageMaker DataWrangler Feature Store Ground Truth Clarify Studio AutoPilot Debugger Distributed Training And I forgot to mention JumpStart, I'll mention next time.
Published 11/04/21
Show notes at ocdevel.com/mlg/32. L1/L2 norm, Manhattan, Euclidean, cosine distances, dot product
Normed distances link
A norm is a function that assigns a strictly positive length to each vector in a vector space. link Minkowski is generalized. p_root(sum(xi-yi)^p). "p" = ? (1, 2, ..) for below. L1: Manhattan/city-block/taxicab. abs(x2-x1)+abs(y2-y1). Grid-like distance (triangle legs). Preferred for high-dim space. L2: Euclidean. sqrt((x2-x1)^2+(y2-y1)^2. sqrt(dot-product)....
Published 11/08/20
MLG: I'm rebooting this series to fix mistakes & add more shallows (Bayesian methods, Tree methods, etc). I'm adding Patreon rewards, including access to a new podcast series: Machine Learning Applied, discussing applied/practical 10-20m frequent episodes
Published 05/24/18
ocdevel.com/mlg/29 for notes and resources
Published 02/05/18