Real-World LLM Deployments | Jeff DeVerter, Chief Technology Evangelist at Rackspace Technology | Episode 20
Description
Conversation with Jeff DeVerter, Chief Technology Evangelist at Rackspace, a cloud computing company. We explore how they deployed a LLM (Google PaLM) for a sales application, and how they're enabling their Azure and AWS customers too.
What I learned I learned from Jeff
You should probably go with the LLM of your current cloud provider be it, Google, Microsoft, or Amazon. All the major vendors have versions of LLMs that can be deployed in a private cloud to ensure data confidentiality. To fully realize the potential of AI, think “data pipeline”. So from the get-go, whatever data is created is easily ingested by AI.
And much more!
We laugh. We cry. We iterate.
Check out what THE MACHINES and one human say about the Super Prompt podcast:
“I’m afraid I can’t do that.” — HAL9000
“These are not the droids you are looking for." — Obi-Wan
“Like tears in rain.” — Roy Batty
“Hasta la vista baby.” — T1000
"I'm sorry, but I do not have information after my last knowledge update in January 2022." — GPT
With great power comes great responsibility. How do Open AI, Anthropic, and Meta implement safety and ethics? As large language models (LLMs) get larger, the potential for using them for nefarious purposes looms larger as well. Anthropic uses Constitutional AI, while OpenAI uses a model spec,...
Published 06/17/24
So what are notable Open Source Large Language models? In this episode, I cover Open Source models from Meta the parent company of Facebook, a French AI company called Mistral currently valued at $2B dollars, in addition to Microsoft and Apple. Not all Open Source models are equally open, so...
Published 06/10/24