Description
While Trino has been proven to run batch analytic workloads at scale, many have avoided long-running batch jobs in fear of query failure. Join this month's broadcast discussing the project introducing granular fault-tolerance to Trino.
Codenamed Project Tardigrade, it is being thoughtfully crafted to maintain the speed advantage that Trino has over other query engines while increasing the resiliency of queries. We will discuss some of the design proposals being considered with Tardigrade engineers Andrii, Zebing, Lukasz Osipiuk, and Martin. We'll also cover how fault-tolerance will be exposed to users, and we will do a demo to showcase retries.
Project Tardigrade is named after the microscopic Tardigrades that are the world's most indestructible creatures, akin to the resiliency we are adding to Trino’s queries. We look forward to telling you more as features unfold.
Concept of the month: Introducing Project Tardigrade
Demo of the month: Task retries with Project Tardigrade
PR of the month: PR 10319 Trino lineage fails for AliasedRelation
Question of the month: How do you cast JSON to varchar with Trino?
Show Notes: https://trino.io/episodes/32.html
Show Page: https://trino.io/broadcast/