32: Trino Tardigrade: Try, try, and never die
Listen now
Description
While Trino has been proven to run batch analytic workloads at scale, many have avoided long-running batch jobs in fear of query failure. Join this month's broadcast discussing the project introducing granular fault-tolerance to Trino. Codenamed Project Tardigrade, it is being thoughtfully crafted to maintain the speed advantage that Trino has over other query engines while increasing the resiliency of queries. We will discuss some of the design proposals being considered with Tardigrade engineers Andrii, Zebing, Lukasz Osipiuk, and Martin. We'll also cover how fault-tolerance will be exposed to users, and we will do a demo to showcase retries. Project Tardigrade is named after the microscopic Tardigrades that are the world's most indestructible creatures, akin to the resiliency we are adding to Trino’s queries. We look forward to telling you more as features unfold. Concept of the month: Introducing Project Tardigrade Demo of the month: Task retries with Project Tardigrade PR of the month: PR 10319 Trino lineage fails for AliasedRelation Question of the month: How do you cast JSON to varchar with Trino? Show Notes: https://trino.io/episodes/32.html Show Page: https://trino.io/broadcast/
More Episodes
More details at https://trino.io/episodes/67
Published 10/31/24
Manfred is joined by Wren AI team members and contributors to talk about the new AI-powered, text to SQL tool and its great support for Trino. More details at https://trino.io/episodes/66
Published 10/04/24
Published 10/04/24