My Journey into Postgres Monitoring with Lukas Fittl & Rob Treat
Listen now
Description
Do you monitor your Postgres error logs for gold? Lukas Fittl and Rob Treat join Claire Giordano and Pino de Candia on the Path To Citus Con podcast for developers who love Postgres—to discuss their respective journeys into Postgres monitoring. Have you ever asked yourself: “Why is my query so slow?” Or had to figure out which query is slowing things down? Or why your database server is at 90% CPU? There are so many ways to monitor Postgres: pganalyze, pgMustard, pgBadger, pgDash, your cloud provider’s Query Performance Insights, pg_stat_statements, pg_stat_io, & more. If you’re running Postgres on a managed service, what kinds of things do you need to monitor & optimize for (vs. what will your cloud service provider do)? There’s also a segue on monitoring vs. observability: what’s the difference?  Links mentioned in this episode: OpenTelemetry: https://opentelemetry.io/ pganalyze: https://pganalyze.com/ pgDash: https://pgdash.io/ pgMustard: https://www.pgmustard.com/ pg_stat_statements docs: https://www.postgresql.org/docs/current/pgstatstatements.html pg_hint_plan: https://github.com/ossc-db/pg_hint_plan  pg_hint_plan hint list: https://github.com/ossc-db/pg_hint_plan/blob/master/docs/hint_list.md Example for PostgreSQL with pg_hint_plan: https://api.rubyonrails.org/classes/ActiveRecord/QueryMethods.html#method-i-optimizer_hints 5mins of Postgres by pganalyze: https://www.youtube.com/playlist?list=PLhqxwIAgz78HZhWyu3UyKrCWNk7VWjVpj Monitoring page on PostgreSQL wiki: https://wiki.postgresql.org/wiki/Monitoring PgHero GitHub repo: https://github.com/ankane/pghero Insights on pgBadger: A PGSQL Phriday #010 Recap: https://techcommunity.microsoft.com/t5/azure-database-for-postgresql/community-insights-on-pgbadger-a-pgsql-phriday-010-recap/ba-p/3880911 Get PostgreSQL Logs Into Honeycomb: https://docs.honeycomb.io/getting-data-in/logs/postgresql/ Blog post by Lukas Fittl about pg_stat_io by Lukas: https://pganalyze.com/blog/pg-stat-io Blog post by Andrew Atkinson about pg_stat_io: https://andyatkinson.com/blog/2023/11/01/PostgreSQL-IO-Visibility-wehack-pg_stat_io BPFtrace by iovisor GitHub repo: https://github.com/iovisor/bpftrace Trace PostgreSQL locks with pg_lock_tracer: https://jnidzwetzki.github.io/2023/01/11/trace-postgresql-locks-with-pg-lock-tracer.html sysdig by draios GitHub repo: https://github.com/draios/sysdig Using BPFtrace to trace PostgreSQL vacuum operations: https://www.timescale.com/blog/using-bpftrace-to-trace-postgresql-vacuum-operations/ PostgreSQL Mailing Lists: https://www.postgresql.org/list/ psql — PostgreSQL interactive terminal: https://www.postgresql.org/docs/current/app-psql.html Ongoing discussion thread about pg_stat_statements: https://commitfest.postgresql.org/46/2837/ Reconnoiter project referenced by Rob: https://github.com/circonus-labs/reconnoiter/tree/master/sql Funny tweet about PostgreSQL pronunciation: https://twitter.com/as_w/status/1648373353214885892 O11ycast EP63 with Lukas Fittl: https://www.heavybit.com/library/podcasts/o11ycast/ep-63-observability-in-the-database-with-lukas-fittl-of-pganalyze Oxide and Friends podcast: https://oxide-and-friends.transistor.fm/
More Episodes
Did you know that sometimes the fastest way of doing something is not having to do it at all? In this episode of Path To Citus Con, the podcast for developers who love Postgres, Michael Christofides joins Claire Giordano to chat about his journey to explaining explain (or should we say EXPLAIN!?)...
Published 05/03/24
You have to find what works for you and Chris Ellis has never been the kind of person that could go and sit in a library—for Chris, the most productive Postgres place is in a coffee shop. In this episode of the Path To Citus Con podcast for developers who love Postgres, Chris Ellis joined Claire...
Published 04/05/24