1 hr 21 min

My Journey into Postgres Monitoring with Lukas Fittl & Rob Treat Path To Citus Con, for developers who love Postgres

    • Technology

Do you monitor your Postgres error logs for gold? Lukas Fittl and Rob Treat join Claire Giordano and Pino de Candia on the Path To Citus Con podcast for developers who love Postgres—to discuss their respective journeys into Postgres monitoring. Have you ever asked yourself: “Why is my query so slow?” Or had to figure out which query is slowing things down? Or why your database server is at 90% CPU? There are so many ways to monitor Postgres: pganalyze, pgMustard, pgBadger, pgDash, your cloud provider’s Query Performance Insights, pg_stat_statements, pg_stat_io, & more. If you’re running Postgres on a managed service, what kinds of things do you need to monitor & optimize for (vs. what will your cloud service provider do)? There’s also a segue on monitoring vs. observability: what’s the difference? 

Links mentioned in this episode:
OpenTelemetry: https://opentelemetry.io/pganalyze: https://pganalyze.com/pgDash: https://pgdash.io/pgMustard: https://www.pgmustard.com/pg_stat_statements docs: https://www.postgresql.org/docs/current/pgstatstatements.htmlpg_hint_plan: https://github.com/ossc-db/pg_hint_plan pg_hint_plan hint list: https://github.com/ossc-db/pg_hint_plan/blob/master/docs/hint_list.mdExample for PostgreSQL with pg_hint_plan: https://api.rubyonrails.org/classes/ActiveRecord/QueryMethods.html#method-i-optimizer_hints5mins of Postgres by pganalyze: https://www.youtube.com/playlist?list=PLhqxwIAgz78HZhWyu3UyKrCWNk7VWjVpjMonitoring page on PostgreSQL wiki: https://wiki.postgresql.org/wiki/MonitoringPgHero GitHub repo: https://github.com/ankane/pgheroInsights on pgBadger: A PGSQL Phriday #010 Recap: https://techcommunity.microsoft.com/t5/azure-database-for-postgresql/community-insights-on-pgbadger-a-pgsql-phriday-010-recap/ba-p/3880911Get PostgreSQL Logs Into Honeycomb: https://docs.honeycomb.io/getting-data-in/logs/postgresql/Blog post by Lukas Fittl about pg_stat_io by Lukas: https://pganalyze.com/blog/pg-stat-ioBlog post by Andrew Atkinson about pg_stat_io: https://andyatkinson.com/blog/2023/11/01/PostgreSQL-IO-Visibility-wehack-pg_stat_ioBPFtrace by iovisor GitHub repo: https://github.com/iovisor/bpftraceTrace PostgreSQL locks with pg_lock_tracer: https://jnidzwetzki.github.io/2023/01/11/trace-postgresql-locks-with-pg-lock-tracer.htmlsysdig by draios GitHub repo: https://github.com/draios/sysdigUsing BPFtrace to trace PostgreSQL vacuum operations: https://www.timescale.com/blog/using-bpftrace-to-trace-postgresql-vacuum-operations/PostgreSQL Mailing Lists: https://www.postgresql.org/list/psql — PostgreSQL interactive terminal: https://www.postgresql.org/docs/current/app-psql.htmlOngoing discussion thread about pg_stat_statements: https://commitfest.postgresql.org/46/2837/Reconnoiter project referenced by Rob: https://github.com/circonus-labs/reconnoiter/tree/master/sqlFunny tweet about PostgreSQL pronunciation: https://twitter.com/as_w/status/1648373353214885892O11ycast EP63 with Lukas Fittl: https://www.heavybit.com/library/podcasts/o11ycast/ep-63-observability-in-the-database-with-lukas-fittl-of-pganalyzeOxide and Friends podcast: https://oxide-and-friends.transistor.fm/

Do you monitor your Postgres error logs for gold? Lukas Fittl and Rob Treat join Claire Giordano and Pino de Candia on the Path To Citus Con podcast for developers who love Postgres—to discuss their respective journeys into Postgres monitoring. Have you ever asked yourself: “Why is my query so slow?” Or had to figure out which query is slowing things down? Or why your database server is at 90% CPU? There are so many ways to monitor Postgres: pganalyze, pgMustard, pgBadger, pgDash, your cloud provider’s Query Performance Insights, pg_stat_statements, pg_stat_io, & more. If you’re running Postgres on a managed service, what kinds of things do you need to monitor & optimize for (vs. what will your cloud service provider do)? There’s also a segue on monitoring vs. observability: what’s the difference? 

Links mentioned in this episode:
OpenTelemetry: https://opentelemetry.io/pganalyze: https://pganalyze.com/pgDash: https://pgdash.io/pgMustard: https://www.pgmustard.com/pg_stat_statements docs: https://www.postgresql.org/docs/current/pgstatstatements.htmlpg_hint_plan: https://github.com/ossc-db/pg_hint_plan pg_hint_plan hint list: https://github.com/ossc-db/pg_hint_plan/blob/master/docs/hint_list.mdExample for PostgreSQL with pg_hint_plan: https://api.rubyonrails.org/classes/ActiveRecord/QueryMethods.html#method-i-optimizer_hints5mins of Postgres by pganalyze: https://www.youtube.com/playlist?list=PLhqxwIAgz78HZhWyu3UyKrCWNk7VWjVpjMonitoring page on PostgreSQL wiki: https://wiki.postgresql.org/wiki/MonitoringPgHero GitHub repo: https://github.com/ankane/pgheroInsights on pgBadger: A PGSQL Phriday #010 Recap: https://techcommunity.microsoft.com/t5/azure-database-for-postgresql/community-insights-on-pgbadger-a-pgsql-phriday-010-recap/ba-p/3880911Get PostgreSQL Logs Into Honeycomb: https://docs.honeycomb.io/getting-data-in/logs/postgresql/Blog post by Lukas Fittl about pg_stat_io by Lukas: https://pganalyze.com/blog/pg-stat-ioBlog post by Andrew Atkinson about pg_stat_io: https://andyatkinson.com/blog/2023/11/01/PostgreSQL-IO-Visibility-wehack-pg_stat_ioBPFtrace by iovisor GitHub repo: https://github.com/iovisor/bpftraceTrace PostgreSQL locks with pg_lock_tracer: https://jnidzwetzki.github.io/2023/01/11/trace-postgresql-locks-with-pg-lock-tracer.htmlsysdig by draios GitHub repo: https://github.com/draios/sysdigUsing BPFtrace to trace PostgreSQL vacuum operations: https://www.timescale.com/blog/using-bpftrace-to-trace-postgresql-vacuum-operations/PostgreSQL Mailing Lists: https://www.postgresql.org/list/psql — PostgreSQL interactive terminal: https://www.postgresql.org/docs/current/app-psql.htmlOngoing discussion thread about pg_stat_statements: https://commitfest.postgresql.org/46/2837/Reconnoiter project referenced by Rob: https://github.com/circonus-labs/reconnoiter/tree/master/sqlFunny tweet about PostgreSQL pronunciation: https://twitter.com/as_w/status/1648373353214885892O11ycast EP63 with Lukas Fittl: https://www.heavybit.com/library/podcasts/o11ycast/ep-63-observability-in-the-database-with-lukas-fittl-of-pganalyzeOxide and Friends podcast: https://oxide-and-friends.transistor.fm/

1 hr 21 min

Top Podcasts In Technology

Acquired
Ben Gilbert and David Rosenthal
No Priors: Artificial Intelligence | Technology | Startups
Conviction | Pod People
Lex Fridman Podcast
Lex Fridman
All-In with Chamath, Jason, Sacks & Friedberg
All-In Podcast, LLC
Hard Fork
The New York Times
TED Radio Hour
NPR