Scaling Postgres
540 episodes - English - Latest episode: 5 days ago - ★★★★★ - 9 ratingsLearn how to get the best performance and scale your PostgreSQL database with our weekly shows. Receive the best content curated from around the web. We have a special focus on content for developers since your architecture and usage is the key to getting the most performance out of PostgreSQL.
Homepage Apple Podcasts Google Podcasts Overcast Castro Pocket Casts RSS feed
Episodes
1,400 Times Faster Max & Group By Performance | Scaling Postgres 311
April 14, 2024 21:00 - 18 minutes - 34.6 MBIn this episode of Scaling Postgres, we discuss a 1,400 times faster max and group by implementation, new quantization capabilities in pgvector, adaptive radix trees and splitting & merging partitions in PG17. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/311-max-group-by-performance/
Andres, Microsoft & Postgres Save Linux? | Scaling Postgres 310
April 07, 2024 21:00 - 12 minutes - 23.7 MBIn this episode of Scaling Postgres, we discuss whether Postgres will pull a Redis, remembering Simon Riggs, built-in collation provider and C.UTF-8 in PG 17 and health checks. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/310-andres-microsoft-postgres-save-linux/
Will Postgres Pull A Redis? | Scaling Postgres 309
March 31, 2024 21:00 - 15 minutes - 27.8 MBIn this episode of Scaling Postgres, we discuss whether Postgres will pull a Redis, remembering Simon Riggs, built-in collation provider and C.UTF-8 in PG 17 and health checks. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/309-will-postgres-pull-a-redis/
Scale Through Sharding | Scaling Postgres 308
March 24, 2024 21:00 - 18 minutes - 33.4 MBIn this episode of Scaling Postgres, we discuss high availability's future, a custom sharding solution by Figma, sharding pg_vector queries, and PG17 logical replication failover. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/308-scale-through-sharding/
Collation Conundrum | Scaling Postgres 307
March 17, 2024 21:00 - 14 minutes - 26.3 MBIn this episode of Scaling Postgres, we discuss whether we should be using bytewise or linguistic ordering by default, how to transform data in Postgres, benefits of a transaction_timeout and how to enforce join order. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/307-collation-conundrum/
Scalability Limits From SLRU & Lock Manager | Scaling Postgres 306
March 10, 2024 21:00 - 14 minutes - 26.5 MBIn this episode of Scaling Postgres, we discuss one configuration change that resulted in an 11,000 times faster query, why Postgres is not using your index, backported PG improvements and parallelism with TOAST. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/306-scalability-limits-from-slru-lock-manager/
11K Faster Configuration Change | Scaling Postgres 305
March 03, 2024 22:00 - 13 minutes - 24.6 MBIn this episode of Scaling Postgres, we discuss one configuration change that resulted in an 11,000 times faster query, why Postgres is not using your index, backported PG improvements and parallelism with TOAST. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/305-11k-faster-configuration-change/
Overhead of pg_stat_statements | Scaling Postgres 304
February 25, 2024 22:00 - 14 minutes - 25.9 MBIn this episode of Scaling Postgres, we discuss new Postgres releases, performance comparisons between PgBouncer, PgCat and Supavisor, a new extension pg_analytics, and new planner capabilities in PG16. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/304-overhead-of-pg_stat_statements/
PgBouncer, PgCat, Supavisor Fight!!! | Scaling Postgres 303
February 18, 2024 22:00 - 19 minutes - 36.5 MBIn this episode of Scaling Postgres, we discuss new Postgres releases, performance comparisons between PgBouncer, PgCat and Supavisor, a new extension pg_analytics, and new planner capabilities in PG16. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/303-pgbouncer-pgcat-supavisor-fight/
UUID vs Bigint Battle!!! | Scaling Postgres 302
February 11, 2024 22:00 - 13 minutes - 24.5 MBIn this episode of Scaling Postgres, we discuss when and how you should use UUIDs or not, how to optimize space with column order and arrays, whether it is better to tune parameters or queries and what devs should know about Postgres with Andrew Atkinson. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/302-uuid-vs-bigint-battle/
Postgres LLM OS & 30 Times Faster Index Builds | Scaling Postgres 301
February 04, 2024 23:29 - 18 minutes - 33.4 MBIn this episode of Scaling Postgres, we discuss how you can build a GPT in 500 lines of SQL code, how to optimize extension loading, the best way to set passwords and being able to change generated columns. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/301-postgres-llm-os-30-times-faster-index-builds/
Scaling Postgres Celebration | Scaling Postgres 300
January 28, 2024 22:00 - 18 minutes - 33 MBIn this episode of Scaling Postgres, we discuss how you can build a GPT in 500 lines of SQL code, how to optimize extension loading, the best way to set passwords and being able to change generated columns. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/300-postgres-celebration/
Build A GPT In SQL | Scaling Postgres 299
January 21, 2024 22:00 - 12 minutes - 22.6 MBIn this episode of Scaling Postgres, we discuss how you can build a GPT in 500 lines of SQL code, how to optimize extension loading, the best way to set passwords and being able to change generated columns. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/299-build-a-gpt-in-sql/
10-100 Times Higher Latency With Distributed Postgres | Scaling Postgres 298
January 14, 2024 22:22 - 19 minutes - 35.7 MBIn this episode of Scaling Postgres, we discuss hopes for Postgres in 2024, whether you need foreign keys, incremental backups, and five ways of doing not exists. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/298-10-100-times-higher-latency-with-distributed-postgres/
Postgres In 2024 | Scaling Postgres 297
January 07, 2024 22:00 - 20 minutes - 37.8 MBIn this episode of Scaling Postgres, we discuss hopes for Postgres in 2024, whether you need foreign keys, incremental backups, and five ways of doing not exists. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/297-postgres-in-2024/
State Of Postgres 2023 | Scaling Postgres 296
December 24, 2023 22:00 - 17 minutes - 32.5 MBIn this episode of Scaling Postgres, we discuss the State of Postgres 2023 survey, a repository of Postgres how-tos, ways foreign keys can break and a custom SQL playground. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/296-state-of-postgres-2023/
30K Messages Per Second Queue | Scaling Postgres 295
December 17, 2023 22:00 - 15 minutes - 28.5 MBIn this episode of Scaling Postgres, we discuss a 30K messages per second queue built on Postgres, a zero downtime logical replication upgrade, the release of the Supavisor 1.0 connection pooler and PostGIS day. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/295-30k-messages-per-second-queue/
How Much Observability Is Needed? | Scaling Postgres 294
December 11, 2023 00:00 - 14 minutes - 25.9 MBIn this episode of Scaling Postgres, we discuss how much observability is needed, avoiding locks during database migrations, a huge Postgres events blogging event and FIPS mode. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/294-how-much-observability-is-needed/
Better Plans With Statistics | Scaling Postgres 293
December 04, 2023 01:03 - 15 minutes - 28 MBIn this episode of Scaling Postgres, we discuss how create statistics can help you get better plans, issues with subtransactions, all about extensions and best practices when indexing timestamps. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/293-better-plans-with-statistics/
Companion Databases? | Scaling Postgres 292
November 26, 2023 20:00 - 13 minutes - 24.2 MBIn this episode of Scaling Postgres, we discuss using companion databases, multi-tenancy database design, whether SQL is good, and different transaction isolation levels. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/292-companion-databases/
2 To 4 Times Faster With Vectorization | Scaling Postgres 291
November 19, 2023 20:55 - 18 minutes - 33.4 MBIn this episode of Scaling Postgres, we discuss Timescale's performance improvements from adding a query vectorization pipeline, doing blue-green deployments for databases, using reserved_connections and two improvements to null handling. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/291-2-to-4-times-faster-with-vectorization/
Postgres Releases = Reindexing | Scaling Postgres 290
November 12, 2023 20:36 - 14 minutes - 26.3 MBIn this episode of Scaling Postgres, we discuss my Postgres Performance Starter Kit, new releases of Postgres, removing JIT, and a lightweight message queue. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/290-postgres-releases-equals-reindexing/
Postgres Scheduling Opportunities | Scaling Postgres 289
November 05, 2023 20:51 - 15 minutes - 28 MBIn this episode of Scaling Postgres, we discuss new options for Postgres scheduling tools, proper ways to kill processes and explain usage. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/289-postgres-scheduling-opportunities/
Index Corruption From ICU Collation Change | Scaling Postgres 288
October 29, 2023 22:23 - 19 minutes - 23.4 MBIn this episode of Scaling Postgres, we discuss index corruption from a ICU collation change, another caveat for PgBouncer prepared statements, ways to version data, and using Postgres as a cache. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/288-index-corruption-from-icu-collation-change/
15% - 250% Faster Query Throughput | Scaling Postgres 287
October 22, 2023 21:14 - 14 minutes - 26.4 MBIn this episode of Scaling Postgres, we discuss how the new version of pgbouncer could get you 15% to 250% faster query throughput, the availability of using kubernetes snapshots for backup and restore with CloudNativePg and Ruby on Rails Postgres improvements. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/287-15-250-percent-faster-query-throughput/
20 Times Faster Text Search & Ranking? | Scaling Postgres 286
October 15, 2023 21:00 - 12 minutes - 23.8 MBIn this episode of Scaling Postgres, we discuss a new extension that promises substantially faster text search and ranking, an AI content storm, how to work with money and the fastest way to stop Postgres. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/286-20-times-faster-text-search-ranking/
Indexing Deep Dive | Scaling Postgres 285
October 08, 2023 21:56 - 18 minutes - 33 MBIn this episode of Scaling Postgres, we cover a deep dive into indexes from a presentation that includes a decision tree of sorts, how to convert to partitioned tables once you have hundreds of millions of rows and detail about the new pg_stat_io view. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/285-indexing-deep-dive/
23 Or 1.1 Times Faster Performance? | Scaling Postgres 284
October 01, 2023 21:27 - 18 minutes - 34.8 MBIn this episode of Scaling Postgres, we discuss whether something is 23 times faster or 1.1 times faster. We also discuss the release of Timescale Vector and whether you can build a queue on Postgres. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/284-23-or-1-times-faster-performance/
222 Times Faster Analytical Queries With Columnar Storage | Scaling Postgres 283
September 24, 2023 21:23 - 16 minutes - 29.3 MBIn this episode of Scaling Postgres, we discuss how to get 222 times faster analytical queries with columnar storage, a Postgres 16 feature review, the birth of a feature and fuzzy search. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/283-222-times-faster-analytical-queries-with-columnar-storage/
Postgres 16 Released, The Postgres Meme, File vs base64 Strings, Intelligent Sharding | Scaling Postgres 282
September 17, 2023 21:15 - 14 minutes - 25.6 MBIn this episode of Scaling Postgres, we discuss the release of Postgres 16, a Postgres meme, storing files or base64 strings and sharding intelligently. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/282-postgres-16-released-postgres-meme-file-vs-base64-strings-intelligent-sharding/
HNSW Indexes, Vacuuming Bloat, Watch Me Now, Connections | Scaling Postgres 281
September 10, 2023 21:32 - 17 minutes - 31.5 MBIn this episode of Scaling Postgres, we discuss the benefits and disadvantages of HNSW indexes for working with vector data, configuring vacuum to reduce bloat and optimize performance, the new options available for \watch and all about connections. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/281-hnsw-indexes-vacuuming-bloat-watch-me-now-connections/
Postgres 16 RC1, Bi-Directional Replication, All About Parameters, Foreign Keys & Polymorphism | Scaling Postgres 280
September 03, 2023 21:42 - 21 minutes - 38.7 MBIn this episode of Scaling Postgres, we discuss the release of Postgres 16 RC1, implementing bi-directional replication, different ways you can set up Postgres parameters and how to handle polymorphism and foreign keys. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/280-postgres-16-rc1-bi-directional-replication-all-about-parameters-foreign-keys-polymorphism/
TPS Benchmark, Partition-wise Join & Aggregate, Partitioning Billions, Posgres 16 Features | Scaling Postgres 279
August 27, 2023 20:50 - 15 minutes - 29.3 MBIn this episode of Scaling Postgres, we discuss how pgbouncer can impact a TPS benchmark, partition-wise join & aggregate performance, partitioning a table with billions of rows and cool Postgres 16 features. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/279-tps-benchmark-partition-wise-join-partitioning-billions-postgres-16-features/
Squeeze Your System, One Million Connections, Indexing LIKE, pgvector HNSW | Scaling Postgres 278
August 20, 2023 21:32 - 15 minutes - 29.3 MBIn this episode of Scaling Postgres, we discuss how to squeeze the most out of your database, achieving one million connections to Postgres, how to use indexes with LIKE and pgvector HNSW index performance. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/278-squeeze-your-system-one-million-connections-indexing-like-pgvector-hnsw/
Postgres Releases, PostgreSQL Survey, Partitioning vs. Sharding, Bulk Loading | Scaling Postgres 277
August 13, 2023 16:32 - 19 minutes - 34.9 MBIn this episode of Scaling Postgres, we discuss new Postgres releases, taking the 2023 State of PostgreSQL survey, partitioning vs. sharding and the fastest way to do bulk loads. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/277-postgres-releases-postgresql-survey-partitioning-sharding-bulk-loading/
BRIN & Correlation, Poor Partitioning, 10 Beginner Tips, Table & Index Usage | Scaling Postgres 276
July 30, 2023 21:13 - 15 minutes - 29.2 MBIn this episode of Scaling Postgres, we discuss the importance of correlation with BRIN indexes, how partitioning can kill performance, 10 tips for beginners and how to track table and index usage. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/276-brin-correlation-poor-partitioning-10-beginner-tips-table-index-usage/
No More Vacuum, Zero-Downtime Cut-Over, Network Impact, Not In Optimization | Scaling Postgres 275
July 23, 2023 21:12 - 13 minutes - 24.3 MBIn this episode of Scaling Postgres, we discuss getting rid of vacuum, how to do zero-downtime cut-overs, analyzing the impact of slow networks and seeing a not in optimization. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/275-no-more-vacuum-zero-downtime-cut-over-network-impact-not-in-optimization/
Subquery Performance, Avoid Update Locking, Column Changes, Outage Workshop | Scaling Postgres 274
July 16, 2023 21:14 - 14 minutes - 26.9 MBIn this episode of Scaling Postgres, we discuss subquery performance, how to avoid excessive locking when doing updates, how to change a columns datatype without excessive locking and lessons from an upgrade outage. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/274-subquery-performance-avoid-update-locking-column-changes-outage-workshop/
Debian / Ubuntu Packaging, ivfflat Indexes, In vs Any, View Logging | Scaling Postgres 273
July 10, 2023 00:42 - 15 minutes - 28.5 MBIn this episode of Scaling Postgres, we discuss how Debian & Ubuntu package Postgres, how ifflat indexes work, in vs any performance and how to log view usage. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/273-debian-ubuntu-packages-ivfflat-indexes-in-vs-any-view-logging/
Postgres 16 Beta 2, The Rise of Vectors, FDW Performance, Unused Indexes | Scaling Postgres 272
July 03, 2023 03:10 - 14 minutes - 26.8 MBIn this episode of Scaling Postgres, we discuss the release of Postgres 16 Beta 2, the rise of vectors and storing them, Foreign Data Wrapper performance and how to identify unused indexes. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/272-postgres-16-beta-2-rise-of-vectors-fdw-performance-unused-indexes/
30% Faster, UUID Downsides, Growing WAL, Processes vs. Threads | Scaling Postgres 271
June 26, 2023 00:28 - 16 minutes - 30 MBIn this episode of Scaling Postgres, we discuss how to get 30% faster performance, the downsides of UUIDs, having too much WAL and whether Postgres should use processes or threads. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/271-30-percent-faster-uuid-downsides-growing-wal-processes-vs-threads/
Data Skew, Monitoring, Remote Access CSV, Documentation | Scaling Postgres 270
June 18, 2023 21:10 - 14 minutes - 26.1 MBIn this episode of Scaling Postgres, we discuss how to handle data skew, tools for Postgres monitoring, how to load data remotely and Postgres documentation. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/270-data-skew-monitoring-remote-access-csv-documentation/
Upgrade Struggles, Hyperloglog, PgBouncer Usage, Postgres Scaling | Scaling Postgres 269
June 11, 2023 23:45 - 18 minutes - 34.2 MBIn this episode of Scaling Postgres, we discuss Postgres upgrade struggles, how and why to use hyperloglog, using pgbouncer for session vs. transaction pooling, and methods to scale Postgres. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/269-upgrade-struggles-hyperloglog-pgbouncer-usage-postgres-scaling/
Faster Copy, psql Variables, backup_label, Bad Encoding | Scaling Postgres 268
June 04, 2023 21:14 - 11 minutes - 21.3 MBIn this episode of Scaling Postgres, we discuss faster COPY in Postgres 16, how to use psql variables, the importance of backup_label and issues with bad character encoding. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/268-faster-copy-psql-variables-backup_label-bad-encoding/
PostgreSQL 16 Beta 1, Rust Functions, Partitioning Memory Problems, Tags & Arrays | Scaling Postgres 267
May 28, 2023 21:11 - 16 minutes - 29.4 MBIn this episode of Scaling Postgres, we discuss the release of PostgreSQL 16 Beta 1, creating Rust functions with PL/Rust, memory problems related to partitioning and prepared statements, and modeling tags with arrays. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/267-postgres-16-beta-1-rust-functions-partitioning-memory-problems-tags-arrays/
Postgres Releases, Postgres Distributed, Privilege Template, Real-Time Dashboards | Scaling Postgres 266
May 21, 2023 21:43 - 16 minutes - 30.9 MBIn this episode of Scaling Postgres, we discuss new Postgres releases, EDB Postgres Distributed, a privilege template and real-time dashboards. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/266-postgres-releases-postgres-distributed-privilege-template-real-time-dashboard/
pg_stat_statements, Transaction ID Wraparound, Consultant Knowledge, CitusCon | Scaling Postgres 265
May 14, 2023 21:26 - 16 minutes - 30.7 MBIn this episode of Scaling Postgres, we discuss different ways to use pg_stat_statements, how to handle transaction ID wraparound, consultant knowledge and all the videos of CitusCon. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/265-pg_stat_statements-transaction-id-wraparound-consultant-knowledge-cituscon/
The Worst Part, Pluggable Storage, A Busy System, Data Architecture | Scaling Postgres 264
May 07, 2023 20:17 - 17 minutes - 31.2 MBIn this episode of Scaling Postgres, we discuss the worst part of Postgres, the status of pluggable storage, what makes a busy system and methods for managing different data architectures. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/264-worst-part-pluggable-storage-busy-system-data-architecture/
LZ4 & ZSTD Compression, Avoiding Problems, Triggers Simplify, Indexes Can Hurt | Scaling Postgres 263
May 01, 2023 13:07 - 19 minutes - 35.2 MBIn this episode of Scaling Postgres, we discuss LZ4 and ZSTD pg_dump compression, how to avoid problems, can triggers simplify and indexes can hurt. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/263-lz4-zstd-compression-avoiding-problems-triggers-simplify-indexes-can-hurt/
pg_failover_slots, Standby Logical Decoding, Trusted Language Extensions, Postgres Package Manager | Scaling Postgres 262
April 23, 2023 21:50 - 14 minutes - 27 MBIn this episode of Scaling Postgres, we discuss the pg_failover_slots extension, how PG16 allows logical decoding on standbys, what are trusted language extensions and how a package manager has been built for them. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/262-pg_failover_slots-standby-logical-decoding-trusted-language-extensions-postgres-package-manager/