postgresql.md

title	PostgreSQL

PostgreSQL

Internals of PostgreSQL is great. Postgres.js & Prisma are neat ORMs. Looking into EdgeDB now as it builds on top of Postgres and has many nice features. Citus & Snaplet seem neat too.

Want to try build something on top of pgproto3. Also trying out pgx as a Go lib to query Postgres.

Notes

• Can use ::1 in Postico to remove unsafe connection warning
• VACUUM ANALYZE is useful.
• Unless you need real time PostgreSQL is always the most obvious solution. If you do need real time you can build it on PostgreSQL yourself depending on your requirements either using LISTEN/NOTIFY or logical replication. There are tradeoffs to both if tbh if you are asking this question you probably don't want to go that path. Non-realtime it's very easy to handle nested JSON in PostgreSQL but I would still avoid it like the plague unless it's user-supplied data without any real schema. You might feel like schema-less lets you "move faster" but it's a load of horseshit that really starts to stink much sooner than you might think. Schemas and by extension database integrity make it easier to move faster because migrations allow you to ensure there are no edge conditions related to stored data when upgrading your code to use an extended or otherwise modified data model. The other main benefit of PostgreSQL is just the sheer body of resources available, with the exception of the other main RDBMS (MySQL/MSSQL) it just completely dwarfs what is available for other data stores. You will rarely if ever encounter a problem someone hasn't already solved.
• Standard Postgres approach: run the query with EXPLAIN ANALYZE, then reduce places where unnecessary work is being done. i.e. moving conditions as deep into the query as possible, and getting rid of a join by turning it into a condition.

Links

• PostgreSQL Exercises (Code)
• Skor - Listen to Postgres events and forward them as JSON payloads to a webhook.
• PipelineDB - High-performance time-series aggregation for PostgreSQL.
• pgsync - Sync Postgres data between databases.
• Bye bye Mongo, Hello Postgres (HN)
• The Internals of PostgreSQL (HN) (HN)
• Slonik - PostgreSQL client with strict types, detail logging and assertions for node.js (slonik-tools)
• Postico - Modern PostgreSQL Client for the Mac. (HN)
• prettier-plugin-pg - Work-in-progress plugin for prettier to support formatting of PostgreSQL-flavour SQL.
• PostGraphile - Execute one command (or mount one Node.js middleware) and get an instant high-performance GraphQL API for your PostgreSQL database.
• WAL-G - Archival restoration tool for Postgres.
• Migra - Diff for PostgreSQL schemas. (HN)
• PGHoard - PostgreSQL backup and restore service.
• postgresqltuner.pl - Simple script to analyse your PostgreSQL database configuration, and give tuning advice.
• PostgreSQL Wiki
• Postgres – Don't Do This (HN)
• pgx - PostgreSQL driver and toolkit for Go.
• postgres-operator - Controller that runs within a Kubernetes cluster that provides a means to deploy and manage PostgreSQL clusters.
• Fastest Way to Load Data Into PostgreSQL Using Python (2019)
• pgfutter - Import CSV and JSON into PostgreSQL the easy way.
• The Art of PostgreSQL - Book that teaches SQL to developers: Learn to replace thousands of lines of code with simple queries. (Lobsters)
• PLV8 - V8 Engine Javascript Procedural Language add-on for PostgreSQL.
• HN: PostgreSQL 12 release (2019)
• PostgreSQL: When it’s not your job (2017)
• Postgres Is Underrated—It Handles More than You Think (2019) (Lobsters)
• Postgres Schema Design (HN)
• PostgreSQL for Beginners book - Intended for those who only start getting acquainted with the world of PostgreSQL.
• PostgreSQL Notes
• pg_flame - Flamegraph generator for Postgres EXPLAIN ANALYZE output.
• PostgREST - Serves a fully RESTful API from any existing PostgreSQL database. (HN) (HN 2) (Introduction to Postgrest) (HN)
• Postgres Explain Visualizer (pev)
• Dexter - Automatic indexer for Postgres.
• Hypothetical Indexes in PostgreSQL (2019)
• System design hack: Postgres is a great pub/sub & job server (2019) (HN)
• Turning PostgreSQL into a queue serving 10,000 jobs per second (HN)
• PGLoader - Migrate to PostgreSQL in a single command. (HN) (Web)
• PgHero - Performance dashboard for Postgres.
• pg-structure - Get PostgreSQL database structure as a detailed JS Object.
• Odyssey - Scalable PostgreSQL Connection Pooler. (HN)
• PostgreSQL at low level: stay curious! (2019)
• pgAudit - PostgreSQL Audit Extension.
• Message DB: Event Store and Message Store for PostgreSQL (2019) (HN) (Code)
• Supabase Realtime - Listen to your to PostgreSQL database in real time via WebSockets. (HN)
• py-pgproto - Low-level IO utilities for PosgtreSQL drivers.
• pgweb - Cross-platform client for PostgreSQL databases.
• plow - Postgres migrations and seeding made easy.
• New Plan - Analyze, visualize and share Postgres Query Plans.
• Visualize your explain of PostgreSQL query
• postgresql.conf - Postgres configuration reference. Helps tune and optimize PostgreSQL configuration.
• My GOTO Postgres Configuration for Web Services (2020)
• pg_timetable - Advanced scheduling for PostgreSQL. (Article)
• PostgreSQL at Scale: Database Schema Changes Without Downtime (2019)
• Strong migrations - Catch unsafe migrations in development.
• PostgreSQL Documentation
• HN: The state of full text search in PostgreSQL 12 (2020)
• pgmetrics - Collect and display information and stats from a running PostgreSQL server. (Web)
• pgDash - Comprehensive diagnostic and monitoring solution designed to help you ensure the ongoing health and performance of your PostgreSQL deployment.
• pgcli - Postgres CLI with autocompletion and syntax highlighting.
• Transactionally Staged Job Drains in Postgres (2017) (HN)
• Postgres source code
• Postgres Explain Visualizer (pev) - VueJS component to show a graphical visualization of a PostgreSQL execution plan. (Code) (HN)
• Awesome Postgres
• PostgreSQL Automatic Failover - High-Availibility for Postgres, based on industry references Pacemaker and Corosync.
• pgagroal - High-performance protocol-native connection pool for PostgreSQL. (HN)
• Distinct On: The Confusing, Unique and Useful Feature in Postgres (2020) (HN)
• Simplify: move code into database functions
• Postgres Weekly - Free, once–weekly e-mail round-up of PostgreSQL news and articles.
• graphile-migrate - Opinionated SQL-powered productive roll-forward migration tool for PostgreSQL.
• pgslice - Postgres partitioning as easy as pie.
• Things I Hate About PostgreSQL (2020) (HN) (Lobsters)
• pgFormatter - PostgreSQL SQL syntax beautifier. (Code)
• graphile-worker - Job queue for PostgreSQL running on Node.js.
• pgBadger - PostgreSQL log analyzer built for speed with fully detailed reports and professional rendering. (Code)
• pgCluu - PostgreSQL performances monitoring and auditing tool. (Code)
• ZomboDB - Brings powerful text-search and analytics features to Postgres by using Elasticsearch as an index type.
• Full Text Search in Milliseconds with Rails and PostgreSQL
• Using PostgreSQL for JSON Storage (HN)
• PGSync - PostgreSQL to Elasticsearch sync.
• Improved (auto)vacuum in PostgreSQL 13 (2020) (HN)
• HN: Ask HN: What PostgreSQL client do you use? (2020)
• Recursive SQL Queries with PostgreSQL (2020)
• How one word in PostgreSQL unlocked a 9x performance improvement (2020) (HN)
• pgCenter - Command-line admin tool for observing and troubleshooting Postgres.
• Supabase - Adds realtime and restful APIs to Postgres without a single line of code. ([HN]) (Docs) (JS client) (CLI) (Supabase with Paul Copplestone) (Tweet) (Tweet) (Made with Supabase) (Made with Supabase Code)
• Postgres Docker image with common extensions - From Supabase. (HN)
• Queries to monitor your PostgreSQL database
• PostgreSQL BRIN Indexes: Big Data Performance With Minimal Storage (2019)
• PostgreSQL query parallelism can be like a box of chocolates (2020)
• Swarm64 - Faster PostgreSQL performance and easier scaling.
• Patroni - Template for PostgreSQL High Availability with Etcd, Consul, ZooKeeper, or Kubernetes.
• PostgreSQL HTTP Client - Retrieve a web page from inside the database.
• Crunchy Data - Trusted Open Source PostgreSQL & Commercial Support for the Enterprise.
• Kanel - Generate Typescript types from Postgres.
• 5 Ways to Host PostgreSQL Databases (2020)
• Jepsen: PostgreSQL 12.3 (2020) (HN)
• pgsodium - Modern cryptography for PostgreSQL using libsodium. (HN)
• Serializable Snapshot Isolation in PostgreSQL
• How does MVCC (Multi-Version Concurrency Control) work (2020)
• Looking Back at Postgres (2019) (HN) (Notes)
• The Postgres and Illustra Codelines
• Citus - Distributed PostgreSQL extension for multi-tenant and real-time analytics workloads. (Web) (GitHub) (HN)
• Postgres...as an App? (2020) (Lobsters)
• PostgreSQL query JIT (2020)
• PgBouncer - Lightweight connection pooler for PostgreSQL. (Code)
• Indexing JSONB columns in PostgreSQL (2020) (Lobsters)
• Splitgraph - Build and share data with Postgres, inspired by Docker/Git. (HN)
• Running Postgres in Kubernetes (HN)
• Zero dependancy Pub / Sub system with PostgreSQL (2018)
• Ephemeral PostgreSQL - Quickly spin up a temporary PostgreSQL test databases. (Docs)
• Managing PostgreSQL Logical Replication (2020)
• Noisia - Harmful workload generator for PostgreSQL.
• Foreign data wrappers: PostgreSQL's secret weapon? (2020) (HN)
• PostgreSQL Templates (2020) (HN)
• pgx - Build Postgres Extensions with Rust. (HN)
• PostgreSQL EXPLAIN glossary
• Postgres Job Queues & Failure By MVCC (2020)
• PostgreSQL beginner guide (2020) (HN)
• pgxtesting - Utilities for having a temporary database per test.
• PostgreSQL: bloat, pg_repack, and deferred constraints (2020)
• How we used Postgres extended statistics to achieve a 3000x speedup (2020)
• Postgres Execution Plans - Field Glossary (2019)
• Recursive queries in PostgreSQL (2020) (HN)
• Cloud-Native PostgreSQL on Kubernetes (2020) (Slides)
• Quickly debugging Postgres problems (2020)
• pg-jump - Postgres jumphost with query audit-logging.
• WAL-E - Continuous Archiving for Postgres.
• Postgres Tips And Tricks
• Bootstraping Postgres in your project (2020)
• How to use PostgreSQL's LISTEN/NOTIFY as a simple message queue with psycopg2 and asyncio
• PostgreSQL B-Tree index deduplication (2020) (HN)
• PostgreSQL and Machine Learning (2020)
• Things we learned running Postgres 13 (2020) (HN)
• 2ndQuadrant - PostgreSQL support company.
• Mastering PostgreSQL Administration (2020) (HN)
• Cost savings of using managed PostgreSQL
• How to Fix PostgreSQL Performance Issues with PG Extras (2020)
• 7 Tips for PostgreSQL Bulk Data Loading (2020)
• Zheap: Reinvented PostgreSQL storage (2020) (Lobsters) (HN)
• EDB - Supercharges PostgreSQL.
• PostgreSQL community impact of 2nd Quadrant purchase (2020) (HN)
• PostgreSQL Contributors
• Measuring the Memory Overhead of a Postgres Connection (2020) (HN)
• prostgles-server - Isomorphic PostgreSQL client for node. (Web)
• pg_squeeze: Optimizing PostgreSQL storage (2020)
• CYBERTEC PostgreSQL - Professional PostgreSQL services. (Web)
• Efficient Evenly Distributed Sampling of Time Series Records in PostgreSQL (2020)
• postgres-interval - Parse Postgres interval columns.
• The Surprising Impact of Medium-Size Texts on PostgreSQL Performance (2020)
• Run PostgreSQL by hands (2019)
• PostgreSQL Monitoring for Application Developers (2020)
• PostgreSQL Feature Matrix
• Recurring Events and PostgreSQL (2020)
• What's so exciting about Postgres? With Craig Kerstiens (2020) (HN)
• Building a recommendation engine inside Postgres with Python and Pandas (2020)
• Protocol Buffer extension for PostgreSQL
• Getting Started With Postgres 13 on Ubuntu 20.04 (2020)
• prettier-plugin-pg - Plugin for prettier to support formatting of PostgreSQL-flavour SQL.
• PGTune - Tuning PostgreSQL config by your hardware. (Code)
• Book about PostgreSQL: tuning and scaling (Russian) (Code)
• An Immutable Blog Application in PostgreSQL (2015) (Lobsters)
• Postgres Constraints (2020)
• Distributed Coordination Using Postgres (2020)
• pg_auto_failover - Postgres extension and service for automated failover and high-availability.
• Postgres Observability - Postgres views and functions that contain info you might want to know about a Postgres instance. (HN)
• PostgreSQL Server Exporter - Prometheus exporter for PostgreSQL server metrics.
• How to Analyze a PostgreSQL Crash Dump File (2020)
• PostgreSQL psql command line tutorial and cheat sheet (HN)
• Viva the NoSQL Postgres - Alexande Korotkov (2019)
• The Basics of Views and Materialized Views in PostgreSQL
• Writing a Postgres Foreign Data Wrapper for Clickhouse in Go (2020) (HN)
• RUM access method - Provides access method to work with RUM index. It is based on the GIN access methods code. Can be used for full text search.
• Hypershield - Shield sensitive data in Postgres and MySQL.
• PostgreSQL to PostgreSQL in minutes - Stitch PostgreSQL integration enables you to ETL data from one PostgreSQL database to another PostgreSQL you'd like to use as a data warehouse.
• Serverless-postgres - Package for managing PostgreSQL connections at serverless scale.
• pg-shortkey - YouTube-like Short IDs as Postgres Primary Keys. (HN)
• pg-mem - Experimental in-memory emulation of a postgres database. Useful for unit tests.
• pg-listen - Postgres LISTEN & NOTIFY that works.
• pgtricks - Handy helpers for PostgreSQL users.
• PGCon 2020 (HN)
• Mastering Postgres indexes in 10 minutes (2020)
• pgreplay - Record and replay real-life database workloads.
• pgreplay-go - Postgres load testing tool.
• pg_stat_monitor - PostgreSQL Statistics Collector.
• hasql-queue - Module that utilizes PostgreSQL to implement a durable queue for efficently processing payloads. (Introducing hasql-queue)
• tmp-postgres - Create temporary postgres instances. (Keeping Database Tests Fast with tmp-postgres) (Faster Database Testing with the New tmp-postgres)
• DbSchema - Opinionated database schema management tool that lets you maintain your DB schema with a single ruby file.
• Apache Age - Graph database optimized for fast analysis and real-time data processing. It is provided as an extension to PostgreSQL. (Web) (HN)
• Bucardo.org - PostgreSQL tools for Replication, Monitoring, and Productivity.
• Re-Introducing Hash Indexes in PostgreSQL (2021)
• postgresql-hll - PostgreSQL extension adding HyperLogLog data structures as a native data type.
• pg_cron - Run periodic jobs in PostgreSQL. (HN)
• temBoard - PostgreSQL Remote Control. (Web)
• Postgres Guide (Code)
• Postgres Book Collection
• Embedded Postgres Binaries - Lightweight bundles of PostgreSQL binaries with reduced size intended for testing purposes.
• pg_activity - Command line tool for PostgreSQL server activity monitoring.
• Our Journey to PostgreSQL 12 (2021) (HN)
• Postgres Scaling Advice for 2021 (HN)
• Deploy PostgreSQL With TLS in Kubernetes (2021)
• The Image of Postgres (2021)
• Avoiding, Identifying, and dealing with PostgreSQL database corruption (2021)
• Planet PostgreSQL - Aggregator for Postgres blog posts from across the web.
• pllua - Embeds Lua into PostgreSQL as a procedural language module.
• An unexpected find that freed 20GB of unused index space in PostgreSQL (2021) (HN)
• Waiting for PostgreSQL 14 – SEARCH and CYCLE clauses (2021) (HN)
• PostgreSQL: What is a checkpoint? (2021)
• Cleaning Up Your Postgres Database (2021)
• Deep PostgreSQL Thoughts: The Linux Assassin (2021)
• pg-boss - Queueing jobs in Node.js using PostgreSQL like a boss.
• FlameExplain - PostgreSQL EXPLAIN ANALYZE visualizer with advanced quirk correction algorithms. (Code)
• AWS Babelfish: The Elephant in the PostgreSQL Room? (2021) (HN)
• Metagration - PostgreSQL Migrator in PostgreSQL.
• Aquameta - Web development platform built entirely in PostgreSQL.
• Deep PostgreSQL Thoughts: Resistance to Containers is Futile (2021)
• Postgres Trigram search learnings (2021)
• Postgres regex search over 10,000 GitHub repositories (using only a Macbook) (2021)
• JIT-Compiling SQL Queries in PostgreSQL Using LLVM (2017) (HN)
• Faster data migrations in Postgres (2021)
• Fuzzy Name Matching in Postgres (2021)
• pgsql-ast-parser - Postgres SQL syntax parser.
• Postgres: Built-in full text search vs. trigram matching (2021)
• Efficient Postgres Full Text Search in Django (2021)
• PGMig - Standalone PostgreSQL Migration Runner.
• Handling Global Associative Arrays in PostgreSQL (2021)
• Time-Series Analytics for PostgreSQL: Introducing Timescale Analytics Project (2021)
• PGConf.Online (2021 Slides)
• Deploying PostgreSQL for High Availability with Patroni, etcd and HAProxy (2021)
• Running a safe database migration using Postgres (2021)
• Postgres Notify for Real Time Dashboards (2021)
• Cleaning Up Your Postgres Database (2021)
• Cracking PostgreSQL Interview Questions (2021)
• Performance differences between Postgres and MySQL (2021) (Lobsters)
• Using Postgres for Cron (2021)
• Writing a Postgres SQL Pretty Printer in Rust (2021)
• Notes on some PostgreSQL implementation details (2021)
• pg_repack - Reorganize tables in PostgreSQL databases with minimal locks.
• Securing a Postgres Database (2021) (HN)
• Things I Hate About PostgreSQL (2020) (Lobsters) (HN)
• Anatomy of a PostgreSQL Query Plan (2021)
• Terraform Provider for PostgreSQL
• Lessons Learned from 5 Years of Scaling PostgreSQL (2021) (HN)
• pganalyze - PostgreSQL Performance Monitoring. PostgreSQL Tuning. (GitHub)
• pganalyze collector - Go-based daemon which collects various information about Postgres databases as well as queries run on it.
• Working with PostgreSQL (2021)
• Pgvector - Open-source vector similarity search for Postgres. (HN)
• PgCookbook - PostgreSQL documentation project.
• pg_tmp - Run tests on an isolated, temporary PostgreSQL database. (HN)
• IntegreSQL - Manages isolated PostgreSQL databases for your integration tests.
• EventStore - Event store using PostgreSQL for persistence.
• Stripe Sync Engine - Continuously synchronizes a Stripe account to a Postgres database.
• PGXN: PostgreSQL Extension Network
• PGXN Client - Command line client for the PostgreSQL Extension Network.
• Using PostgreSQL as a Data Warehouse (2021) (HN)
• IsomorphicDB - PostgreSQL compatible distributed database in Rust. (Code)
• pgq - Go library for job queues that use Postgres for persistence.
• pgANN - Approximate Nearest Neighbor (ANN) searches using a PostgreSQL backend.
• smlar - PostgreSQL extension for an effective similarity search.
• Debugging random slow writes in PostgreSQL (2021) (HN)
• PostgreSQL: Detecting slow queries quickly (2021)
• An early look at Postgres 14 performance and monitoring improvements (2021) (HN)
• Kubegres - Kubernetes operator allowing to deploy one or many clusters of PostgreSql pods with data replication and failover enabled out-of-the box. (Code) (OSS release) (HN)
• Beware The Missing Foreign Key Index: A Postgres Performance Gotcha (2021)
• How difficult is to create a database software like PostgreSQL? (2021)
• PostgreSQL EXPLAIN Output Explained (2021) (HN)
• PolarDB - Open source database system based on PostgreSQL. (HN)
• PostgreSQL UUID vs. Serial vs. Identity (2021) (HN)
• repmgr - Replication Manager for PostgreSQL. (Web)
• Better JSON in Postgres with PostgreSQL 14 (2021) (Tweet) (HN)
• PostgreSQL Autodoc - Dumps a Postgres schema in several useful documentary forms.
• Logical replication and decoding for Cloud SQL for PostgreSQL (2021) (HN)
• Zero downtime Postgres migration, done right (2021) (HN)
• Do You Really Need Redis? How to Get Away with Just PostgreSQL (2021) (HN)
• embedded-postgres - Run an embedded PostgreSQL database in Go application or test.
• Hierarchical Structures in PostgreSQL (HN)
• pgsh - PostgreSQL tools for local development.
• How to best store audio files in PostgreSQL (2021)
• Globally Distributed Postgres (2021) (HN)
• Implementing Stripe-Like Idempotency Keys in Postgres (2017) (HN)
• Protecting reserved roles with PostgreSQL Hooks (2021)
• HypoPG - PostgreSQL extension adding support for hypothetical indexes. (Docs)
• Installing different PostgreSQL server versions in GitHub Actions
• Syncing Stripe to Postgres (2021)
• Sync Inc - Replicate third-party APIs to Postgres. (GitHub)
• PostgreSQL: Limit vs. Fetch First Rows with Ties
• High Availability Postgres on Fly
• Cut Out the Middle Tier: Generating JSON Directly from Postgres (2021)
• Coordination-free Database Query Sharding with PostgreSQL (2021)
• Postgres Full-Text Search: A Search Engine in a Database (2021) (HN)
• imgsmlr-server - Simple image search service based on imgsmlr extension of PostgreSQL.
• pg_plan_inspector - Framework to monitor and improve the performance of PostgreSQL using Machine Learning methods.
• How PostgreSQL aggregation works and how it inspired our hyperfunctions’ design
• Postgres.app - Easiest way to get started with PostgreSQL on the Mac. (HN)
• pgdiff - Compare what data changed in your Postgres database between two points in time.
• Postgres Extensions in Rust (2021)
• Supabase in 6 Minutes - Building a Full Stack App with Supabase and React (2021)
• Postgres Conference (Videos)
• squawk - Linter for PostgreSQL, focused on migrations. (Web)
• plum - Lightweight tool to investigate and explore lock contention in PostgreSQL database.
• PostgreSQL Subtransactions Considered Harmful (2021) (HN)
• Implement Authorization using Row Level Security with Supabase (2021)
• Supabase PgBouncer (2021)
• HN: Using PostgreSQL’s JSONB for NoSQL
• Docker Official Image packaging for Postgres
• Postgres: Boundless Text and Back Again (2021) (HN)
• Data Fluent for PostgreSQL (2021) (Code)
• Building PostgreSQL Extensions with Rust (2021)
• Postgres 14: It's The Little Things (2021) (Reddit)
• node-pg-migrate - Node.js database migration management built exclusively for postgres.
• Persisted operations - Persisted operations (aka "persisted queries") support for PostGraphile.
• PostgreSQL Prolog - Prolog library to connect to PostgreSQL databases. (HN)
• postgraphile-plugin-connection-filter - Adds a powerful suite of filtering capabilities to a PostGraphile schema.
• Why isn’t Postgres using my index? (2021)
• PostgreSQL 14 (2021) (HN)
• Why we spent the last month eliminating PostgreSQL subtransactions (2021) (Lobsters)
• PostgreSQL 14 on Kubernetes (2021) (HN)
• Lessons learned from sharding Postgres at Notion (2021) (HN)
• PSQL wire protocol - Go PostgreSQL server wire protocol implementation. Build your own PostgreSQL server with 15 lines of code.
• clickhousedb_fdw - PostgreSQL's Foreign Data Wrapper For ClickHouse.
• Google Cloud Gives Spanner a PostgreSQL Interface (2021) (HN)
• StackGres - Enterprise Postgres made easy. On Kubernetes. (Code)
• OnGres - PostgreSQL Professional Services & Products. (Twitter)
• Postgres text search: balancing query time and relevancy (2021) (HN)
• Function pipelines: Building functional programming into PostgreSQL (2021) (HN)
• Stateless Postgres Query Router (SPQR)
• PostgresDBA - Useful tools for Postgres DBAs and all engineers.
• Postgres Checkup - PostgreSQL Health Check and SQL Performance Analysis.
• Database Lab Engine - Allows blazing-fast cloning of Postgres databases of any size in seconds. (How it Works) (Web)
• PostgreSQL HTTP Client - Simple HTTP client inside your PostgreSQL. Easy to install. No compilation required.
• Supabase SQL - Curated list of SQL to help you find useful script easily. (Code)
• Supabase Schema - Secured & Simple Supabase Schema Visualizer. (Web)
• TimescaleDB Toolkit - Extension for more hyperfunctions, fully compatible with TimescaleDB and PostgreSQL.
• flaco - Fastest and most memory efficient way to pull data from PostgreSQL into pandas and numpy.
• PostgRPC - Query your Postgres databases directly using gRPC or transcoded JSON.
• Platter - Branching Postgres for the Cloud. Database platform optimized for your Git-based workflows.
• Exploring PL/pgSQL: Strings, arrays, recursion, and parsing JSON (2021) (HN)
• postgresql-to-sqlite - Easy to use solution to create sqlite database from postgresql dump.
• How Postgres Audit Tables Saved Us From Taking Down Production (2021) (HN)
• Building a recommendation engine inside Postgres with Python and Pandas (2020) (HN)
• postguard - Statically validate Postgres SQL queries in JS / TS code and derive schemas.
• Babelfish for PostgreSQL - SQL Server to Postgres translator. (Article) (HN)
• How partial, covering, and multicolumn indexes may slow down UPDATEs in PostgreSQL (2021)
• Useful queries to analyze PostgreSQL lock trees (a.k.a. lock queues) (2021)
• Zero-downtime Postgres schema migrations need this: lock_timeout and retries (2021)
• Encrypting Postgres Data at Rest in Kubernetes (2021) (HN)
• Postgres migrations - Stack Overflow-inspired PostgreSQL migration library with strict ordering and immutable migrations.
• Zero-downtime schema migrations in Postgres using views (2021)
• Zenith - Substitutes PostgreSQL storage layer and redistributes data across a cluster of nodes.
• The LZ4 introduced in PostgreSQL 14 provides faster compression (2021) (HN)
• Lesser Known PostgreSQL Features (2021) (Lobsters) (HN)
• pg_probackup - Backup and recovery manager for PostgreSQL. (Docs)
• pgquarrel - Program that compares PostgreSQL database schemas (DDL).
• Scaling Postgres Episodes - YouTube
• PostgreSQL Tutorials - YouTube
• Fun with PostGIS: Mandelbrot set, game of life, and more (2021)
• Cloudflare Workers + PostgreSQL Template
• Ephemeral Postgres Databases (HN)
• imcs - In-Memory Columnar Store extension for PostgreSQL.
• pgTAP - Unit Testing for PostgreSQL. (Code)
• Pagila - PostgreSQL Sample Database.
• Supabase Studio - Dashboard for managing your self-hosted Supabase project, and used on our hosted platform. (HN) (Article)
• Pg_GraphQL - GraphQL support for PostgreSQL. (Article)
• Realtime Postgres RLS Now Available on Supabase (2021) (HN)
• walrus - Write Ahead Log Realtime Unified Security (WALRUS).
• supabase-py - Python Client for Supabase.
• skitch - Create PostgreSQL SQL code quickly and in a streamlined, versioned workflow.
• pg2arrow - PostgreSQL Table to Apache Arrow file converter.
• Advent of Code 2021 with PostgreSQL (HN)
• Speeding up Postgres integration tests in Go (2021)️
• Foreign data wrappers - PostgreSQL wiki
• OrioleDB – Solution for PostgreSQL wicked problems (Web) (HN) (HN)
• Postgres is a great pub/sub and job server (2019) (HN)
• Everything I've seen on optimizing Postgres on ZFS (2021) (HN)
• pgModeler - PostgreSQL Database Modeler. (Web)
• pgxr - Write PostgreSQL extension functions using Rust.
• Fast Counting with PostgreSQL and Haskell (2021) (HN)
• Getting Started with QGIS, PostgreSQL and PostGIS (2021) (HN)
• Optimizing Postgres queries at scale (2021) (HN)
• PostgREST on Fargate – 500QPS for $20/mo (2021)
• Postgres Tuning Tips (2021) (HN)
• Examples for deploying applications with PGO, the Postgres Operator from Crunchy Data
• Multicorn - PostgreSQL 9.1+ extension meant to make Foreign Data Wrapper development easy, by allowing the programmer to use the Python programming language. (Web)
• pg_partman - Partition management extension for PostgreSQL.
• pg_bloat_check - Bloat check script for PostgreSQL.
• Zero-downtime schema migrations in Postgres using Reshape (2022) (HN)
• Who Contributed to PostgreSQL Development in 2020 and 2021? (HN)
• pgcopydb - Copy a Postgres database to a target Postgres server (pg_dump | pg_restore on steroids).
• Why I Enjoy PostgreSQL – Infrastructure Engineer's Perspective (2022) (HN)
• Tricking PostgreSQL into using an insane, but faster, query plan (2021) (HN)
• PostgreSQL query performance bottlenecks (2022) (HN)
• Postgres Indexes for Newbies (2022)
• Creating a Postgres Foreign Data Wrapper (2021) (HN)
• Reshape - Easy-to-use, zero-downtime schema migration tool for Postgres.
• PG-Strom - Extension for PostgreSQL database. Designed to accelerate mostly batch and analytics workloads with utilization of GPU and NVME-SSD.
• pgcapture - Scalable Netflix DBLog implementation for PostgreSQL.
• Procrastinate - PostgreSQL-based Task Queue for Python. (Docs) (HN)
• Tern - Standalone migration tool for PostgreSQL.
• The world of PostgreSQL wire compatibility (2022)
• PgCat - PgBouncer rewritten in Rust, with sharding, load balancing and failover support. (HN)
• How PostgreSQL stores rows (2022) (HN)
• postgres-meta - RESTful API for managing your Postgres. Fetch tables, add roles, and run queries (and more).
• plgo - Tool for easily creating PostgreSQL extensions with stored procedures and triggers in Go.
• pg_show_plans - Show query plans of all currently running SQL statements.
• Prestogres - PostgreSQL protocol gateway for Presto distributed SQL query engine.
• Realtime Client - Listens to changes in a PostgreSQL Database and via websockets.
• pgMustard - Review Postgres query plans quickly. (Lobsters)
• pg-online-schema-change - Zero downtime online schema changes in PostgreSQL.
• Queries in PostgreSQL: 1. Query execution stages
• Postgres Professional - Russian PostgreSQL company founded by Russian PostgreSQL contributors.
• pg_ulid - Universally Unique Lexicographically Sortable Identifier (ULID) for PostgreSQL.
• OnlineMigrations - Catch unsafe PostgreSQL migrations in development and run them easier in production.
• A psql hack for select * except some columns (2022) (Lobsters)
• PostgreSQL Notes
• pgrocks-fdw - PostgreSQL extension implements a Foreign Data Wrapper (FDW) for RocksDB.
• VidarDB - Fork of PostgreSQL for real-time machine learning. (Code) (GitHub)
• Optimizing Postgres text search with trigrams (2022) (HN)
• Hydra - Query Postgres, Route to any Database. (HN)
• Intro to Postgres Planner - Hacking Melanie Plageman (2022)
• PostgreSQL Schema Change Guide
• Paranoid SQL Execution on Postgres (2021) (HN)
• Tusker - PostgreSQL specific migration tool.
• Ways to improve Postgres (2022)
• pgMonitor - PostgreSQL Monitoring, Metrics Collection and Alerting Resources from Crunchy Data.
• Non blocking and zero downtime ALTER statements in PostgreSQL with pg-osc (2022) (HN) (HN)
• migrator - Postgres migration generator and runner that uses raw declarative SQL.
• libpg_query - C library for accessing the PostgreSQL parser outside of the server.
• How we optimized PostgreSQL queries 100x (2022) (Reddit)
• Postgres Auditing in 150 lines of SQL (2022) (HN)
• supa_audit - PostgreSQL extension is a generic solution for tracking changes to tables' data over time.
• Best place to host a Postgres database today that’s not one of the big 3 (2022)
• Hooks: The secret feature powering the Postgres ecosystem (2022)
• Wasmer Postgres - Postgres library to run WebAssembly binaries.
• pg_task - PostgreSQL job scheduler pg_task allows to execute any sql command at any specific time at background asynchronously.
• pg_curl - PostgreSQL curl allows most curl actions.
• AintQ - Python asyncio task queue on PostgreSQL.
• Postgres.js - Fastest Full-Featured PostgreSQL Client for Node and Deno. (HN) (Reddit)
• plProfiler - Extension for the PostgreSQL database system to create performance profiles of PL/pgSQL functions and stored procedures.
• PgBouncerHero - Dashboard for your PgBouncers.
• Supabase Cheat Sheet - Cheat Sheets for anyone starting with Supabase + PostgreSQL. (Code)
• pg_plan_guarantee - Postgres Query Optimizer Extension that guarantees your desired plan will not change. (HN)
• Index Adviser - Postgres extension that helps you find potentially useful indexes.
• Postgres 15 will support MERGE (Article)
• Understanding connection URI strings in PostgreSQL
• Supabase Enterprise (2022)
• Supabase Edge Functions (2022) (HN)
• Postgrator CLI - PostgreSQL, MySQL and MS SQL database schema migration tool using plain SQL and JS files.
• Postgres Container Apps (beta) (HN)
• pg_ivm - IVM (Incremnetal View Maintenance) implementation as a PostgreSQL extension.
• PostgreSQL Database Management System
• Postgres connection pooler - Alternative to PgBouncer.
• E-Maj - PostgreSQL extension that tracks updates on tables sets with rollback capabilities.
• pg_migrate - Perform schema changes in PostgreSQL with minimal locks.
• How Postgres Chooses Which Index To Use For A Query (2022) (HN)
• Postgres everywhere. SQLite is embedded everywhere. Will Postgres follow suit? (2022)
• icu_ext - PostgreSQL extension (in C) to expose functionality from the ICU library.
• pg-simplify-inflector - Simplifies the graphile-build-pg inflector to trim the ByFooIdAndBarId from relations.
• Multiranges in PostgreSQL 14 (2022) (HN)
• SupaDB - Connect and play with Supabase REST API / GraphQL easily. (Code)
• IaSQL - Manage cloud infrastructure as data in a hosted PostgreSQL database. (Web)
• SQL views for Dune Analytics
• Pgeon - Fast data retrieval from a PostgreSQL database into Apache Arrow format.
• How we upgraded our 4TB PostgreSQL database (2022) (HN)
• How to setup Postgres with Github Actions (2020)
• A Journey to Postgres Productivity with Go (2020) (Another version)
• pglast - PostgreSQL Languages AST and statements prettifier.
• pglogrepl - PostgreSQL logical replication library for Go.
• parquet_fdw - Parquet foreign data wrapper for PostgreSQL.
• Schemalint - Run linting rules on your database schema. Works with Postgres databases.
• pgoutput - Postgres logical replication in Go.
• Snaplet - Copies a production database, transforming personal information so that developers can safely code against actual data. (Twitter) (Docs) (Docs Code)
• Postgres JSON Schema - JSON Schema validation for PostgreSQL.
• pglookout - PostgreSQL replication monitoring and failover daemon.
• pgwatch2 - PostgreSQL metrics monitor/dashboard.
• Parquet and Postgres in the Data Lake (2022) (HN)
• PostgreSQL collation (2022)
• Creating JSON Extracts in Supabase (2022) - How to upload and extract JSON using Postgres trigger functions in Supabase.
• Auto-Updating Materialized View in PostgreSQL (2022)
• Tgres - Time Series in Go and PostgreSQL.
• Postgres-Extension.rs - Library to write Postgres extensions in Rust.
• Understand your systems like never before with traces and PostgreSQL (2022) (HN)
• CloudNativePG - Kubernetes operator that covers the full lifecycle of a PostgreSQL database cluster with a primary/standby architecture, using native streaming replication. (Web)
• Postgres AST Deparser for Postgres - Pure plpgsql AST toolkit and deparser for PostgreSQL.
• PL/pgSQL Language Server
• postgres-deno - PostgreSQL extension for Deno: run Typescript in PostgreSQL functions and triggers.
• Let's build a distributed Postgres proof of concept (2022) (Code)
• Storing JSONB in PostgreSQL tips
• Soft deletion with PostgreSQL: but with logic on the database! (2022)
• Speeding up sort performance in Postgres 15 (2022) (HN)
• Instant Heatmap with pg_featureserv (2022) (HN)
• PostgreSQL Anonymizer: Privacy by Design for Postgres (2022)
• Neon - Serverless open source alternative to AWS Aurora Postgres. (Web) (HN) (Why)
• Postgres Docker Container Migration Cheat Sheet (2022)
• Pigsty - Battery-Included Open-Source PostgreSQL Distribution.
• Restore PostgreSQL database running in Docker Container (2021)
• PG Exporter - Prometheus exporter for PostgreSQL metrics.
• pegsocket.js - WebSocket driver for PostgreSQL.
• pg_tail - Watches last lines of a PostgreSQL table like in a "tail -f".
• Useful PostgreSQL utilities
• pg_plugins - Gathering of template plugins for PostgreSQL: background workers, logical replication things, etc.
• PostgreSQL Fuzzy Text Search: Not so fuzzy to fuzziest (2022)
• PG to DBML - CLI tool to scan your postgres database, and output DBML.
• PostgreSQL hooks documentation
• Case-insensitive pattern matching in PostgreSQL (2022)
• Convergence - Set of tools for writing servers that speak PostgreSQL's wire protocol.
• pgq - Go library for using Postgres as a job queue.
• Search Replica - Uses postgres logical replication protocol to subscribe and receive any updates almost in real time.
• PostgreSQL-wheel - Python wheel for Linux containing a complete, self-contained, locally installable PostgreSQL database server.
• How to simplify working with PostgreSQL time-series data (2022)
• Using Edge Functions in Supabase: A complete guide (2022)
• How to Find and Stop Running Queries on PostgreSQL (2022) (HN)
• How we made data aggregation on PostgreSQL better and faster (2022) (HN)
• PostgreSQL Upgrades are hard (2022) (Lobsters) (HN)
• Custom SQL functions for data analytics in PostgreSQL (2022)
• Postgres Indexes, Selectivity, and Statistics (2022)
• Refurb - Library for building PostgreSQL database migration software.
• Citus data SIGMOD white paper notes (2022)
• Dashibase - No-code dashboards with Supabase. (Insert) (Insert Code) (Code) (Twitter)
• pgenv - PostgreSQL binary manager.
• Postico - Modern PostgreSQL Client for the Mac.
• pgs2 - Postgres extension for S2 spherical geometry.
• InfluxDB Line Protocol Listener for PostgreSQL
• Postgres Locking: When is it Concerning? (2022)
• Коллекция готовых SQL запросов для PostgreSQL
• Postgres 15 improves UNIQUE and NULL (2022) (HN)
• Postgres Full-Text Search: A Search Engine in a Database (2021) (HN)
• PostgreSQL 14 Internals Book (HN)
• Postgres Indexing: When Does BRIN Win? (2022) (HN)
• PQ - Simple transactional queue for PostgreSQL written in Python.
• PostgreSQL views and materialized views and how they influenced TimescaleDB (2022) (HN)
• Postgres and the curious case of the cursory cursors (2022)
• Implementing "seen by" functionality with Postgres (2022) (HN)
• pg_jsonschema - PostgreSQL extension providing JSON Schema validation. (HN)
• allas - LISTEN / NOTIFY connection pooler for PostgreSQL.
• pgx_json_schema - JSON Schema validation for Postgres.
• Shipping Multi-Tenant SaaS Using Postgres Row-Level Security (2022) (HN)
• vsql - Single-file or PostgreSQL-server compatible transactional SQL database written in pure V..
• Notes on GitLab Postgres Schema Design (2022)
• hasql - Library for high available PostgreSQL clusters.
• State of PostgreSQL 2022
• Speculare PGCDC - Allows you to listen to changes in your PostgreSQL database via logical replication and then broadcast those changes over websockets.
• Validating PostgreSQL results and inferring query static types (2022)
• Postgres Performance Monitoring: Best Practices and Tools to Use (2022)
• Improving Postgres text search speed (HN)
• Postgres Tutorials | Crunchy Data
• Learn Postgres at the Playground – Postgres compiled to WASM running in browser (HN) (Tweet)
• PostgreSQL 14 Internals book – Part II (HN)
• PostgreSQL 15: Stats Collector Gone? What’s New? (2022) (HN)
• plrust - Rust procedural language handler for PostgreSQL.
• PGTracer - Tracing tools for PostgreSQL, using eBPF.
• pg_idkit - Postgres extension for generating UUIDs.
• TiDB for PostgreSQL - PgSQL compatible on distributed database TiDB.
• pg_netstat - PostgreSQL extension to monitor database network traffic. (HN)
• Supabase Examples - Supabase examples to help you get started.
• Hydra - Open source Snowflake alternative. (Code) (How we built it) (HN)
• Postgres Data Flow (2022)
• Postgres database functions are your next favorite feature (2022)
• Fun With Postgres Functions (2022)
• plpgsql_check - Linter tool (does source code static analyze) for the PostgreSQL language plpgsql.
• Postgres WASM - PostgresQL server running in your browser.
• Barman - Backup and Recovery Manager for PostgreSQL. (Web)
• Ivory - Makes it easy for you to create a PostgreSQL database instance from a Go program.
• PG Scripts - Analysis and optimization SQL queries. Some PL/pgSQL scripts.
• Postgres WASM by Snaplet and Supabase (2022) (HN)
• Coroot-pg-agent - Prometheus exporter for Postgres focusing on query performance statistics.
• RapidRows - Low-code, configurable API server for PostgreSQL databases. (Docs)
• Pg_squeeze: An extension to fix table bloat (HN)
• Awesome Supabase
• pg_eventserv - Small Go server to push PgSQL listen/notify events into websockets.
• Routing PostgreSQL queries between read-write & read-only instances (Lobsters)
• Partitioning in Postgres, 2022 edition (HN)
• PostgreSQL 15 (HN)
• Postgres Full Text Search vs. the Rest (2022) (HN)
• Postgres 15 Merge Command with Examples (2022) (HN)
• PostgresML is 8-40x faster than Python HTTP microservices (2022) (HN)
• pgsentinel - PostgreSQL extension providing Active session history.
• Postgres: Safely renaming a table with no downtime using updatable views (2022)
• PGroonga - Fast full text search platform for all languages.
• Push-based outbox pattern with Postgres logical replication (2022) (HN)
• Building full-text-search over multiple tables in Postgres (2022)
• Forcing Sequential Scans on PostgreSQL Using Large Integers (2022)
• Data Loading in Postgres for Newbies (2022)
• Postgres Databases and Schemas (2022)
• pisk - PostgreSQL Sessions in Vim. (HN)
• Things I learned at PGConf.EU 2022
• Postgres Insider Terminology (2022) (HN)
• Opening Old Wounds - Why Uber Engineering Switched from Postgres to MySQL (2020)
• Scaling PostgresML to 1 Million Requests per Second (2022) (HN)
• pg - Alternative CLI tool for PostgreSQL.
• Decile - Simple, open-source analytics tool for any Postgres database. (Code)
• Reducing replication lag with IO concurrency in Postgres 15 (2022)
• pg_hexedit - Open PostgreSQL relation files in a hex editor with tags and annotations.
• PostgreSQL ERROR: permission denied for schema public (2022)
• Gonymizer - Tool to Anonymize Sensitive PostgreSQL Data Tables for Use in QA and Testing.
• semver - Semantic version data type for PostgreSQL.
• How We Built Fly Postgres · Fly (2022) (HN)
• Postgres Tips and Tricks (HN)
• Faceting large result sets in PostgreSQL (2022) (HN)
• Time travel in Postgres. Bisect to the last valid transaction (2022) (HN)
• Edge-compatible Serverless Driver for Postgres (2022) (HN)
• pg_hint_plan - Give PostgreSQL ability to manually force some decisions in execution plans.
• How I used Supabase and n8n for my background tasks (2022)
• Understanding PostgreSQL Query Plans (aka EXPLAIN) (2022)
• Just Use Postgres for Everything (HN)
• Supabase Storage v2: Image resizing and Smart CDN (2022)
• Supabase Storage Middleware - S3 compatible object storage service that stores metadata in Postgres.
• pg-pubsub - Reliable PostgreSQL LISTEN/NOTIFY with inter-process lock support.
• Supabase Wrappers - Postgres Foreign Data Wrapper development framework in Rust. (Article) (HN)
• IvorySQL - Open-source Oracle-compatible PostgreSQL. (HN)
• Supabase Vault is now in Beta (2022) (HN)
• Queries to measure statistical bloat in indexes and tables for PostgreSQL