Feature request: logical replication

[n3ziniuka5]

It would be great if we could use Skunk for native Postgres CDC. it could have a great advantage over embedded debezium, because it still uses polling so isn't great for latency-sensitive applications.

[mpilquist]

@n3ziniuka5 Thanks for the suggestion! I'm not familiar with Postgres CDC. Do you have an idea what would be involved in adding support to Skunk?

[n3ziniuka5]

Skunk already supports streaming, e.g. NOTIFY/LISTEN channels, and I think users could create publications and replication slots themselves, so you would only need to understand Postgres logical decoding. I say "only", but that's probably a big amount of work.

[simonpetty]

For what it's worth, we ended up using the Postgres JDBC driver for this, and wrapped the polling loop in an FS2 Stream. YMMV ofc. So the challenge here would be understanding the underlying protocol to implement it in the Skunk (purely functional) way.