Commit 1dc7cc1
authored
Add add_tables and filter_tables wal2json plugin options (#791)
Allows passing wal2json's add-tables and filter-tables options via
pgstream config (YAML and env vars). These filter at the source-side
decode level, preventing wal2json from generating JSON for excluded
tables — dramatically reducing CPU and network overhead.
Config:
source.postgres.replication.plugin.add_tables: "public.*"
source.postgres.replication.plugin.filter_tables: "pipelines.*,private.*"
Env vars:
PGSTREAM_POSTGRES_REPLICATION_PLUGIN_ADD_TABLES
PGSTREAM_POSTGRES_REPLICATION_PLUGIN_FILTER_TABLES1 parent 59a723d commit 1dc7cc1
3 files changed
Lines changed: 17 additions & 3 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
213 | 213 | | |
214 | 214 | | |
215 | 215 | | |
216 | | - | |
| 216 | + | |
| 217 | + | |
| 218 | + | |
217 | 219 | | |
218 | 220 | | |
219 | 221 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
116 | 116 | | |
117 | 117 | | |
118 | 118 | | |
119 | | - | |
| 119 | + | |
| 120 | + | |
| 121 | + | |
120 | 122 | | |
121 | 123 | | |
122 | 124 | | |
| |||
429 | 431 | | |
430 | 432 | | |
431 | 433 | | |
| 434 | + | |
| 435 | + | |
432 | 436 | | |
433 | 437 | | |
434 | 438 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
47 | 47 | | |
48 | 48 | | |
49 | 49 | | |
50 | | - | |
| 50 | + | |
| 51 | + | |
| 52 | + | |
51 | 53 | | |
52 | 54 | | |
53 | 55 | | |
| |||
110 | 112 | | |
111 | 113 | | |
112 | 114 | | |
| 115 | + | |
| 116 | + | |
| 117 | + | |
| 118 | + | |
| 119 | + | |
| 120 | + | |
113 | 121 | | |
114 | 122 | | |
115 | 123 | | |
| |||
0 commit comments