Commit c27ec8f
Add Yezzey submodule to gpcontrib (#1752)
Yezzey is an open-source extension for Apache Cloudberry and
Greenplum 6 that transparently offloads Append-Only (AO/AOCO)
table data to S3-compatible object storage. Inspired by Snowflake
and AnyBlob, it extends the storage manager (smgr) so reads and
writes go to S3 instead of local disk, keeping the user interface
unchanged. A companion YProxy service acts as an I/O scheduler,
managing connection pooling and request prioritization to prevent
S3 throttling. Data is PGP-encrypted during upload. Benchmarks
show only 10–43% query slowdown versus local storage, far
outperforming PXF, making it ideal for cost-effective cold-data
tiering.
The main feature of Yezzey - you don't need to change tables or code;
just launch yezzey_define_offload_policy and move the data to S3.
In this way, you can unload your cluster using the available disk space.
Currently, it is widely used on Greenplum 6 instances, and the goal is
to provide users with the same interface in Cloudberry, so they can
seamlessly migrate to Cloudberry.
We placed Yezzey as a submodule, as we believe one day we will replace
all outdated solutions like AO/AOCO/Yezzey with PAX. However, that has
not happened yet and we still need Yezzey.
Co-authored-by: reshke <reshkekirill@gmail.com>1 parent b310a13 commit c27ec8f
11 files changed
Lines changed: 1121 additions & 13 deletions
File tree
- .github/workflows
- devops/build/automation/cloudberry/scripts
- gpcontrib
- licenses
- src
Large diffs are not rendered by default.
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
15 | 15 | | |
16 | 16 | | |
17 | 17 | | |
| 18 | + | |
| 19 | + | |
| 20 | + | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
338 | 338 | | |
339 | 339 | | |
340 | 340 | | |
| 341 | + | |
| 342 | + | |
| 343 | + | |
| 344 | + | |
| 345 | + | |
| 346 | + | |
341 | 347 | | |
342 | 348 | | |
343 | 349 | | |
| |||
0 commit comments