Skip to content

Commit ecf10ac

Browse files
author
王平10304955
committed
Add SFTP support to gpfdist for data loading
gpfdist, Cloudberry's parallel file distribution program, traditionally required data files to be co-located with the gpfdist process. This limitation made it cumbersome to load data from remote servers, often requiring an extra data transfer step. This commit extends gpfdist to support the SFTP protocol, enabling users to ingest data directly from remote servers. This enhancement streamlines ETL workflows by allowing `CREATE EXTERNAL TABLE` to specify SFTP locations. Key change include: Fix the compilation errors related to the libssh2 library option in the configure file.
1 parent 080908d commit ecf10ac

1 file changed

Lines changed: 2 additions & 0 deletions

File tree

src/include/fstream/gfile.h

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -72,10 +72,12 @@ typedef struct gfile_t
7272
#endif
7373
} fd;
7474

75+
#ifdef LIBSSH2
7576
LIBSSH2_SESSION *session;
7677
LIBSSH2_SFTP *sftp_session;
7778
LIBSSH2_SFTP_HANDLE *sftp_handle;
7879
int sock;
80+
#endif
7981

8082
union
8183
{

0 commit comments

Comments
 (0)