Skip to content

Commit 08f91e2

Browse files
author
Thierry RAMORASOAVINA
committed
Support for Azure storage
- Among all the Azure storages, Khiops supports only (via its specific driver) "Files" and "Blobs" (Binary Large Objects) - The only supported authentication method is currently the `AZURE_STORAGE_CONNECTION_STRING` embedding the account name and account key
1 parent 17439c1 commit 08f91e2

File tree

5 files changed

+501
-35
lines changed

5 files changed

+501
-35
lines changed

.github/workflows/tests.yml

Lines changed: 11 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -138,21 +138,32 @@ jobs:
138138
echo "Generated AWS configuration..."
139139
cat ${GITHUB_WORKSPACE}/.aws/configuration
140140
/scripts/run_fake_remote_file_servers.sh . # launch the servers in the background
141+
141142
# Set environment variables for the tests with GCS
142143
GCS_BUCKET_NAME=data-test-khiops-driver-gcs/khiops_data
143144
GCS_DRIVER_LOGLEVEL=info # set to debug for diagnosis
145+
144146
# Set environment variables for the tests with S3
145147
S3_DRIVER_LOGLEVEL=info # set to debug for diagnosis
146148
S3_BUCKET_NAME=s3-bucket
147149
AWS_SHARED_CREDENTIALS_FILE=${{ github.workspace }}/.aws/credentials
148150
AWS_CONFIG_FILE=${{ github.workspace }}/.aws/configuration
151+
152+
# Set environment variables for the tests with Azure
153+
AZURE_STORAGE_CONNECTION_STRING='${{ secrets.AZURE_CONNECTION_STRING }}'
154+
CLOUD_BLOB_URI_PREFIX=${{ vars.CLOUD_BLOB_URI_PREFIX }}
155+
CLOUD_FILE_URI_PREFIX=${{ vars.CLOUD_FILE_URI_PREFIX }}
156+
149157
# Persist environment variables for subsequent steps
150158
echo "GCS_BUCKET_NAME=${GCS_BUCKET_NAME}" >> "$GITHUB_ENV"
151159
echo "GCS_DRIVER_LOGLEVEL=${GCS_DRIVER_LOGLEVEL}" >> "$GITHUB_ENV"
152160
echo "S3_DRIVER_LOGLEVEL=${S3_DRIVER_LOGLEVEL}" >> "$GITHUB_ENV"
153161
echo "S3_BUCKET_NAME=${S3_BUCKET_NAME}" >> "$GITHUB_ENV"
154162
echo "AWS_SHARED_CREDENTIALS_FILE=${AWS_SHARED_CREDENTIALS_FILE}" >> "$GITHUB_ENV"
155163
echo "AWS_CONFIG_FILE=${AWS_CONFIG_FILE}" >> "$GITHUB_ENV"
164+
echo "AZURE_STORAGE_CONNECTION_STRING=${AZURE_STORAGE_CONNECTION_STRING}" >> "$GITHUB_ENV"
165+
echo "CLOUD_BLOB_URI_PREFIX=${CLOUD_BLOB_URI_PREFIX}" >> "$GITHUB_ENV"
166+
echo "CLOUD_FILE_URI_PREFIX=${CLOUD_FILE_URI_PREFIX}" >> "$GITHUB_ENV"
156167
- name: Authenticate to GCP using "Workload Identity Federation"
157168
if: env.SKIP_EXPENSIVE_TESTS != 'true'
158169
# For integration tests on GCS we use a real Google account

CHANGELOG.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -10,6 +10,7 @@
1010

1111
### Added
1212
- (`sklearn`) `keep_selected_variables_only` parameter to the predictors (`KhiopsClassifier` and `KhiopsRegressor`)
13+
- (General) Support for Azure storage
1314

1415
### Changed
1516
- (`core`) Rename `variable_part_dimensions` to `inner_variable_dimensions` in Coclustering results.

0 commit comments

Comments
 (0)