Skip to content

Commit f88c9b5

Browse files
Copilotf-thiele
Copilot
and
f-thiele
authored
Delete deprecated get_azure_share_sas action (#79)
* Initial plan * Delete deprecated get_azure_share_sas action and update README Agent-Logs-Url: https://github.com/SneaksAndData/github-actions/sessions/fe7b3796-b6ba-4b4e-bd41-277d66413f94 Co-authored-by: f-thiele <16508158+f-thiele@users.noreply.github.com> * Delete deploy_poetry_project_to_azfs, deploy_dbt_project_to_azfs, deploy_data_schemas_to_azfs, run_azcopy actions and update README Agent-Logs-Url: https://github.com/SneaksAndData/github-actions/sessions/b64c8cf1-5f0f-4f9c-80ce-ce197745dff8 Co-authored-by: f-thiele <16508158+f-thiele@users.noreply.github.com> --------- Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com> Co-authored-by: f-thiele <16508158+f-thiele@users.noreply.github.com>
1 parent 6c8187f commit f88c9b5

11 files changed

Lines changed: 7 additions & 627 deletions

File tree

‎README.md‎

Lines changed: 7 additions & 253 deletions
Original file line numberDiff line numberDiff line change
@@ -10,16 +10,11 @@ Available actions are:
1010
5. [generate_version](#generate_version)
1111
6. [install_azcopy](#install_azcopy)
1212
7. [login_to_aks](#login_to_aks)
13-
8. [deploy_poetry_project_to_azfs](#deploy_poetry_project_to_azfs)
14-
9. [deploy_dbt_project_to_azfs](#deploy_dbt_project_to_azfs)
15-
10. [deploy_data_schemas_to_azfs](#deploy_data_schemas_to_azfs)
16-
11. [run_azcopy](#run_azcopy)
17-
12. [get_azure_share_sas](#get_azure_share_sas)
18-
13. [setup_gh_app](#setup_gh_app)
19-
14. [update_airflow_variables](#update_airflow_variables)
20-
15. [contribute_changes](#contribute_changes)
21-
16. [activate_workflow](#activate_workflow)
22-
16. [setup_aws_ca](#setup_aws_ca)
13+
8. [setup_gh_app](#setup_gh_app)
14+
9. [update_airflow_variables](#update_airflow_variables)
15+
10. [contribute_changes](#contribute_changes)
16+
11. [activate_workflow](#activate_workflow)
17+
12. [setup_aws_ca](#setup_aws_ca)
2318

2419
## semver_release
2520

@@ -240,10 +235,8 @@ Generates project version based on current git commit and git tags.
240235
1) To use this action, your repository should contain
241236
[version tags](https://docs.github.com/en/repositories/releasing-projects-on-github/about-releases).
242237
This action relies on git tags to be present in order to generate a version.
243-
2) Generated version is will not be compatible with [PEP-440](https://peps.python.org/pep-0440/), so this versions
244-
should not be used with python packages. Although, this action can be used with
245-
[source code deployments](#deploy_poetry_project_to_azfs) of python applications.
246-
238+
2) Generated version will not be compatible with [PEP-440](https://peps.python.org/pep-0440/), so these versions
239+
should not be used with python packages.
247240

248241
### Inputs
249242
No inputs defined
@@ -339,245 +332,6 @@ jobs:
339332
cluster_name: $AZURE_AKS_NAME
340333
```
341334

342-
# deploy_poetry_project_to_azfs
343-
Copy python site-packages of current virtual environment and installs application into it.
344-
345-
### Inputs
346-
| Name | Description | Optional | Default value |
347-
|-------------------|:-----------------------------------------------------------------|----------|---------------|
348-
| project_version | Version of the project | False | |
349-
| project_name | Name of the project | False | |
350-
| project_directory | Directory name inside the project (if differs from project name) | True | "" |
351-
| destination | Directory or SAS for upload | False | |
352-
| python_version | Project python version | True | 3.9 |
353-
| deployment_root | Root directory in the file share | False | |
354-
355-
**NOTES**:
356-
1) To use this action, your project should use poetry for virtual environment management. Ensure that you installed
357-
the latest version of poetry and project dependencies (for instance, by [install_poetry](#install_poetry) action).
358-
359-
### Outputs
360-
No outputs defined
361-
362-
### Usage
363-
```yaml
364-
name: Prepare python deployment
365-
366-
on:
367-
workflow_dispatch:
368-
369-
jobs:
370-
prepare_deployment:
371-
name: Prepare python code for deployment
372-
runs-on: ubuntu-latest
373-
steps:
374-
- uses: actions/checkout@v2
375-
with:
376-
fetch-depth: 0
377-
- name: Get project version
378-
uses: SneaksAndData/github-actions/generate_version@v0.0.17
379-
id: version
380-
- name: Generate SAS for upload
381-
uses: SneaksAndData/github-actions/get_azure_share_sas@v0.0.17
382-
with:
383-
directory_name: share-name/path/within/share
384-
account_key: ${{ secrets.ACCOUNT_KEY }}
385-
account_name: ${{ secrets.ACCOUNT_NAME }}
386-
id: sas
387-
- name: Prepare site-packages for deployment
388-
uses: SneaksAndData/github-actions/deploy_poetry_project_to_azfs@v0.0.17
389-
with:
390-
deployment_root: /python
391-
project_version: ${{ steps.version.outputs.version }}
392-
destination: ${{ steps.sas.outputs.authorized_destination }}
393-
project_name: python_project
394-
```
395-
396-
# deploy_dbt_project_to_azfs
397-
Prepare DBT models for deployment to an Azure file share.
398-
399-
### Inputs
400-
| Name | Description | Optional | Default value |
401-
|------------------|:----------------------------------------------|----------|---------------|
402-
| project_version | Version of the project | False | |
403-
| project_name | Name of the project | False | |
404-
| destination | Directory or SAS for upload | False | |
405-
| deployment_root | Root directory in the file share | False | |
406-
407-
### Outputs
408-
No outputs defined
409-
410-
### Usage
411-
```yaml
412-
name: Prepare deployment
413-
414-
on:
415-
workflow_dispatch:
416-
417-
jobs:
418-
prepare_deployment:
419-
name: Prepare dbt output for deployment
420-
runs-on: ubuntu-latest
421-
steps:
422-
- uses: actions/checkout@v2
423-
with:
424-
fetch-depth: 0
425-
- name: Get project version
426-
uses: SneaksAndData/github-actions/generate_version@v0.0.17
427-
id: version
428-
- name: Generate SAS for upload
429-
uses: SneaksAndData/github-actions/get_azure_share_sas@v0.0.17
430-
with:
431-
directory_name: share-name/path/within/share
432-
account_key: ${{ secrets.ACCOUNT_KEY }}
433-
account_name: ${{ secrets.ACCOUNT_NAME }}
434-
id: sas
435-
- name: Prepare dbt for deployment
436-
uses: SneaksAndData/github-actions/deploy_dbt_project_to_azfs@v0.0.17
437-
with:
438-
deployment_root: /dbt
439-
project_version: ${{ steps.version.outputs.version }}
440-
destination: ${{ steps.sas.outputs.authorized_destination }}
441-
project_name: dbt_project
442-
```
443-
444-
# deploy_data_schemas_to_azfs
445-
Prepare DBT schemas for deployment to an Azure file share.
446-
447-
### Inputs
448-
| Name | Description | Optional | Default value |
449-
|------------------|:----------------------------------------------|----------|---------------|
450-
| project_version | Version of the project | False | |
451-
| project_name | Name of the project | False | |
452-
| destination | Directory or SAS for upload | False | |
453-
| deployment_root | Root directory in the file share | False | |
454-
455-
### Outputs
456-
No outputs defined
457-
458-
### Usage
459-
```yaml
460-
name: Prepare deployment
461-
462-
on:
463-
workflow_dispatch:
464-
jobs:
465-
validate_commit:
466-
name: Prepare schemas output for deployment
467-
runs-on: ubuntu-latest
468-
steps:
469-
- uses: actions/checkout@v2
470-
with:
471-
fetch-depth: 0
472-
- name: Get project version
473-
uses: SneaksAndData/github-actions/generate_version@v0.0.17
474-
id: version
475-
- name: Generate SAS for upload
476-
uses: SneaksAndData/github-actions/get_azure_share_sas@v0.0.17
477-
with:
478-
directory_name: share-name/path/within/share
479-
account_key: ${{ secrets.ACCOUNT_KEY }}
480-
account_name: ${{ secrets.ACCOUNT_NAME }}
481-
id: sas
482-
- name: Prepare dbt for deployment
483-
uses: SneaksAndData/github-actions/deploy_data_schemas_to_azfs@v0.0.17
484-
with:
485-
deployment_root: /dbt
486-
project_version: ${{ steps.version.outputs.version }}
487-
destination: ${{ steps.sas.outputs.authorized_destination }}
488-
project_name: dbt_project
489-
```
490-
491-
# run_azcopy
492-
Invoke [azcopy copy](https://learn.microsoft.com/en-us/azure/storage/common/storage-ref-azcopy-copy?toc=%2Fazure%2Fstorage%2Fblobs%2Ftoc.json)
493-
command in pipeline.
494-
495-
### Inputs
496-
| Name | Description | Optional | Default value |
497-
|--------------------|:-----------------------------------------------|----------|---------------|
498-
| source | Source directory or SAS url to copy | False | |
499-
| target | Target directory or SAS url | False | |
500-
| mode | azcopy action mode (copy or sync) | True | copy |
501-
| put_md5 | If `true` sets `--put-md5` parameter to azcopy | True | True |
502-
| delete_destination | azcopy --delete-destination flag | True | False |
503-
504-
### Outputs
505-
No outputs defined
506-
507-
### Usage
508-
```yaml
509-
name: Copy files
510-
511-
on:
512-
workflow_dispatch:
513-
514-
jobs:
515-
copy_files:
516-
name: Copy files
517-
steps:
518-
- name: Generate SAS for upload
519-
uses: SneaksAndData/github-actions/get_azure_share_sas@v0.0.17
520-
with:
521-
directory_name: share-name/path/within/share
522-
account_key: ${{ secrets.ACCOUNT_KEY }}
523-
account_name: ${{ secrets.ACCOUNT_NAME }}
524-
id: sas
525-
- name: Copy data
526-
uses: SneaksAndData/github-actions/run_azcopy@v0.0.17
527-
with:
528-
source: source/directory/on/build/agent
529-
target: ${{ steps.sas.outputs.authorized_destination }}
530-
```
531-
## get_azure_share_sas
532-
533-
### Description
534-
Generates new temporary
535-
[Shared Access Signature](https://learn.microsoft.com/en-us/azure/storage/common/storage-sas-overview)
536-
for a file share, attached to a storage account.
537-
538-
### Inputs
539-
| Name | Description | Optional | Default Value |
540-
|-----------------|:-----------------------------------------------------------------|----------|---------------|
541-
| directory_name | Path within file share | False | |
542-
| account_key | Name of the storage account of the share | False | |
543-
| account_name | Key of the storage account of the share | False | |
544-
| expiration_date | Expiration date in format that can be used by the `date` command | True | +10 minutes |
545-
| directory_type | Type of directory (blob or fileshare) | True | fileshare |
546-
547-
548-
**NOTES**:
549-
1) For the expiration date format see [man 1 date](https://man7.org/linux/man-pages/man1/date.1.html)
550-
551-
### Outputs
552-
| Name | Description |
553-
|------------------------|-------------------------------------------------------------|
554-
| authorized_destination | URL of the file share with attached shared access signature |
555-
556-
### Usage
557-
```yaml
558-
name: Release a new version
559-
560-
on:
561-
workflow_dispatch:
562-
563-
jobs:
564-
create_release:
565-
runs-on: ubuntu-latest
566-
steps:
567-
- name: Generate SAS for upload
568-
uses: SneaksAndData/github-actions/get_azure_share_sas@v0.0.17
569-
with:
570-
directory_name: share-name/path/within/share
571-
account_key: ${{ secrets.ACCOUNT_KEY }}
572-
account_name: ${{ secrets.ACCOUNT_NAME }}
573-
id: sas
574-
- name: Copy data
575-
uses: SneaksAndData/github-actions/run_azcopy@v0.0.17
576-
with:
577-
source_directory: source/directory/on/build/agent
578-
target: ${{ steps.sas.outputs.authorized_destination }}
579-
```
580-
581335
## setup_gh_app
582336

583337
### Description

‎deploy_data_schemas_to_azfs/action.yaml‎

Lines changed: 0 additions & 35 deletions
This file was deleted.

‎deploy_data_schemas_to_azfs/deploy_data_schemas_to_azfs.sh‎

Lines changed: 0 additions & 23 deletions
This file was deleted.

‎deploy_dbt_project_to_azfs/action.yaml‎

Lines changed: 0 additions & 35 deletions
This file was deleted.

0 commit comments

Comments
 (0)