Skip to content

Commit 5925085

Browse files
authored
chore(pipelines): Remove pipeline script uv lock files (#322)
### Summary At this point the lock files are causing more harm than good. When not regularly updated they contain dependencies out of sync with the elt-common package. Take s3fs, for example, the script lock files contained a an old 2025 version of s3fs that worked. However, when developers tried to install elt-common locally and run the same pipeline script through python and not uv the lockfile is not used and a broken version of s3fs was used as it crept into pyproject.toml. When running the pipeline scripts now it will automatically use the dependency patterns from elt-common and our current [rest catalog tests](https://github.com/ISISNeutronMuon/analytics-data-platform/blob/e67979ed5f20001ca37beffffda7c9dd79d68ae7/.github/workflows/rest-catalog-tests.yml) will then ensure a development setup is not broken. <!-- This is an auto-generated comment: release notes by coderabbit.ai --> ## Summary by CodeRabbit * **Chores** * Updated dependency version constraints for improved compatibility. --- **Note:** No user-facing changes in this release. <!-- end of auto-generated comment: release notes by coderabbit.ai -->
1 parent e67979e commit 5925085

7 files changed

Lines changed: 8 additions & 7436 deletions

File tree

elt-common/pyproject.toml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -12,7 +12,7 @@ dependencies = [
1212
"dlt[parquet,s3]>=1.26.0,<2",
1313
"pyarrow==23.0.1", # See https://github.com/ISISNeutronMuon/analytics-data-platform/issues/183
1414
"pyiceberg[pyiceberg-core]>=0.11.1",
15-
"s3fs<2026.3.0", # See https://github.com/ISISNeutronMuon/analytics-data-platform/issues/237
15+
"s3fs<2026.2.0", # See https://github.com/ISISNeutronMuon/analytics-data-platform/issues/237
1616
]
1717

1818

elt-common/uv.lock

Lines changed: 7 additions & 7 deletions
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

0 commit comments

Comments
 (0)