Sync up unique cache paths for Singularity images with cwltool#433
Sync up unique cache paths for Singularity images with cwltool#433adamnovak wants to merge 2 commits into
Conversation
Codecov Report❌ Patch coverage is
Additional details and impacted files@@ Coverage Diff @@
## main #433 +/- ##
==========================================
+ Coverage 37.77% 37.79% +0.01%
==========================================
Files 50 51 +1
Lines 36760 36777 +17
Branches 9531 9533 +2
==========================================
+ Hits 13886 13899 +13
- Misses 19941 19943 +2
- Partials 2933 2935 +2 ☔ View full report in Codecov by Harness. 🚀 New features to boost your workflow:
|
|
I can't figure out how to run just the tests I wrote here and lint just for one Python, so I can run the tests locally in a reasonable amount of time. |
|
Looks like it's |
| CHARS_TO_REPLACE = ["/", ":"] | ||
| NEW_CHAR = "_" | ||
| CHARS_TO_REPLACE = ["_", "/"] | ||
| NEW_STRINGS = ["___", "_s_"] |
There was a problem hiding this comment.
Hey @adamnovak ! Thank you for this and the linked PR. I worry that this will cause existing stored images to be ignored. Any idea on how we can diverge less from the previously naming scheme?
There was a problem hiding this comment.
One problem that's being solved here is name collisions: it's possible with the previous naming scheme to have two distinct images (mostly pairs like a/b_c and a_b/c) share a cache key.
The obvious way to re-use existing cached images would be to look and see if the files already exist under the old scheme. Maybe that's OK even if there were possible collisions, since we won't create any new collisions and if people have images cached they must have been working.
There was a problem hiding this comment.
The obvious way to re-use existing cached images would be to look and see if the files already exist under the old scheme.
yes, please and thank you
This and common-workflow-language/cwltool#2284 should make
cwltoolandcwl-docker-extractagree on what filenames to use for SIF images, even when the image names are unusual.They should agree for everything they both support, which is Docker-format specifiers with and without tags.
cwl-docker-extractdoesn't support Singularity-isms like direct SIF file references ordocker://URIs even when run in Singularity mode.