Commit 5b5fb3f
Gereon Elvers
Add OSFDownloadMixin
Mirrors OhanaDownloadMixin (ensure_file, prefetch_files, manifest, retries)
for datasets hosted on the Open Science Framework. Public OSF projects
need no auth; OSF_TOKEN env var supported for private projects.
Multi-component projects (OSF storage caps at ~50 GB per node) are
supported via OSF_PROJECT_FALLBACKS — the manifest aggregates files
across all configured nodes with the primary winning on duplicates.
Used by the upcoming MEG-MASC dataset, which spans four sibling nodes
(ag3kj, h2tzn, u5327, dr4wy).1 parent dfaf6e6 commit 5b5fb3f
2 files changed
Lines changed: 501 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
13 | 13 | | |
14 | 14 | | |
15 | 15 | | |
| 16 | + | |
16 | 17 | | |
17 | 18 | | |
18 | 19 | | |
| |||
21 | 22 | | |
22 | 23 | | |
23 | 24 | | |
| 25 | + | |
24 | 26 | | |
25 | 27 | | |
26 | 28 | | |
| |||
0 commit comments