Skip to content

Migrate to use Pooch for data ingestion and update example data source#1955

Merged
VeckoTheGecko merged 11 commits intov4-devfrom
pooch
Apr 3, 2025
Merged

Migrate to use Pooch for data ingestion and update example data source#1955
VeckoTheGecko merged 11 commits intov4-devfrom
pooch

Conversation

@VeckoTheGecko
Copy link
Copy Markdown
Contributor

Changes:

@VeckoTheGecko VeckoTheGecko changed the title Migrate to use Pooch for data ingestion and update example data source to parcels-data repo Migrate to use Pooch for data ingestion and update example data source Apr 3, 2025
Comment on lines +18 to +29
# Keys are the dataset names. Values are the filenames in the dataset folder. Note that
# you can specify subfolders in the dataset folder putting slashes in the filename list.
# e.g.,
# "my_dataset": ["file0.nc", "folder1/file1.nc", "folder2/file2.nc"]
# my_dataset/
# ├── file0.nc
# ├── folder1/
# │ └── file1.nc
# └── folder2/
# └── file2.nc
#
# See instructions at https://github.com/OceanParcels/parcels-data for adding new datasets
Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@fluidnumerics-joe are these instructions clear? Do you think you can add your datasets now?

@VeckoTheGecko
Copy link
Copy Markdown
Contributor Author

More info about pooch:

Projects using Pooch

SciPy, scikit-image, xarray, Ensaio, GemPy, MetPy, napari, Satpy, yt, PyVista, icepack, histolab, seaborn-image, Open AR-Sandbox, climlab, mne-python, GemGIS, SHTOOLS, MOABB, GeoViews, ScopeSim, Brainrender, pyxem, cellfinder, PVGeo, geosnap, BioCypher, cf-xarray, Scirpy, rembg, DASCore, scikit-mobility, Py-ART, HyperSpy, RosettaSciIO, eXSpy, SPLASH xclim CLISOPS

  • It's a thin package with few dependencies ("platformdirs >= 2.5.0", "packaging >= 20.0", "requests >= 2.19.0")

Comment thread parcels/tools/exampledata_utils.py Outdated
Comment thread parcels/tools/exampledata_utils.py
Comment thread parcels/tools/exampledata_utils.py
Comment thread .binder/environment.yml
Comment thread tests/tools/test_exampledata_utils.py
@VeckoTheGecko VeckoTheGecko enabled auto-merge (squash) April 3, 2025 14:29
@VeckoTheGecko VeckoTheGecko disabled auto-merge April 3, 2025 14:32
@VeckoTheGecko VeckoTheGecko enabled auto-merge (squash) April 3, 2025 14:39
@VeckoTheGecko VeckoTheGecko merged commit ecddc78 into v4-dev Apr 3, 2025
16 checks passed
@VeckoTheGecko VeckoTheGecko deleted the pooch branch April 3, 2025 15:08
@github-project-automation github-project-automation Bot moved this from Backlog to Done in Parcels development Apr 3, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

Status: Done

Development

Successfully merging this pull request may close these issues.

2 participants