Skip to content

Feature/8642 anfog realtime nonqc#303

Draft
LeoLee-Xiaohu wants to merge 11 commits into
mainfrom
feature/8642-ANFOG-realtime-nonqc
Draft

Feature/8642 anfog realtime nonqc#303
LeoLee-Xiaohu wants to merge 11 commits into
mainfrom
feature/8642-ANFOG-realtime-nonqc

Conversation

@LeoLee-Xiaohu

Copy link
Copy Markdown

This pull request address the issue of https://github.com/aodn/backlog/issues/8642#issuecomment-4931645689. It standardizes and updates the naming of the delayed quality-controlled ocean glider dataset from "slocum_glider_delayed_qc" to "ocean_glider_delayed_qc" throughout the codebase and documentation. It also introduces a new example notebook for accessing glider realtime non-quality-controlled data. The main changes are grouped below:

Dataset and Notebook Renaming:

  • Renamed the dataset configuration file from slocum_glider_delayed_qc.json to ocean_glider_delayed_qc.json, updating all internal references such as dataset_name, logger_name, S3 paths, and tutorial links to use the new name. [1] [2] [3]
  • Renamed the example notebook and all references from slocum_glider_delayed_qc.ipynb to ocean_glider_delayed_qc.ipynb, including dataset variables, metadata, and output file names. [1] [2] [3] [4] [5] [6] [7] [8]
  • Updated the main data access notebook (GetAodnData.ipynb) to use the new dataset name in all code and output examples. [1] [2] [3]
  • Updated the notebooks/README.md to reference the new notebook name and added the new realtime glider notebook to the list. [1] [2]

Dataset Coverage and Access:

  • Added the ANFOG seaglider S3 URI to the dataset sources in ocean_glider_delayed_qc.json, expanding the dataset's coverage.

New Example Notebook:

  • Added a new notebook, glider_realtime_nonqc.ipynb, which demonstrates how to access and query the glider realtime non-quality-controlled Parquet dataset, including partitioning, spatial/temporal queries, and data export.

LeoLee-Xiaohu added 11 commits July 10, 2026 15:33
- Updated pyproject.toml to include new entry for glider_realtime_nonqc.
- Created glider_realtime_nonqc.py to handle dataset processing.
- Added glider_realtime_nonqc.json configuration file with dataset metadata and settings.
- Introduced Jupyter notebook glider_realtime_nonqc.ipynb for accessing and visualizing the dataset.
…glider delayed QC dataset and contain data from both slocum and seagliders.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant