Skip to content

Harmonise metadata creation#140

Merged
anton-seaice merged 9 commits into
mainfrom
139
Jul 3, 2026
Merged

Harmonise metadata creation#140
anton-seaice merged 9 commits into
mainfrom
139

Conversation

@anton-seaice

@anton-seaice anton-seaice commented Jun 29, 2026

Copy link
Copy Markdown
Contributor

Closes #139
This change updates get_provenance_metadata to generate runcmd automatically, and to include information on input files.

get_provenance_metadata now returns a dictionary

Spot checked some metadata:

drof.streams.xml:
<history>Created by as2285 (anton-seaice) on 2026-06-30, using https://github.com/ACCESS-NRI/om3-scripts/blob/07bb1ec4762068a6d522f9b44a393452e7aafa57/generate_xml_drof_jra55.py: /g/data/xp65/public/apps/med_conda_scripts/analysis3-26.05.d/bin/python3 generate_xml_drof_jra55.py 1900 1900</history>

mesh:

history = "Created by as2285 (anton-seaice) on 2026-06-30, using https://github.com/ACCESS-NRI/om3-scripts/blob/07bb1ec4762068a6d522f9b44a393452e7aafa57/generate_rof_weights.py: /g/data/xp65/public/apps/med_conda_scripts/analysis3-26.05.d/bin/python3 generate_rof_weights.py --mesh_filename=/g/data/tm70/ek4684/make_OM3_025deg_topo_26_11_25/access-om3-100km-ESMFmesh.nc --nx=360 --ny=324 --weights_filename=test_weights.nc"

@anton-seaice anton-seaice changed the title Use sys.argv for metadata Harmonise metadata creation Jun 29, 2026
@anton-seaice anton-seaice marked this pull request as ready for review June 30, 2026 00:07
@anton-seaice anton-seaice self-assigned this Jun 30, 2026
@anton-seaice

Copy link
Copy Markdown
Contributor Author

Ready to go @dougiesquire

@dougiesquire dougiesquire left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @anton-seaice. Some scripts are broken, see below. I'd definitely feel more comfortable if we'd verified all scripts work and don't lose any provenance info.

Comment thread wombat_ic_generation/co2_iaf.py
Comment thread regrid_common.py
Comment thread external_tidal_generation/generate_bottom_roughness_intermediate_woa.py Outdated
Comment thread rof_pattern_generation/generate_rofi_pattern.py Outdated
Comment thread surface_restoring_generation/make_sfc_restore_from_regridded_woa.py Outdated
Comment thread scripts_common.py Outdated

@anton-seaice anton-seaice left a comment

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Don't look yet, will finish tomorrow

Comment thread grid_generation/generate_vertical_grid.py
Comment thread data_stream_xml_generation/generate_xml_datm_era5.py
Comment thread data_stream_xml_generation/generate_xml_datm_jra55.py
Comment thread data_stream_xml_generation/generate_xml_drof_jra55.py
Comment thread make_ryf/make_ryf.py
Comment thread payu_config/postscript/build_intake_ds.py
Comment thread payu_config/postscript/concat_ice_daily.py

@anton-seaice anton-seaice left a comment

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Still don't look yet

Comment thread external_tidal_generation/generate_bottom_roughness_regrid.py
Comment thread external_tidal_generation/generate_tide_amplitude.py
Comment thread mesh_generation/generate_mesh.py
Comment thread surface_restoring_generation/make_sfc_restore_from_regridded_woa.py

@anton-seaice anton-seaice left a comment

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I ran all the commonly generated input files

Comment thread mesh_generation/generate_rof_weights.py
Comment thread rof_pattern_generation/generate_rofi_pattern.py
Comment thread wombat_ic_generation/co2_iaf.py
Comment thread wombat_ic_generation/SFe_climatology.py
Comment thread chlorophyll/chl_climatology_and_fill.py
Comment thread wombat_ic_generation/generate_wombat_ic.py
@anton-seaice anton-seaice requested a review from dougiesquire July 1, 2026 05:26

@dougiesquire dougiesquire left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @anton-seaice - looks good

@dougiesquire dougiesquire left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actually wait

Comment thread external_tidal_generation/generate_bottom_roughness_intermediate_woa.py Outdated
@anton-seaice anton-seaice requested a review from dougiesquire July 2, 2026 23:03
@anton-seaice

Copy link
Copy Markdown
Contributor Author

Try again @dougiesquire

Comment thread external_tidal_generation/pbs_bottom_roughness.pbs Outdated
@anton-seaice anton-seaice requested a review from dougiesquire July 3, 2026 02:26

@dougiesquire dougiesquire left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @anton-seaice

@anton-seaice anton-seaice merged commit 9e9b5f8 into main Jul 3, 2026
4 checks passed
@anton-seaice anton-seaice deleted the 139 branch July 3, 2026 05:07
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Automate runcmd

2 participants