Improve ENSO driver file discovery across realms#1378
Conversation
This updates the ENSO driver to make model input discovery more robust for workflows that mix atmosphere and ocean variables, while preserving the existing successful lookup path as the first choice. Detailed changes: - Add filename token parsing that supports both "." and "_" separators. - Pass the inferred realm when discovering models with modnames="all". - Use a wildcard realization for file discovery when realization is "all" or "*". - Avoid leaving runs_list undefined when wildcard run parsing fails. - Normalize table-style realms to path-style realms, e.g. Amon -> atmos and Omon -> ocean. - Add fallback model-file lookup for realm/table mismatches: Amon <-> Omon and atmos <-> ocean. - Keep the original rendered model path as the first lookup, and only try fallback paths when the original path is missing. - Allow ocean variables such as zos/tos to be found when a template is hard-coded with Amon/atmos. - Resolve multi-component variables using the concrete loop run instead of the original realization string. - Reuse the same model-file fallback logic for multi-component variables. This helps ENSO_proc metrics that require ssh/zos run when the input exists under an ocean table/path, without changing the downstream metric or derive computation behavior.
|
@lee1043 Hi Jiwoo, this commit includes changes intended to address one of the issues pointed out by @yyplanton in #95:
In my local Demo 6 test, I saw the following message: This indicates that the metric was skipped because no model data were found for First, in CMIP-style files, sea surface height is often stored as So there is a vulnerability in the workflow: when Second, there appears to be an issue on the PCMDI The code change in this commit is intended to address the second issue on the PCMDI |
This updates the ENSO driver to make model input discovery more robust for workflows that mix atmosphere and ocean variables, while preserving the existing successful lookup path as the first choice.
Detailed changes:
This helps ENSO_proc metrics that require ssh/zos run when the input exists under an ocean table/path, without changing the downstream metric or derive computation behavior.