Skip to content

[2679] Add hourly model support to the NetCDF parser - #2709

Open
Matteo-Salis wants to merge 12 commits into
ecmwf:developfrom
Matteo-Salis:msalis/dev/hourly-nc-parser
Open

[2679] Add hourly model support to the NetCDF parser#2709
Matteo-Salis wants to merge 12 commits into
ecmwf:developfrom
Matteo-Salis:msalis/dev/hourly-nc-parser

Conversation

@Matteo-Salis

@Matteo-Salis Matteo-Salis commented Jul 31, 2026

Copy link
Copy Markdown

Description

We add support for hourly models to the NetCDF parser (netcdf_parser.py). We have been inspired by the quaver_parser.py that already supports hourly models.

The exporter functionality and command remain the same: uv run export --run-id <INFERENCE_ID> --stream ERA5 --output-dir ../output_nc --format netcdf --regrid-degree 1 --regrid-type regular_ll

For hourly models, the argument --fstep-hours (by default 6) must be set to 1

The code has been developed and tested on Santis using the inference muly9d4v of the hourly model af90zz71, and the inference h8ymb6sh of the 6h model atmofs03.

Issue Number

This fixes #2679

Checklist before asking for review

  • I have performed a self-review of my code
  • My changes comply with basic sanity checks:
    • I have fixed formatting issues with ./scripts/actions.sh lint
    • I have run unit tests with ./scripts/actions.sh unit-test
    • I have documented my code and I have updated the docstrings.
    • I have added unit tests, if relevant
  • I have tried my changes with data and code:
    • I have run the integration tests with ./scripts/actions.sh integration-test
    • (bigger changes) I have run a full training and I have written in the comment the run_id(s): launch-slurm.py --time 60
    • (bigger changes and experiments) I have shared a hegdedoc in the github issue with all the configurations and runs for this experiments
  • I have informed and aligned with people impacted by my change:
    • for config changes: the MatterMost channels and/or a design doc
    • for changes of dependencies: the MatterMost software development channel

@github-actions github-actions Bot added bug Something isn't working eval anything related to the model evaluation pipeline labels Jul 31, 2026
@clessig

clessig commented Aug 1, 2026

Copy link
Copy Markdown
Collaborator

@Matteo-Salis : thank you for the contribution.

@enssow : could you have a look at this?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

bug Something isn't working eval anything related to the model evaluation pipeline

Projects

Status: No status

Development

Successfully merging this pull request may close these issues.

Exporter: Inconsistent Grid points between forecast steps

2 participants