NCI Replica Collection
Known exceptions to the ERA5 parameter shortnames replicated from the Copernicus Climate Data Store (CDS) or used in the NCI directory structure can be found here: ERA5 Parameter Shortname Exceptions.
Issues relating to the ERA5 data replication service at NCI will be tracked in the table below:
| Date | Affected Data | Issue | Action | Status | ||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| All files under /g/data/rt52/era5/pressure-levels/reanalysis/pv/ | Title: Precision issue of pressure-level data Description: A short datatype with scale and offset provided by the upstream repository isn't sufficient to represent the small numbers seen at higher levels in the PV variable. Affected files: All files under All files under /g/data/rt52/era5/pressure-levels/reanalysis/pv/ | The affected files will be replaced by the files with higher precision. |
| ||||||||||||||||||||
| Lists of affected files:
| Title: incorrect variable data Description: The files under /g/data/rt52/era5-1/pressure-levels/reanalysis/c*wc/ have incorrect humidity data instead of cloud water content. Affected files: 336 files as listed in 20220711_era5-1_incorrect_variable.txt | The affected files will be replaced by the files with correct variable data. |
| ||||||||||||||||||||
| Lists of affected files:
| Title: Incorrect time order Description: Some files under the directory /g/data/uc16/era5/potential-temperature/oper have incorrect time order. Affected files: 668 files as listed in pt-oper-incorrect-time-order.txt Description: Some files under the directory /g/data/uc16/era5/potential-vorticity/oper have incorrect time order. Note that datasets under this directory haven't been officially released yet. Affected files: 921 files as listed in pv-oper-incorrect-time-order.txt | The affected files will be replaced by the files with correct time order. |
| ||||||||||||||||||||
| Full list of affected files:
| Title: Bad chunking files Affected files: 354 Description: Some files under the directory /g/data/rt52/era5/single-levels/reanalysis have time chunks larger than 200. | The affected files will be replaced by rechunked files. |
| ||||||||||||||||||||
| /g/data/rt52/era5/single-levels/reanalysis/sst/2020/sst_era5_oper_sfc_20201101-20201130.nc | Title: Corrupted data Affected files: 1 Description: ERA5 Single-Level, oper, sst, 20201101-20201131 file was corrupted. | The corrupted file was removed and re-downloaded. |
| ||||||||||||||||||||
| /g/data/rt52/era5/pressure-levels/reanalysis/t/1983/t_era5_oper_pl_19830401-19830430.nc /g/data/rt52/era5/pressure-levels/reanalysis/t/1984/t_era5_oper_pl_19840701-19840731.nc /g/data/rt52/era5/pressure-levels/reanalysis/t/1986/t_era5_oper_pl_19860501-19860531.nc /g/data/rt52/era5/pressure-levels/reanalysis/t/1996/t_era5_oper_pl_19960101-19960131.nc For the full list of the additional suspected files, please see: era5_retraction_20210419.txt | Title: Corrupted data Description: Corrupted data content was discovered in at least 4 of the new replacement files re-downloaded after the recent ERA5 Climate Data Store (CDS) Data Corruption issue. Affected files: 4 confirmed (up to 197 suspected) | NCI will report the issue upstream to the CDS support team and the 4 known files will be immediately removed and re-downloaded. All the remaining affected files from this recent retraction (193) will also be re-downloaded and updated in place as a precaution. Please monitor this page for the current status of the re-download. |
All files from the original 19-Arp-2021 corrupted data retraction have been re-downloaded. | ||||||||||||||||||||
| Full list of affected files: era5_retraction_20210419.txt | Title: Corrupted data Affected files: 197 Description: Corrupted data was discovered within the following ERA5 hourly data on single levels and ERA5 hourly data on pressure levels datasets. Further detail can be found on the ECMWF ERA5 Documentation page. | Files have been updated. |
| ||||||||||||||||||||
| /g/data/rt52/era5-1/pressure-levels/reanalysis/t/2006/t_era5-1_oper_pl_20061201-20061231.nc | Title: Incomplete download Affected files: 1 Description: ERA5.1 Pressure-Levels, oper, temperature, 2006-12-01 file was missing data points for all days except 1st day of month. | File has been updated to include data points for all days of month. |
| ||||||||||||||||||||
| WFDE5 (all products) | All products missing data at +-180 deg longitude locations as provided in upstream collection | N/a | Cannot be fixed | ||||||||||||||||||||
| CEMS (all oroducts) | Longitude values are on a different range (0 to 359.75) compared to rest of collection (-180 to 179.75) as provided in upstream collection | N/a | Cannot be fixed | ||||||||||||||||||||
| /g/data/rt52/era5/single-levels/reanalysis/mlssr/1989/mlssr_era5_oper_sfc_19890501-19890531.nc /g/data/rt52/era5/single-levels/reanalysis/msdrswrf/1989/msdrswrf_era5_oper_sfc_19890501-19890531.nc | Missing data due to failed replication from source; corrupt data upstream. | Bug-report submitted |
Missing files now replicated. |
Reporting Issues
If you notice an issue within the NCI replica collection, please email help@nci.org.au (Subject: ERA5 data collection). NCI will check if it is a local issue or can assist with reporting the issue upstream to ECMWF. Details of any issues affecting local usage will be added to the table above.