Page tree

This is an online zoom workshop on Wednesday, 28 Aug 2024. In this workshop we are aiming to help existing climate and weather researchers to get hands-on experience of various SOTA (State-of-the-Art) deep learning models in Weather and Climate Studies. The aim of this workshop is to let you try some of our examples and then start training your own climate/weather deep learning models for your own research. 

In order to participate in the practise session in the second half of the workshop please check the prerequisites well in advance of the workshop. 

Note: If you are not an existing NCI user, then you will need to create an account as per the instructions below.

Here is the registration link [https://events.humanitix.com/introduction-of-deep-learning-development-in-weather-and-climate-studies]

Prerequisites

  1. a NCI account ( create an account ) with valid password 
  2. Membership of the following projects:
    1. vp91 (join) [the training project which we will use for this workshop's compute and storage]
    2. dk92 (join) [for environment modules and some examples]
    3. wb00 (join) [for NCI-WeatherBench and ClimateNet datasets]
    4. rt52 (join) [for ERA5 datasets]
    5. ob53 (join) [for BARRA2 datasets]


Click to Register 

1:00-1:05

Dr. Ben Evans

Opening

1:05-1:20

Dr. Yue Sun

A gentle Introduction to the Interactive Workflow of Developing Deep Learning Models 

Presentation Slides 

1:20 - 2:10

Dr. Edison Guo

Dr. Maruf Ahmed

Dr. Rui Yang

Dr. Yue Sun

Describing Deep Learning Models for Climate and Weather Studies

  • Forecasting Models: (DLWP-CS, ClimaX) on NCI-WeatherBench, (Pangu-Weather, GraphCast) on ERA5,
  • NCI-FourCastNeXt: train modified FourCastNet at NCI 
  • Downscaling Models: CorrDiff on BARRA2,
  • Physical Law Incorporation: SFNO on ERA5, ClimODE on NCI-WeatherBench
  • Segmentation Models: CGNet on ClimateNet

Presentation Slides

2:10 - 2:20

Dr. Rui Yang

Overview: Facilitating AI/ML Processes with NCI

  • Datasets: ERA5, WeatherBench, BARRA2 and more
  • Environments: Modules compatible with (ARE VDI/JupyterLab, PBS Jobs) x Examples
  • Models and Training/Inference examples that are tested on Gadi and ready to use

Presentation Slides

2:20 - 2:30

Tea Break

2:30 - 3:30

Dr. Edison Guo

Dr. Maruf Ahmed

Dr. Rui Yang

Dr. Yue Sun


Self-Directed Examples using ARE JupyterLab

[Recommend to focus on a notebook showing in the first four bullet points during the training]


3:30 - 4:00

Dr. Ben Evans

Discussions

  • Feedback on the examples. Suggestions to further improvements.
  • What more support do you need?
  • What models/algorithms are you interested in / working on?


Breakout Room Exercise Example Direct Links

InstructorsExamplesNotebooksARE Job Instruction
Maruf Ahmed

DLWP-CS on NCI-WeatherBench

https://github.com/nci/NCI-DLWP-CS.gitsearch "Queue" on the page NCI-DLWP-CS Notebooks

Inference Notebooks:

  • Pangu-Weather
  • GraphCast
  • FourCastNet
  • FourCastNet v2
https://github.com/nci/NCI-AI-Models.gitseearch "Queue" on the page ECMWF's inference AI-Model notebooks 
Edison GuoCorrDiff on BARRA2 inference/g/data/dk92/notebooks/examples-aiml/corrdiff/inference/CorrDiff_inference.ipynbsearch "Queue" on the page NCI-CorrDiff
Rui YangCGNet on ClimateNet/g/data/dk92/apps/climatenet/24.02/notebooks/ClimateNet/train_eva_pred.ipynbsearch "Queue" on the page Evaluation of CGNet Model Using the ClimateNet Dataset
Yue Sun

SFNO on derived ERA5

  • /g/data/dk92/notebooks/examples-aiml/sfno/shallow_water_model.ipynb
  • /g/data/dk92/notebooks/examples-aiml/sfno/res_invar.shallow_water_model.ipynb
  • /g/data/dk92/notebooks/examples-aiml/sfno/weather_era5.ipynb
search "Queue" on the page Spherical Fourier Neural Operators

ClimODE on NCI-WeatherBench

/g/data/dk92/notebooks/examples-aiml/climODE/climODE_global.ipynbsearch "Queue" on the page ClimODE
  • No labels