Intro to Distributed AI/ML Techniques
NCI AI/ML environments
- NCI-ai-ml environment
- Running Horovod
- Running Ray and associated Libraries
- JupyterLab Sessions for Deep Learning Jobs
AI/ML Frameworks
AI/ML associated tools
- DALI: NVIDIA Data Loading Library Example Notebook
- Gpustat - Multinode GPU monitoring
- Tensorboard: web-based ML visualisation tool