Page tree

OOD Service Deprecation

The OOD environment is being replaced by ARE (Australian Research Environment). Please migrate your workload to ARE. For more information, see the ARE User Guide.

Under OOD, the JupyterLab App allows you to start a dedicated JupyterLab instance.

Starting a Session

  1. Login to OOD: https://ood.nci.org.au/
  2. Click the JupyterLab icon on the Dashboard (home page)


     
  3. Choose:
    1. the number of hours you want your session to run for (maximum)
    2. the size of the compute resources you have access to (maximum).  If you attempt to exceed the CPU limit your processes will be throttled to the amount requested.  If you exceed the memory your Jupyter Kernel may be terminated.  Note: this is the resources used within the notebook; if you offload the processing to Gadi (e.g. using Dask) then you may not need a very large JupyterLab session
    3. if you want to receive an email once your session has started.  This is useful when the JupyterLab cluster is very busy and your session is queued waiting for a free slot
  4. Optionally use the advanced options to specify an alternative JupyterLab installation or other module files that your notebooks use


     
  5. Choose:
    1. Module directories: a space-separated list of additional directories to search for modulefile definitions
    2. Modules: a space-separated list of modules to be loaded
    3. Python or Conda virtual environment base: specify the top-level directory of a custom virtual env, or the base directory of a conda environment.
    4. Conda environment: specify the name of a conda environment to activate. You must supply a conda base directory in order for this to work.
  6. Click Launch button
  7. Initially it will show the status as Queued until your session begins to start. Once it is finished it will change to Running and look like the figure below


     
  8. Click the Open JupyterLab button
  9. This will open a new tab in your web browser that shows the JupyterLab session. NOTE: it can take a minute or two for the JupyterLab Client to start
  10. If you close the window the session will remain running.  To end the session you can either Shutdown (last item in File menu) or delete the job on the Interactive Sessions page of OOD


Note for Dask usage: You can use the JupyterLab session resources as above to set up a local Dask cluster within a Jupyter notebook. The total memory size scales with 1.75GB/CPU core. If you need a larger scale Dask cluster, please select Small or Medium sized Compute Size to start up the JupyterLab session and then set up another Dask cluster crossing multiple nodes within a Jupyter notebook. 

Loading Linux Environment modules

To load in specific modules you already need to know where these are located on the system by either discovery under a VDI session, or someone has shared with you.

1. Loading from /apps

Click "Advanced options" and type in "<module name>" in "Modules" box and leave "Module directories" box empty. You can specify multiple modules by including a space between each.

For example you can load modules python3/3.7.4 and python-shapely/1.7.0-py3.7 as below:


2. Loading modules from other locations

Click "advanced options" and 

1. type in "<your module directory>" in "Module directories" box.

2. type in "<module name>" in "Modules" box

For example, we can load the "NCI-data-analysis/2021.03" module from "/g/data/dk92/apps" as below:


  • No labels