Page tree

Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Contributed By 

Contributors

Gadi is Australia’s most powerful supercomputer, a highly parallel cluster comprising more than 150,000 processor cores on ten different types of compute nodes. Gadi accommodates a wide range of tasks, from running climate models to genome sequencing, from designing molecules to astrophysical modelling. To start using Gadi, you should read this page which covers most of the basics you need to know before submitting your first job. 

...

Resource Name


Owner

Accessible from 

Size Limit

Allocation Valid Until

Resource Specific Comments

Compute Hoursprojectn.a.amount set by scheme managerend of quarter
storage

$HOME

user

PBS jobs / login nodes

10 GiB  with no possible extension 

user account deactivation

  • with backups in $HOME/.snapshot

/scratch/$PROJECT

project

PBS jobs† / login nodes

72 GiB by default, more on jobs' demand

project retirement/job demand changes
  • designed for jobs with large data IO
  • no backups
  • data expires in 90 days since creation [tbc when details available]
  • number-of-files limit applied

/g/data/$PROJECT

project

PBS jobs† / login nodes

amount set by scheme manager

project retirement 

  • designed for hosting persistent data
  • no backups
  • number-of-files limit applied
  • also accessible from other NCI services, like cloud

mdssprojectPBS copyq jobs† / login nodesamount set by scheme managerproject retirement tape-based archival data sto
  • two copies created in two different buildings
  • tape-based archival data storage

$PBS_JOBFSuserPBS jobs * disk space available on the job's hosting node(s)job termination
  • no backups
  • designed for jobs with frequent and small IO
software applications

NCI

PBS jobs / login nodes

n.a.

n.a.

  • built from source on Gadi when possible
  • more can be added on request ‡
license

software group owner

PBS jobs / login nodes

available seats on the licensing server

license expiry date

  • access controlled by software group membership ††
  • NCI owned licenses are for academic use only
  • projects, institutions and universities can bring in their own licenses 

...

This shows the total, used, reserved, and available compute grant of the project in the current billing period at the time of the query. SU is short for Service Unit, the unit that measures Gadi compute hours. Jobs run on the Gadi normal queue are charged 2 SUs to run for an hour on a single core with a memory allocation of up to 4 GiB. Jobs on Gadi are charged for the proportion of a node’s total memory that is used: see more examples of job cost here. In addition, different Gadi queues have different charge rates: see the breakdown of charge rates here.

The Grant amount listed is always equal to the sum of Used, Reserved and Avail. Every time a project has a job submitted, its potential cost, calculated according to the requested walltime, is reserved from the total Grant and reduces the amount of Avail. The actual cost based on walltime usage is determined only after the job's completion. If it finishes within the requested walltime limit, the over-reserved allocation is returned to the Avail amount and the actual cost goes to Used amount. When the project has no jobs that are waiting to run or running, Reserved SU returns to zero.

...

The first column in the output shows the permissions set for the folder/file. For more information on unix file permissions, see this page.

To look up how much storage you have access to through which projects, run the command ‘lquota’ on the login node. It prints out the storage allocation info together with its live usage data. For example, the return message 

...