Page tree

Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Code Block
languagebash
#!/bin/csh
#PBS -q normal
#PBS -l walltime=00:10:00
#PBS -l ncpus=96
#PBS -l mem=380Gb
#PBS -l jobfs=400GB
#PBS -l storage=gdata/ab01+scratch/ab01
#PBS -l software=ansys<license_<institution>string>
#PBS -l wd

module load ansys/2021r1
module load ansys_licence/<institution>
fluent 3ddp -g -mpi=hpcx -t $PBS_NCPUS -i test.jou >& outputfile

Note that the submission script uses the PBS directive`-l software`, to ask the job scheduler for the reservation of ansys licence seats from license ansys_<institution> where the placeholder <institution> needs to be replaced by your own institution<license_string> , see details in the section License requirements below. To change the number of processors, memory, or jobfs required, and/or project folders to mount, simply modify the appropriate PBS resource requests at the top of this file.

The maximum number of CPU cores a fluent job can use is limited by the license availability. For example, NCI owns an academic ANSYS license file which has 128 seats for the hpc feature and it supports jobs request up to 128 CPU cores. If you submit many 128-core fluent jobs, they are expected to run one at a time.

Once the job submission script is saved to the same directory in which the journal file test.jou is located, run 

Code Block
qsub ansysjob.sh 

inside that directory to submit your job to the PBS scheduler.

Restart Jobs

If you need to run Fluent for a very long period of time which exceeds the default walltime limit set for the job, see the walltime limit for different queues and number of CPU cores requested for the jobon the Queue Limits page, we suggest to add checkpoints to the long job, save restart files and use the last one as input to the next job. 

...

Users from the following institutions have access to their own institution licenses and should join the corresponding software group. To join the corresponding software group in the table below, login to my.nci.org.au first, search for the group by the software group name, and use the tab `Join` on its project page to submit the membership request. It may take up to 1 business day for the lead CI to respond. Once your group membership request is approved, the corresponding licence module becomes visible to use. Run `module avail ansys` to list all ansys related modulefiles. Jobs need to load the license module together with the application module to run fluent.

License Ownerlicense modulePBS Directive `-lsoftware=`software group
Royal Melbourne Institute of Technologyansys_licence/rmitansys_rmit ansys_rmit
The University of Wollongongansys_licence/wollongongansys_wollongongansys_wollongong
The University of New South Walesansys_licence/unswunsw_ansysunsw_ansys
The University of Sydneyansys_licence/usydansys_usydansys_usyd


NCI owns an ANSYS license file which provides 25 CFD feature seats and 128 HPC feature seats. Users do not who have no access to the above licenses are welcome to join the software group ansys_nci to enable the access to modulefile ansys_licence/nci and the checkouts from licence ansys_nci.

...