Dear Intersect users,
Welcome to Raijin! This document provides important information which will help you to get up and running on Raijin. We ask that you take the time to read it, and the links to supporting information, carefully and in full. NCI and Intersect are committed to making your transition to Raijin as smooth as possible.
NCI Conditions of Use
All users should review the NCI Conditions of Use.
All NCI users are automatically subscribed to a private, internal mailing list, which is used to send announcement, advisory and service alert messages and newsletters to our user community. Users are expected to remain subscribed to this list, so that they receive timely status updates and news from NCI. NCI uses this mailing list for essential notification purposes only and maintains strict confidentiality of all user information.
Sharing of NCI account information or passwords is a serious security concern and is strictly forbidden. User accounts and projects may be deactivated without notice if account details are shared. Also note that the Research Office of your home institution may need to certify your project for compliance with the Defence Trade Controls Act (Commonwealth, 2012) and Autonomous Sanctions Act (Commonwealth, 2011). Questions regarding the NCI Conditions of Use can be submitted to firstname.lastname@example.org.
Mancini - NCI User and Project Registration
“Mancini” - https://my.nci.org.au - is NCI’s self-service user and project registration system. You can use Mancini to:
- reset your NCI password;
- propose a project under an NCI partner scheme, such as Intersect;
- submit a request to join a project;
- submit a request to join a software group, which provides access to some software packages with licensing conditions;
- approve a request to join a project (Lead CI only); or,
- remove a user from a project (Lead CI only).
As a first step, all users should log in to Mancini and update their user profiles. Note that a current mobile phone number is required for account verification purposes.
There is no change to help and support arrangements. Please continue to make requests using the normal process; that is, simply email email@example.com or visit http://help.intersect.org.au. The hpc.Time team will escalate to NCI User Support should this be required.
NCI User Support - firstname.lastname@example.org
NCI operates an expert support desk service during normal business hours, 8:30am-5:30pm Monday-Friday. Users can lodge a support request by sending email to email@example.com, or via the online support portal at https://help.nci.org.au (login required). Support requests received outside of normal working hours are addressed as soon as possible on the next business day. All support requests are tracked in the NCI user support help ticket system.
User support is managed by the NCI User Services team, which operates the support desk service, and a consulting service for users on questions of code efficiency and optimisation, algorithms, and computational workflows. Members of the user support team are Ph.D.-qualified computational scientists, and can provide advice on algorithms and workflows in their areas of specialisation.
Raijin User Guides and Documentation
NCI’s user documentation is available online at https://opus.nci.org.au. Useful links for new users are:
A convenient listing of commonly used links to user documentation is provided on the NCI public web site - http://nci.org.au/user-support/getting-help/help-resources/
Scheduled Quarterly Maintenance - 4 April 2017
The next NCI quarterly maintenance downtime is scheduled for 8:00am-6:00pm (AEST) Tuesday 4 April 2017. Raijin, the Lustre file systems and associated services will not be available to users during the maintenance period. Please note that the Q2 maintenance downtime is not on the first business day of the quarter, per the usual schedule, due to an external dependency on electrical power supply repair work by the ANU and its electrical provider.
UPDATE: 2017 Q2 scheduled maintenance was completed at 11:00 pm AEST Tuesday 4 April.
The first business day of every quarter is reserved as a scheduled downtime for maintenance of all NCI systems. NCI systems and services are typically offline and not available to users during scheduled quarterly maintenance periods, although there are exceptions to this depending on the nature of scheduled maintenance work. NCI communicates plans for quarterly maintenance downtimes to all users through advisory emails, event notices on the NCI public web site, and social media updates (Twitter, Facebook) on a progressive schedule before each scheduled downtime. Job queues on Raijin are set to drain from 48 hours before each scheduled downtime. Jobs which could run into or could start during the downtime are held, and then released following completion of maintenance activities. Jobs held for maintenance will have increased scheduling priority when operational services resume.
Q2 allocations for your projects have been provided by Intersect support. NCI User Services has installed these Q2 allocations on Raijin.
Your project is eligible to receive resource allocations from the Intersect-NCI partner scheme. Resource allocation requests for Intersect projects should be submitted by email to Intersect support at firstname.lastname@example.org. Intersect support will approve your allocation request and forward details to NCI for installation on Raijin.
Note that it is possible for a project to receive allocations from multiple partners, for example, Intersect and the National Computation Merit Allocation Scheme. If your project is eligible to receive allocations from other partners the Lead CI has the option to request allocations from these partner schemes. NCI User Services can provide advice to Lead CIs on project resourcing through other partner schemes.
Orange User Home and Project Data
Intersect and NCI have finalised arrangements to make data from your Orange user home directories and project directories available on Raijin. These data are available through two procedures.
User home directories — self-service copy: User home data from Orange are available through a temporary read-only data distribution area on Raijin, which is accessible via project jv33. Users will be provided with instructions for copying home directory data from the jv33 read-only archive. As part of this process, users from active Intersect projects have been automatically granted membership in NCI project jv33 - Intersect/Orange user Home Read-only Archive - which is configured as an archive for data migration purposes. Note that project jv33 project cannot be used for computational work on Raijin.
The quota for user home directories on Raijin is 2 GB. NCI encourages you to clean up unneeded files and to copy only essential files from the Orange read-only archive to your Raijin home directory.
Important - NCI strongly recommends that you do not modify your Raijin .bashrc or other dot files file until you are familiar with the Raijin operating environment. Please exercise extreme caution if you copy any account customisations or dot files from Orange into your Raijin home directory. Copying your Orange .bashrc file directly into your Raijin home directory may render your account unusable. Also note that any symbolic links used on Orange will not be valid on Raijin. If you have any questions about configuring your Raijin environment please submit a support request to email@example.com.
Project directories — copy on request from Lead CI: Project data from Orange will be copied on request from a private read-only archive to a subdirectory in the project’s /short directory on Raijin:
The Lead CI, as the principal authority for a project, must initiate the migration process by submitting an email request for the project data to firstname.lastname@example.org. Use the following subject line for the email request:
Subject: Orange Project Data Migration Request <projectcode>.
The /short quotas for all active Intersect projects have been adjusted to accommodate additional data from the Orange read-only projects archive. (Please note that the project data archive is not stored under NCI project jv33, which is for user home data only.)
This migration procedure allows NCI and Intersect to:
- confirm that project data from Orange are needed on Raijin, per the Lead CI’s request;
- record a proper request and approval for the migration of project data;
- maintain data integrity and security for all projects;
- give each Lead CI familiarity with the Mancini system and NCI administrative procedures; and,
- minimise administrative overheads during the transition to Raijin.
Further details regarding Orange user home and project data can be found on this page - Orange User Home and Project Data.
Workflows on Raijin
NCI User Services has begun consultations with individual project teams transitioning from Orange to help them develop effective and efficient workflows on Raijin. User Services will give highest priority to consulting with projects which have little or no prior experience on Raijin. Orange users transitioning to Raijin will notice the following differences:
- Login nodes are accessible via round-robin mechanism at raijin.nci.org.au, e.g. ssh <userid>@raijin.nci.org.au.
- Login nodes are not to be used for computational work. User processes on login nodes are subject to a time limit of 30 minutes. Note that this limit is applied to user processes and does not apply to the duration of the user’s login session.
- Compute nodes are dedicated to compute and high-speed interconnect functionality, and provide no additional services.
- Data mover nodes are provided to facilitate data transfers. (Note that data mover nodes cannot be used for computational work.)
- Different versions and packages will be present in the NCI software catalogue.
- User /home quotas are 2 GB, versus ~80 GB on Orange. Home directories on Raijin are backed up daily.
- /short/<project> directories are used for temporary project data. The /short file system is not backed up.
- There are two primary compute queues: normal (Intel Sandy Bridge architecture) and normalbw (Intel Broadwell architecture).
- The express queue can be used for jobs requiring faster turnaround. Express jobs run with a higher scheduling priority, and are charged at a higher SU rate than normal jobs.
- The copyq queue should be used to move data. Jobs in the copyq run on the dedicated data mover nodes.
- The default maximum wall time limit for normal jobs is 48 hours. Users can request exceptions to the maximum wall time limit by submitting a support ticket to email@example.com. Please read the information at this link before you consider asking for a wall time exception.
NCI and Intersect are committed to supporting Intersect users through this transition period.
NCI User Services