To meet the increasing demand for more space on /scratch from our researchers and to reduce the number of 'forgotten' temporary files, NCI is introducing a new file management policy for the Gadi /scratch file system. This new policy will automatically clean up files older not accessed for more than 100 days and so create more space available for research projects.
The removal of old /scratch files is a three stage process.
Step 1 - Files older not accessed for more than 100 days are moved from project directories on /scratch into a quarantine space. Once a file has been moved to quarantine it will no longer be accessible to its owner, the project, or to any HPC jobs run by the project or collaborating projects with read access, regardless of file permission settings.
: Files within /scratch project directories which have not been accessed for 365 days will be quarantined. Any quarantined files that are not recovered by project users within the initial 14-day quarantine period 17-31 May will be automatically deleted at the end of the quarantine period, 31 May.
: Files on /scratch which have not been accessed for 100 days will be quarantined. Any files remaining in quarantine at the end of the 14-day quarantine period will be automatically deleted.
From /scratch files older not accessed for more than 100 days will be quarantined on a continuous, rolling basis. The automated quarantine-expiry process will run each day, adding any files with atime greater than 100 days to the quarantine space, and deleting any files that have resided in quarantine for 14 days.