Welcome to the M3 user guide

Important

Planned maintenance outages

We have scheduled quarterly outages for the M3 cluster. This is to ensure we communicate scheduled outages to our HPC users in advance. Where possible, we perform rolling upgrades with the cluster online. However, sometimes we have to perform upgrades that require the cluster to be taken offline. These include:

• system software upgrades;

• network maintenance;

• bug and security patches; and

• hardware maintenance

The 2020 planned maintenance dates are:

• 25/03/2020

• 24/06/2020

• 16/09/2020

• 16/12/2020

This site contains the documentation for the MASSIVE HPC systems. M3 is the newest addition to the facility.

Help and Support

• Help and Support
• Scheduled Maintenance
• MASSIVE System Status and Known Issues
• MASSIVE Terms of Use

Using M3

• About M3
  • System configuration
  • Compute
  • GPU Compute
  • Remote desktops through the CVL
• Requesting an account
  • Overview of the process
    • 1. Log in to the HPC ID system
    • 2. Create an M3 account
    • 3. Create or join an M3 project
    • 4. Set your M3 account password
    • 5. Log in to M3
    • Request an M3 account via email
• Requesting help on M3
  • Software issues
  • System issues
  • Contacting us
    • Help Desk
    • General Enquiries
    • Postal Address
• Connecting to M3
  • Connecting to M3 via ssh
    • Linux and OS X Users
    • Windows Users
  • Connecting to M3 via the MASSIVE desktop
    • MASSIVE Desktop (Strudel)
    • MASSIVE Desktop in browser (Strudel Web)
  • Connecting to M3 via Strudel2
    • Using the Desktop Application in Strudel2
    • Using the JupyterLab Application in Strudel2
    • Using the Terminal Application in Strudel2
• File Systems on M3
  • What to put on each file system?
    • Home directory (~10GB)
    • Project directory (Shared with everyone on your project)
    • Scratch directory (Shared with everyone on your project)
  • Disk Quotas
  • Default Quotas for New Projects
  • Scratch Usage Policies
  • System Backups and File Recovery
    • File Recovery Procedure
  • Information for Desktop Users
    • Thumbnails Generating Too Much Data
    • Remember to empty your trash folder
    • Already over quota?
  • Storage outside of M3
    • Instructions to access Market share
    • Instructions to access Vault
• Copying files to and from M3
  • GUI Tool - Windows, Mac OS, and Linux Users
    • FileZilla
  • Command Line Interface - Linux and OS X Users
    • rsync
• Software on M3
  • Modules
  • Installed software modules
  • Requesting an install
  • Docker based work flows
  • Running QIIME on M3
  • Running Python on M3
    • Using PyCharm with your Virtual environment
  • Running Anaconda on M3
    • Activating your Conda environment on M3
    • Installing and updating Python packages in your Conda environment
    • I ran conda init and my Desktop session no longer starts
• Known issues with software on M3
  • Singularity containers impacted by the new /scratch file system
  • Software Deprecation
• Running jobs on M3
  • Partitions Available
  • Other partitions
  • Checking the status of M3
    • The STATUS field explained
  • Slurm Accounts
    • Default accounts
    • Setting the account for a job
    • Questions about slurm accounts
  • Getting started with job submission scripts
  • Running Simple Batch Jobs
    • An example Slurm job script
    • Cancelling jobs
  • Running MPI Jobs
    • An example Slurm MPI job script
  • Running Multi-threading Jobs
    • An example Slurm Multi-threading job script
  • Running Interactive Jobs
    • Submitting an Interactive Job
    • How long do interactive jobs last for?
    • Reconnecting to/Disconnecting from an Active Interactive Job
  • Running GPU Jobs
    • Running GPU Batch Jobs
    • Compiling your own CUDA or OpenCL codes for use on M3
  • Running Array Jobs
    • An example of Slurm Array job script
  • QoS (Quality of Service)
    • How to run jobs with QoS
    • Explanation
  • Features & Constraints
    • An example of using constraint in the job script
    • Features Available
  • Checking job status
    • Method 1: show_job
    • Method 2: Slurm commands
  • Project Allocation
    • Project Space
    • Questions about allocation
• Lustre File System Quickstart Guide
  • About Lustre

Communities

• MX2 Eiger
  • The Big Picture
  • Authorising MASSIVE to download your data (CAP Leaders only)
  • Creating research projects (research lab leaders only)
  • Requesting access to M3
  • Getting started on M3
  • Connecting to M3
  • Accessing your MX data
  • Reprocessing your MX data
  • Recommended Settings
  • Known Issues
    • Cannot open or read filename.tmp error
  • Need help?
• Deep Learning
  • Software
    • Caffe
    • TensorFlow
    • PyTorch
    • Keras
    • Scikit-learn
  • Reference datasets
    • ImageNet
  • Quick guide for checkpointing
    • Why checkpointing?
• Neuroimaging
  • Human Connectome Project Data Set
    • Human Connectome Project Steps for Access
    • MASSIVE Steps for Access
  • Using SLURM to submit a simple FSL job
    • Background
    • Data and scripts
• Cryo EM
  • Relion
    • The Graphical Interface
    • Using the Queue
    • Motion Correction
    • 2d/3d Classification & Refinement
    • Particle Polishing
  • Cryo EM Pre-Processing Tool
  • Cryo EM Benchmarking and Optimisation
    • Cryo EM Benchmarking and Optimisation
• Bioinformatics
  • Requesting an account on M3
  • Getting started
    • Importing the bioinformatics module environment
    • Installing additional software with Bioconda
  • Running the RNAsik RNA-seq pipeline on M3
  • FAQ
• DGX
  • Hardware
  • How to access the DGX hardware
  • What jobs are suitable?
    • How do you demonstrate a suitable project/job?
• Data Collections
  • 1. Human Connectome Project Dataset (HCP)
  • 2. ImageNet
  • 3. BlastDB
  • 4. Brain Genomics Superstruct Project (GSP)
  • 5. Nathan Kline Institute Rockland Sample (NKI-RS): Neuroimaging Release
  • Requesting a data collection
• XNAT
  • Create an account at Monash-XNAT
  • Request to create a project at Monash-XNAT
  • Mirroring data from Alfred-XNAT to Monash-XNAT
  • Pulling Data from Monash-XNAT to MASSIVE M3

FAQs

• Frequently asked questions
  • Accounts
  • Jobs
  • M3, desktops and Strudel
• About Field of Research (FOR) and Socio-Economic Objective (SEO) codes
• Miscellaneous
• CloudStor Plus
  • Getting Started
  • CloudStor Plus on the CVL Desktop
  • Deactivating your CloudStor Plus Account on the CVL Desktop