Work in Progress: active data transfer/staging is still happening in the background. Hence, not all of your datasets will have read/write access at this point in time.
We are referring to this process as the “cutover process”. Please raise a request to clarify the status for your dataset.
Before You Start
When making the move over to eRI, there is some information you can provide or have thought about to help smooth the process.
Do you have legacy data that needs to move (be cutover)? this could take some time
Background: Most data has been transferred from the legacy HPC to the new eRI HPC already. Any data that has not been migrated will not readable/writeable until it has been cut over. This ensures both data sets remain in sync.
Do you need a new dataset and project (with compute allocation) created or will you be accessing another workspace?
If you are unsure what the difference between a dataset and a project is, check out the frequently asked questions page for more information.
What software/version might you need?
If you are unsure what software is available, check out xxx.
How do I know if there is already data or a project?
New AgResearch staff planning to utilise the compute resources, need a home folder provisioned. Please request a home folder with us.
Do this by emailing NeSI’s support desk at support@cloud.nesi.org.nz.
Getting started
When accessing the AgResearch HPC for the first time, you will need to email NeSI’s support desk (at support@cloud.nesi.org.nz) and request that NeSI give you a user account in the AgResearch Active Directory OR go to my.nesi.org.nz and log in with either your institutional credentials, or your Tuakiri Virtual Home account, whichever applies. A user account will give you access to a Proposal Development, a sandbox environment with a small amount of storage and computing allocation to allow you to familiarise yourself with the platform, e.g. check that your software works.
Any usage of the HPC for computing will need to be linked to a project, this is done by emailing NeSI’s support desk (at support@cloud.nesi.org.nz) to link a project to your user account. This will give you access to a project directory, a scratch directory (for high-performance working storage within the HPC environment), and a share of access to HPC (i.e. compute/analysis) resources.
There might be data already stored in your project directory, but if you need to transfer data over to your project, you will need to email NeSI’s support desk. You can create a ticket with the support desk for each data set separately, or list all data sets that you want to have cut-over in one go.
More technical details are given here on how to connect to the AgResearch HPC from your computer. There are also resources available here if you want a better understanding of what NeSI user accounts are etc.
Finally, NeSI also offers regular online office hour sessions, hosted via Zoom. These sessions are open to anyone - you don't need to be an existing NeSI user. Information on when the next office hour will be hosted is here.
Authentication
The default authentication method is set to utilise Kerberos authentication using your AgResearch domain credentials from the login session of the workstation/laptop. Key-based authentication is supported as well. Make sure to use the supported format:
If it doesn’t work you will be prompted to authenticate using your AgResearch AD password. SSH Key-Based Authentication
username@agresearch.co.nz@login-0.eri.agresearch.co.nz for the username@host part.
Accessing storage resources
Every AgResearch user can access the storage. Some datasets have tighter access restrictions.
Please raise a request to clarify the access permissions for your dataset.
Accessing compute resources
Compute access is currently handled via a service request.
How to access the AgResearch eRI compute cluster