Note |
---|
Applicable to participants in the Early Access Program (EAP) only!In order to use the compute resources you need an account. Please request an account before connecting https://nznesi.atlassian.net/wiki/spaces/eRI/pages/2715779396/How+do+I+get+help#Via-the-support-portal. |
The instructions below assume that you already have an user account in AgResearch Active Directory and your password is not temporary. Also, that you are on the AgResearch local network (LAN) when attempting to connect. Further, one would need to be a member of a project in order to have access to both a project
(data/storage) folder as well as a scratch
(compute) folder.
To connect your local machine to the eRI cluster a Secure Shell (SSH) connection needs to be established. If you are using a Unix-like operating system like MacOS or Linux this can be achieved simply using the inbuilt terminal. Windows users must make use of an SSH client (e.g. WSL, PuTTY, MobaXterm).
Instruction for NeSI staff access
First copy the following SSH host configs. You can rename the login nodes I've named them eri-X as their true hostnames are generic
login-X
:
Code Block |
---|
Host bastion
User nesi-support
Hostname 163.7.177.182
ServerAliveInterval 300
ServerAliveCountMax 2
Host eri-0
User USER
Hostname 10.29.107.20
ProxyCommand ssh -W %h:%p bastion
ServerAliveInterval 300
ServerAliveCountMax 2
#ForwardX11 yes
#ForwardX11Trusted yes
Host eri-1
User USER
Hostname 10.1.112.21
ProxyCommand ssh -W %h:%p bastion
ServerAliveInterval 300
ServerAliveCountMax 2 |
Second, send one of your public keys to someone that already has access so they can add it to:
Code Block |
---|
/home/nesi-support/.ssh/authorized_keys |
Login to one of the eri login nodes with password provided by platforms and I recommend adding your personal pubkey auth to avoid passwords altoghether, eg from Mahuika:
Code Block |
---|
$ ssh-copy-id -i ~/.ssh/mypubkey.pub eri-0 |
\uD83D\uDCD8 Instructions
See NeSI internal documentation
\uD83D\uDCD8 Instructions for AgR staff access
OPTIONAL: If working from outside the AgResearch local network, connect to AgR VPN
(or Inscrutable or Iramohio first: e.g. connect via a Terminal application:ssh inscrutable.agresearch.co.nz
)
See also Connecting to the eRI compute cluster from Windows
Once logged on, continue to connectConnect to an eRI login node:
ssh username@agresearch.co.nz@login-0.eri.agresearch.co.nz
(orlogin-1
) enter your password if promptedList the contents of your sandbox project folder:
ls -la /agr/persist/projects/XXXX-abc_defghijklm
List the contents of your scratch folder:
ls -la /agr/scratch/projects/XXXX-abc_defghijklm
Change into the scratch location:
cd /agr/scratch/projects/XXXX-abc_defghijklm
Start working…
Panel | ||||||
---|---|---|---|---|---|---|
| ||||||
While other datasets or projects might be visible, please do not attempt to modify them during this phase of data staging/migration. |
...
Available Applications
Modules
module spider
to list the available applications as module. See also How to find and load software (aka modules)
Conda
Conda is installed but needs to be enabled:
Run
export PATH=/agr/persist/apps/miniconda/bin:$PATH
Run
conda init bash
Run
source ~/.bashrc
See also Usage — Bioconda documentation (very important - unless you setup the channel priorities as described there, installations from BioConda won’t work reliably)
Singularity
Available as Apptainer and aliasing enabled, meaning both apptainer --version
and singularity --version
will work.
...
scp can be used to copy data to/from the login node.
(Before copying data, please check whether what you need is already there - all legacy HPC datasets should be accessible via the familiar /dataset
paths, and legacy home directories under eRI home directories in legacy-hpc
, which should be treated as readonly, since it will get overridden when changes are made on legacy home.)
Copy from eRI login node to Inscrutable
Login to Inscrutable and then, for example:
copy a file from the user home on the eRI login node to the user home on Inscrutable.
Code Block | ||
---|---|---|
| ||
scp username@agresearch.co.nz@login-0.eri.agresearch.co.nz:/home/agresearch.co.nz/username/slurm-94.out /home/username/slurm-94.out |
Copy from Inscrutable to eRI login node (project folder)
Code Block | ||
---|---|---|
| ||
scp -r /home/username/my-data username@agresearch.co.nz@login-0.eri.agresearch.co.nz:/home/agresearch.co.nz/username/my-dataagr/persist/projects/XXXX-abc_defghijklm |
Copy from NeSI Mahuika to eRI login node
How to copy data between NeSI Mahuika and AgR eRI
Accessing other data
Datasets are located at /agr/persist/datasets/
...
Filter by label (Content by label) | ||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
|