Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

 The The Project

Expand
titleWhat is this project about and why are we doing it?

This project is about delivering fit-for-purpose storage and computing infrastructure. This will be delivered by deploying new hardware, software, and expertise to create: 

  1. A central storage space for all AgResearch’s research data. 

    • Replacing our aging legacy High Performance Computing (HPC) with a more performant compute environment 

  2. Provide application support to researchers through our partnership with the talented people at NeSI (New Zealand eScience Infrastructure) 

Relevant Gateway articles: 

https://agresearchnz.sharepoint.com/sites/Gateway/SitePages/eResearch-platform-update.aspx  

https://agresearchnz.sharepoint.com/sites/Gateway/SitePages/Green-light-for-eResearch---our-first-Enabling-Platform.aspx  

...

Expand
titleMy work is urgent/has commercial deadlines, how will the new platform support that?

The general compute will be managed via Fairshare (here is an explanation of how this runs on NeSI at the moment). We are aware of various groups workflows for whom this approach won’t always ork due to urgent commercial deadlines (for example). In these cases we are currently looking into various mechanisms - replicate the existing environment; reservations; or high quality of service approacheswhich this approach may not provide sufficient service level guarantees, e.g., where there are urgent deadlines. Fortunately the Slurm scheduler has various mechanisms with which to support these requirements (e.g. reservations or quality-of-service) alongside ensuring fair sharing of resources in the general case. We will work with users to find the most appropriate approach as we migrate workflows to the new platform.

New questions for us to answer

Expand
titleWhat is the difference between the eResearch Infrastructure’s HPC cluster and NeSI’s National HPC platforms? When should I use one or other?

The eRI HPC cluster is hosted by NeSI, but is otherwise independent. That is, the eRI HPC cluster is AgResearch’s own infrastructure. In contrast, the HPC clusters such as the Mahuika are hosted and owned by NeSI and are the existing national HPC service, separate from AgResearch’s eRI. More technical details can be found here Differences in Platforms

image-20240503-022116.pngImage Added

Expand
titleIs the eResearch Infrastructure as secure as our existing eResearch options?

(To be developed)

Expand
titleWhat is Open OnDemand?

https://ondemand.eri.agresearch.co.nz/ is the portal for the eResearch Infrastructure accessible via web browser.