The Hybrid Cloud-HPC platform as an Infrastructure for SKA Precursor Pipelines

PO
Not scheduled
15m
Wichernhaus

Wichernhaus

Board: A192
poster presentation Automation of data pipeline and workflows Poster

Speaker

Gordon German (CSIRO)

Description

The hybrid compute model, incorporating both Cloud and High Performance Compute (HPC) resources, has been an active area of research since 2018. For the past 5 years, the Australian SKA Regional Centre (AusSRC) has been utilising this model for processing of SKA Precursor data, utilizing both private and commercial Cloud Compute options, as well as private and public HPC centres.

We show our experience with this compute paradigm, and the obstacles and choices we have made along the way, using the AusSRC – FLASH (First Large Absorption Survey in H1) pipeline as an example.

Affiliation of the submitter AusSRC-CSIRO
Attendance in-person

Primary author

Presentation materials

There are no materials yet.