The Canadian Data-Intensive Astrophysics PLatform (CanDIAPL)

PO
Not scheduled
15m
Wichernhaus

Wichernhaus

Board: S206
poster presentation Science platforms in the big data era Poster

Speaker

Mike Cichonski (Dunlap Institute for Astronomy and Astrophysics, University of Toronto)

Description

The Canadian Data-Intensive Astrophysics PLatform (CanDIAPL) is a national, production-grade ecosystem that lets Canadian astronomers use petabyte-scale survey streams rather than drown in them. CanDIAPL will pair on-site streaming compute at SKA pathfinders (MeerKAT/South Africa; MWA/Australia) with dedicated off-site storage and analysis at the Alliance/CANFAR Nibi (formerly ‘Graham’) cloud to turn raw throughput into science-ready products in near real time. On top of this hardware, three integrated software pillars serve both time-domain and “static-sky” use cases: (1) a real-time analysis stack that will ingest feeds from the Rubin community alert brokers with a radio-focused transient marshal for cross-wavelength/multi-messenger classification and follow-up; (2) dynamic-dataset pipelines that continuously ingest, calibrate, and publish radio (continuum, polarization, H I) and optical image/catalog products, with user-defined triggers that notify researchers when evolving data satisfy science criteria; and (3) a multi-messenger science portal that unifies access to images, cubes, catalogs, alerts, cutouts, and notebooks, conforming to IVOA standards (e.g., TAP/VOEvent) and interoperating with CADC/CANFAR systems. Initial science drivers span two themes: (I) Cosmic Explosions & the Transient Universe and (II) Galaxies, Gas & Dark Matter. Beyond accelerated discovery, CanDIAPL secures Canadian data rights, standardizes tooling, and delivers inclusive training in high-performance computing and data-intensive methods. We will present the architecture, current deployment, and early services, and outline the scale-up path toward full SKA/Rubin operations.

Affiliation of the submitter Dunlap Institute for Astronomy and Astrophysics, University of Toronto
Attendance in-person

Primary author

Mike Cichonski (Dunlap Institute for Astronomy and Astrophysics, University of Toronto)

Presentation materials