The CANFAR Science Platform at 1.0: Cloud-Native Batch, APIs, and Operational Experience

P9
12 Nov 2025, 09:30
15m
Synagoge

Synagoge

Görlitz
oral presentation Science platforms in the big data era Plenary Session 9

Speaker

Shiny Brar (CADC)

Description

The Canadian Advanced Network for Astronomical Research (CANFAR) science platform has reached its 1.0 release, marking a significant evolution in its capacity to address the challenges of astronomical analysis in the era of large surveys and facilities. In this presentation, we will detail the evolution of the CANFAR architecture, which provides researchers with a suite of services, including browser-accessible desktops, notebooks, and development and analysis tools, built upon a Kubernetes-managed cloud backend.

We will focus on recent major technical developments, including the deployment of a cloud-native batch processing system using Kueue, which enables the efficient execution of large-scale, automated analysis pipelines, and promotes the transition from interactive, exploratory work to batch computation. We will also detail the release of a new CANFAR client and software API, facilitating programmatic access for complex workflows that can span networks of CANFAR deployments. Drawing from years of operational experience supporting a diverse user base—from individual researchers to large collaborations —we will share insights and metrics related to platform monitoring, reliability, and user support strategies.

Finally, we will outline our roadmap, which prioritizes support for data-intensive projects driven by SRCNet while also accommodating workflows from Euclid, LSST, ALMA or CHIME-FRB. This talk will demonstrate how these integrated components establish CANFAR as a robust, scalable, and accessible platform for modern astronomy.

Affiliation of the submitter CADC
Attendance in-person

Primary author

Co-authors

Presentation materials