A new Plotly-dash based query infrastructure for the Keck Observatory Archive

FD1
10 Nov 2025, 13:30
30m
Synagoge

Synagoge

Görlitz
Focus demo Automation of data pipeline and workflows Focus demo 1

Speaker

Rosemary Moseley (Caltech/IPAC-NExScI)

Description

The Keck Observatory Archive (KOA) curates all observations acquired at the W. M. Keck Observatory. The archive is expected to grow rapidly as complex new instruments will soon be commissioned and as the expectations of archive users have expanded. In response, KOA has been implementing a new Python based VO-compliant query infrastructure. We have deployed real time ingestion of newly acquired data, and a dedicated interface for observers to manage these newly acquired data. Our poster at ADASS 2024 identified the new technologies chosen: Plotly-Dash, a low-code framework that exploits event-driven callbacks to simplify the handling of user interactions; R-tree spatial indexing to speedup spatial searches by x20; a VO-compliant TAP middleware, used already at the NASA Exoplanet Archive and the NEID archive; and mViewer, a visualization engine in the Montage Image Mosaic toolkit that is optimized for astronomy images.

These technologies will underpin new services that can be hosted on web pages or in Jupyter notebooks, and when completed, will replace the current query infrastructure. We have completed two new services now in beta release. The Data Discovery Service is a web-based dashboard which returns spatial and temporal queries of the entire archive in seconds, It supports filtering observations by keywords, previewing results in a interactive data grid, visualizing images, and offer data downloads The second is a Jupyter notebook that performs interactive Visualization of Keck Observations of protostars in the Rho Oph Dark Cloud, and uses data from CDS and IRSA as well as KOA.

This presentation demonstrates these services.

Affiliation of the submitter Caltech/IPAC-NExScI
Attendance in-person

Primary author

Rosemary Moseley (Caltech/IPAC-NExScI)

Co-authors

Presentation materials