EDPS GUI: A Modern Graphical Frontend for the ESO Data Processing System

PO
Not scheduled
15m
Wichernhaus

Wichernhaus

Board: A226
poster presentation Automation of data pipeline and workflows Poster

Speaker

Stefano Zampieri (ESO)

Description

The ESO Data Processing System (EDPS) is a framework designed to execute data reduction pipelines for ESO’s optical and infrared instruments at the La Silla Paranal Observatory and, in the future, the ELT. More information is available at https://www.eso.org/sci/software/edps.html.
EDPS supports a wide range of use cases, from online data quality control at the telescope to interactive use by individual scientists. It has been used operationally for quality control at Paranal for over three years and was made publicly available at the end of 2023. It has proven to be robust enough for large-scale processing yet flexible enough to handle the diversity of data produced by ESO’s La Silla Paranal Observatory.
Each ESO pipeline comprises a series of standalone programs known as recipes, each of which is tailored to process a specific type of input data. These recipes usually require various auxiliary files, such as calibration data. EDPS automates the selection of the correct input files and orchestrates the sequential – or, when appropriate, parallel –execution of recipes according to a defined workflow, enabling fully automated data processing.
We present the first release of the EDPS GUI, a web-based Graphical User Interface for EDPS designed for scientific and interactive use. It is built with Panel, an open-source Python web application framework that streamlines the development of robust tools, dashboards, and complex applications. Panel is part of the Holoviz ecosystem, which provides high-level tools for simplifying data visualization in Python.
The EDPS GUI has been designed to replace the current EsoReflex environment. It provides a modern, flexible and user-friendly interface for executing pipelines, including configuring and optimising the reduction cascade, and inspecting the data.

Affiliation of the submitter ESO
Attendance in-person

Primary author

Co-authors

Presentation materials