The 35th annual conference on Astronomical Data Analysis Software & Systems 2025 in Görlitz, Germany

ESA's Euclid cosmology mission was launched in 2023 and during its five year life time it will observe one third of the sky with unprecedented resolution with its optical and near infrared instruments.

The Euclid data will be hosted by the Euclid Science Archive, within the ESAC Science Data Centre (ESDC) in Madrid. The ESDC is in charge of the development, operations and maintenance of the science archives for all the ESA astronomy, planetary and heliophysics missions, as well as for the ESA Human Robotic and Exploration investigations.

The Euclid Science Archive released the Quick Release 1 (QR1) in May 2025, making available to the public 35 Terabytes of data.
The next major milestone is the Internal Data Release 1 (IDR1) in October 2025, whose data will grow to 2.2 Petabytes.
By the end of the mission, over 25 Petabytes of official products from the Euclid mission will be hosted at the Euclid Science Archive.

The purpose of this presentation is to show in detail the software, hardware and architectural progress needed for the critical transition to the IDR1 milestone, and how the Euclid Archive is getting ready to prepare for future, bigger releases.

The topics to be discussed will range from database technology specific for big data, parallelization of download and ingestion of products from several Euclid Data Centres across Europe and the US, as well as custom configuration of filesystem architecture to guarantee a transfer and ingestion performance of up to 70 Terabytes per day.