Speaker
Holger Stiele
Description
Forschungszentrum Jülich has hosted the German part of the LOFAR long-term archive since 2013. Currently about 20 petabytes (PB) of data are stored with a growth rate of around 2 PB a year.
Future radio telescopes are expected to have a much higher data rate and bring new challenges in processing and storing data.
Here we briefly report on the current data management of the Jülich LOFAR Data Archive, including the ingestion, the storage system, the export to the long-term archive, and the request chain. We analysed the data access pattern over the last 10 years and give an estimation of the energy consumption of the process. Based on this analysis, we define requirements for future, even more extensive long-term data archives.
| Type of submission | Talk |
|---|
Primary authors
Arpad Miskolczi
(Forschungszentrum Jülich)
Cristina Manzano
Holger Stiele
Susanne Pfalzner
(Forschungszentrum Jülich)
Vadim Vybornov
(Juelich Supercomputing Centre JSC)
