Data analysis at the European XFELZoom Video Conference

Tuesday 25 Jan 2022, 09:45 → 18:30 Europe/Berlin

Online

Luca Gelisio (European XFEL)

The experiments performed at the European XFEL generate enormous amounts of data. While online analysis, which happens in near real-time, provides crucial feedback to steer the experiment, more rigorous offline analysis is necessary for new scientific findings.
One of the missions of the Data Analysis group is to provide tools to enable analysis and interpretation of data, both online and offline.
The aim of this workshop is to introduce the various tools that we develop and to provide examples of their use, as well as to bring in the point of view of the Users and their feedback. We will also talk about how artificial intelligence and machine learning can be used for data analysis, and discuss new ideas together.

1 Welcome

Speaker: Luca Gelisio (European XFEL)

LGelisio-UM2022.pdf

2 Preamble

How to get started: Maxwell, finding your data and useful software.

Speaker: Robert Rosca (Eur.XFEL (European XFEL))

UM2022_Preamble.pdf

3 Online analysis

Performing quasi real-time analysis: Extra-foam, Extra-metro, Karabo bridge.

Speakers: James Wrigley (Eur.XFEL (European XFEL)), Philipp Schmidt (Eur.XFEL (European XFEL))

UM2022_OnlineAnalysis.pdf

4 Offline analysis

How to read data and perform some analysis.

Speaker: Thomas Kluyver (Eur.XFEL (European XFEL))

Tutorial MID data.ipynb

Tutorial MID data.pdf

Tutorial notebook on max-jhub

12:00 Break

5 GroEL diffraction at SQS: Finding the protein needle in a haystack of background

Speaker: Dr Tomas Ekeberg (Uppsala University)

6 Data processing and reduction in serial crystallography

Speakers: Marina Galchenkova (Center for Free-Electron Laser Science), Oleksandr Yefanov (FS-CFEL-1 (Forschung mit Photonen Experimente 1))

7 Towards a streaming algorithm for AGIPD calibration and photon counting

Speaker: Felix Brausse (Eur.XFEL (European XFEL))

dataAnalysisSatellite-FelixBrausse.pdf

8 Steps towards a real-time pipeline for MHz X-ray imaging

Speaker: Pablo Villanueva Perez (CFEL)

15:00 Break

9 A deep dive into the mathematics of Machine Learning

Crash course on machine learning.

Speaker: Danilo Enoque Ferreira de Lima (Eur.XFEL (European XFEL))

user_meeting_ml_intro_jan_2022.pdf

Jupyter notebooks at: https://git.xfel.eu/danilo/ml-tutorial

10 Artificial intelligence activities

Artificial intelligence activities within the Data Analysis group.

Speakers: Arman Davtyan (Eur.XFEL (European XFEL)), Yue Sun (Eur.GPEX)

User_Meeting_2022.pdf

11 Automated SFX analysis

A pipeline for the automatic analysis of serial femtosecond crystallography data.

Speakers: Fabio Dall'Antonia (Eur.XFEL (European XFEL)), Oleksii Turkot (Eur.XFEL (European XFEL))

xwiz_users_2022.pdf

12 Data reduction at EuXFEL: first steps

Overview of ideas for data reduction at the European XFEL.

Speaker: Egor Sobolev (Eur.XFEL (European XFEL))

um2022-data-reduction.pdf

16:45 Break

13 Round table

Discussion with participants on several topics.

Speaker: Philipp Schmidt (Eur.XFEL (European XFEL))

UM2022_Roundtable.pdf