European XFEL data workshop

Europe/Berlin
Online

Online

Krzysztof Wrona (Eur.XFEL (European XFEL)), Luca Gelisio (European XFEL)
Description

Join our workshop to discuss how to efficiently manage and analyze data at European XFEL.
You'll learn which tools, processes, and experiences from your peers can directly improve your results.

If you would like a particular topic to be discussed, contact us.

 

Contact
    • 10:00 10:15
      Welcome 15m
      Speakers: Krzysztof Wrona (Eur.XFEL (European XFEL)), Luca Gelisio (European XFEL)
    • 10:15 10:45
      Data orientation 30m

      This session for new & less experienced European XFEL users is a brief summary of the systems & infrastructure which you'll use to work with data produced at a beamtime. We'll talk about how to prepare for data collection, and show some of the tools you might be using to analyse data during & after your experiment.

      Speaker: Thomas Kluyver (Eur.XFEL (European XFEL))
    • 10:45 11:30
      News & highlights 45m

      This talk will cover new developments from the Data department in addition to highlighting notable achievements in 2025. The past year saw many new additions to our data analysis software suite, EXtra. There is now a new GUI interface (extra.gui) which features a graphical tool to calibrate 2D spectrometers in Jupyter and a couple of widgets for ROI and peak selection. Another big addition is the extra.applications module where multi-step specialized analyses built on the EXtra library can be implemented; the calibration of the photo-electron spectrometer is such an application. The talk will also discuss many more smaller changes (some of them break backward compatibility), and new helper functions for plotting and more. Another new development is the release of the web interface of the DAMNIT, our interactive experiment overview tool. The talk will also give a quick overview of the policy along with the newly created data local contact (DLC) role. Finally, the talk will cover some highlights from experiments as well as from data science and machine learning activities in the department.

      Speaker: Fady Adibsamy Bishara (Eur.XFEL (European XFEL))
    • 11:30 11:45
      Questions & Break 15m
    • 11:45 12:30
      Data management plans & data reduction: a practical demonstration 45m

      The new Scientific Data Policy takes effect for all user proposals starting in 2026, which includes the introduction of data management plans and data reduction as an integral part of the proposal lifecycle. Over the past two years, the necessary workflows have been developed as part of pilot programs in conjunction with users of select experiments.
      Here we present a practical end-to-end demonstration of how this process looked like for a typical experiment, as well as some examples of how it can benefit in the case of more special requirements.

      Speakers: Egor Sobolev (Eur.XFEL (European XFEL)), Philipp Schmidt (Eur.XFEL (European XFEL))
    • 12:30 13:30
      Questions & Break 1h
    • 13:30 14:00
      First insights to refined results: mapping charge transfer in dissociating molecules 30m

      Charge transfer is essential to many complex chemical processes and thus a thorough understanding at the molecular level is desired. One particular aspect concerns the interplay between the positions of nuclei and the probability of charge transfer. During a beamtime at EuXFEL's SQS instrument, we studied how the ability to transfer electrons in dissociating molecules with a rotating fragment changes throughout the dissociation process.
      Beyond the fundamental physics, this talk highlights the data analysis journey. We demonstrate how preliminary online and first offline feedback enabled us to steer the experiment, yet how it differs from the post-beamtime refined results. We discuss the role of the EuXFEL data analysis ecosystem using tools such as EXtra-metro, DAMNIT and EXtra in different stages of that journey.

      Speaker: Bjoern Senfftleben (ETH Zurich)
    • 14:00 14:30
      Reduction and analysis of time resolved solution scattering data measured with non-standard excitation patterns 30m

      I will introduce Time resolved X-ray solutions scattering as a technique and outline some of the challenges associated with measuring at ~100 kHz X-ray repetition rate.
      I will discuss the data pipeline that we have developed in conjunction with the data analysis group and outline how that helped solve these challenges.

      Speaker: Morten Haubro (Technical University of Denmark)
    • 14:30 15:00
      Automating Talbot phase imaging at HED 30m

      High rep-rate data requires high rep-rate solutions, where human-in-the-loop decision making no longer sufficient to manage many experiments efficiently. Simultaneously, the requirement for high-level, (near-) online analysis to manage experiments is often explicitly at odds with their goal: to do something new where you don't know exactly what you'll see. I'll walk through how HED have built from early, often user-provided notebooks/codebases, toward (more) robust, adaptable analysis deployed across many experiments - making use of DAMNIT and extra-metro frameworks at European XFEL - focusing on the example of Talbot phase imaging.

      Speaker: Oliver Humphries (Eur.XFEL (European XFEL))
    • 15:00 15:30
      Data quality enhancement 30m

      Research done at European XFEL takes advantage of both high-throughput data, as well as the enhanced data quality. Different research topics are being explored to ensure that we continue to deliver increasingly high-quality data. The presentation expands on selected projects and research topics within three main areas. One topic includes beam automation and instrument alignment automation, which reduce the time spent in this task during the beam time, leading to a larger time budget spent on the data collection. Another avenue being explored consists of improving the quality of the diagnostics provided, combining information from multiple sources. A final research topic includes the provision of quality labels to the acquired data, and its correction, when needed.

      Speaker: Danilo Enoque Ferreira de Lima (Eur.XFEL (European XFEL))
    • 15:30 15:45
      Wrap-up 15m
      Speakers: Krzysztof Wrona (Eur.XFEL (European XFEL)), Luca Gelisio (European XFEL)
    • 15:45 16:00
      Break 15m
    • 16:00 17:00
      Breakout room 1. Feedback & discussion: Data management plans & data reduction 1h

      Join this breakout room to discuss the data reduction topic, as well as data management plans.

    • 16:00 17:00
      Breakout room 2. Feedback & discussion: Data access & data analysis 1h

      Join this breakout room to discuss tools and methods to access and analyze data at European XFEL.