5–7 Jul 2023
Dresden
Europe/Berlin timezone

First Online Reinforcement Learning on Hardware at a Particle Accelerator

6 Jul 2023, 10:39
3m
Dresden

Dresden

Helmholtz-Zentrum Dresden-Rossendorf (HZDR)
Speed talk & Poster ST - Beam control Speedtalks: Controls/Seeding/DAQ

Speaker

Luca Scomparin (KIT IPE)

Description

Future particle accelerators will challenge the capabilities of current control systems. One of the possible solutions is the use of Machine Learning techniques. While several algorithms have already been implemented and are in current operation, some specific problems will require novel hardware systems in order to satisfy throughput and latency constraints.
In this study, we employ the KINGFISHER platform developed at IPE, which is based on the innovative Xilinx Versal ACAP, to effectively control horizontal betatron oscillations caused by a kicker at KARA. This control is achieved through the turn-by-turn action of a Reinforcement Learning agent. Notably, this is the first instance of online agent training implemented on hardware at a particle accelerator.

Primary author

Presentation materials