9–11 Oct 2023
Karlsruhe Institute of Technology (KIT)
Europe/Berlin timezone

Beam Trajectory Control with Lattice-Agnostic Reinforcement Learning

Not scheduled
2h 30m
Gaede Lecture Hall (Bldg 30.22) (Karlsruhe Institute of Technology (KIT))

Gaede Lecture Hall (Bldg 30.22)

Karlsruhe Institute of Technology (KIT)

Kaiserstr. 12 76131 Karlsruhe
Poster without speed talk Accelerator Research and Development Poster session

Speaker

Chenran Xu (KIT)

Description

In recent work, it has been shown that reinforcement learning (RL) is capable of outperforming existing methods on accelerator tuning tasks. However, RL algorithms are difficult and time-consuming to train, and currently need to be retrained for every single task. This makes fast deployment in operation difficult and hinders collaborative efforts in this research area. At the same time, modern accelerators often reuse certain structures, such as transport lines consisting of several magnets, within or across facilities, leading to similar tuning tasks.
In this contribution, we use different methods, such as domain randomization, to allow an agent trained in simulation to easily be deployed to a group of similar tasks. Preliminary results show that this training method is transferable and allows the RL agent to control the beam trajectory at similar lattice sections of two different real linear accelerators. We expect that future work in this direction will enable faster deployment of learning-based tuning routines, and lead towards the ultimate goal of autonomous operation of accelerator systems and transfer of RL methods to most accelerators.

Speed Talks I am unable/unwilling to give a speedtalk.

Primary author

Chenran Xu (KIT)

Co-authors

Andrea Santamaria Garcia (KIT) Anke-Susanne Mueller (KIT) Annika Eichler (MSK (Strahlkontrollen)) Dr Erik Bruendermann (KIT) Jan Kaiser (DESY)

Presentation materials

There are no materials yet.