Research

21 pages, 18217 KiB

Open AccessArticle

Fast, Efficient and Flexible Particle Accelerator Optimisation Using Densely Connected and Invertible Neural Networks

by Renato Bellotti, Romana Boiger and Andreas Adelmann

Information 2021, 12(9), 351; https://0-doi-org.brum.beds.ac.uk/10.3390/info12090351 - 28 Aug 2021

Cited by 4 | Viewed by 2427

Particle accelerators are enabling tools for scientific exploration and discovery in various disciplines. However, finding optimised operation points for these complex machines is a challenging task due to the large number of parameters involved and the underlying non-linear dynamics. Here, we introduce two [...] Read more.

Particle accelerators are enabling tools for scientific exploration and discovery in various disciplines. However, finding optimised operation points for these complex machines is a challenging task due to the large number of parameters involved and the underlying non-linear dynamics. Here, we introduce two families of data-driven surrogate models, based on deep and invertible neural networks, that can replace the expensive physics computer models. These models are employed in multi-objective optimisations to find Pareto optimal operation points for two fundamentally different types of particle accelerators. Our approach reduces the time-to-solution for a multi-objective accelerator optimisation up to a factor of 640 and the computational cost up to 98%. The framework established here should pave the way for future online and real-time multi-objective optimisation of particle accelerators. Full article

(This article belongs to the Special Issue Machine Learning and Accelerator Technology)

► Show Figures

Figure 1

11 pages, 362 KiB

Open AccessArticle

An Online Iterative Linear Quadratic Approach for a Satisfactory Working Point Attainment at FERMI

by Niky Bruchon, Gianfranco Fenu, Giulio Gaio, Simon Hirlander, Marco Lonza, Felice Andrea Pellegrino and Erica Salvato

Information 2021, 12(7), 262; https://0-doi-org.brum.beds.ac.uk/10.3390/info12070262 - 26 Jun 2021

Viewed by 1808

Abstract

The attainment of a satisfactory operating point is one of the main problems in the tuning of particle accelerators. These are extremely complex facilities, characterized by the absence of a model that accurately describes their dynamics, and by an often persistent noise which, [...] Read more.

The attainment of a satisfactory operating point is one of the main problems in the tuning of particle accelerators. These are extremely complex facilities, characterized by the absence of a model that accurately describes their dynamics, and by an often persistent noise which, along with machine drifts, affects their behaviour in unpredictable ways. In this paper, we propose an online iterative Linear Quadratic Regulator (iLQR) approach to tackle this problem on the FERMI free-electron laser of Elettra Sincrotrone Trieste. It consists of a model identification performed by a neural network trained on data collected from the real facility, followed by the application of the iLQR in a Model-Predictive Control fashion. We perform several experiments, training the neural network with increasing amount of data, in order to understand what level of model accuracy is needed to accomplish the task. We empirically show that the online iLQR results, on average, in fewer steps than a simple gradient ascent (GA), and requires a less accurate neural network to achieve the goal. Full article

(This article belongs to the Special Issue Machine Learning and Accelerator Technology)

► Show Figures

Figure 1

17 pages, 8782 KiB

Open AccessArticle

Autoencoder Based Analysis of RF Parameters in the Fermilab Low Energy Linac

by Jonathan P. Edelen and Christopher C. Hall

Information 2021, 12(6), 238; https://0-doi-org.brum.beds.ac.uk/10.3390/info12060238 - 31 May 2021

Cited by 3 | Viewed by 2807

Abstract

Machine learning (ML) has the potential for significant impact on the modeling, operation, and control of particle accelerators due to its ability to model nonlinear behavior, interpolate on complicated surfaces, and adapt to system changes over time. Anomaly detection in particular has been [...] Read more.

Machine learning (ML) has the potential for significant impact on the modeling, operation, and control of particle accelerators due to its ability to model nonlinear behavior, interpolate on complicated surfaces, and adapt to system changes over time. Anomaly detection in particular has been highlighted as an area where ML can significantly impact the operation of accelerators. These algorithms work by identifying subtle behaviors of key variables prior to negative events. Efforts to apply ML to anomaly detection have largely focused on subsystems such as RF cavities, superconducting magnets, and losses in rings. However, dedicated efforts to understand how to apply ML for anomaly detection in linear accelerators have been limited. In this paper the use of autoencoders is explored to identify anomalous behavior in measured data from the Fermilab low-energy linear accelerator. Full article

(This article belongs to the Special Issue Machine Learning and Accelerator Technology)

► Show Figures

Figure 1

16 pages, 4460 KiB

Open AccessArticle

Vectorization of Floor Plans Based on EdgeGAN

by Shuai Dong, Wei Wang, Wensheng Li and Kun Zou

Information 2021, 12(5), 206; https://0-doi-org.brum.beds.ac.uk/10.3390/info12050206 - 12 May 2021

Cited by 11 | Viewed by 4100

Abstract

A 2D floor plan (FP) often contains structural, decorative, and functional elements and annotations. Vectorization of floor plans (VFP) is an object detection task that involves the localization and recognition of different structural primitives in 2D FPs. The detection results can be used [...] Read more.

A 2D floor plan (FP) often contains structural, decorative, and functional elements and annotations. Vectorization of floor plans (VFP) is an object detection task that involves the localization and recognition of different structural primitives in 2D FPs. The detection results can be used to generate 3D models directly. The conventional pipeline of VFP often consists of a series of carefully designed complex algorithms with insufficient generalization ability and suffer from low computing speed. Considering the VFP is not suitable for deep learning-based object detection frameworks, this paper proposed a new VFP framework to solve this problem based on a generative adversarial network (GAN). First, a private dataset called ZSCVFP is established. Unlike current public datasets that only own not more than 5000 black and white samples, ZSCVFP contains 10,800 colorful samples disturbed by decorative textures in different styles. Second, a new edge-extracting GAN (EdgeGAN) is designed for the new task by formulating the VFP task as an image translation task innovatively that involves the projection of the original 2D FPs into a primitive space. The output of EdgeGAN is a primitive feature map, each channel of which only contains one category of the detected primitives in the form of lines. A self-supervising term is introduced to the generative loss of EdgeGAN to ensure the quality of generated images. EdgeGAN is faster than the conventional and object-detection-framework-based pipeline with minimal performance loss. Lastly, two inspection modules that are also suitable for conventional pipelines are proposed to check the connectivity and consistency of PFM based on the subspace connective graph (SCG). The first module contains four criteria that correspond to the sufficient conditions of a fully connected graph. The second module that classifies the category of all subspaces via one single graph neural network (GNN) should be consistent with the text annotations in the original FP (if available). The reason is that GNN treats the adjacent matrix of SCG as weights directly. Thus, GNN can utilize the global layout information and achieve higher accuracy than other common classifying methods. Experimental results are given to illustrate the efficiency of the proposed EdgeGAN and inspection approaches. Full article

(This article belongs to the Special Issue Machine Learning and Accelerator Technology)

► Show Figures

Figure 1

19 pages, 1862 KiB

Open AccessArticle

A Machine Learning Approach for the Tune Estimation in the LHC

by Leander Grech, Gianluca Valentino and Diogo Alves

Information 2021, 12(5), 197; https://0-doi-org.brum.beds.ac.uk/10.3390/info12050197 - 29 Apr 2021

Cited by 1 | Viewed by 1982

Abstract

The betatron tune in the Large Hadron Collider (LHC) is measured using a Base-Band Tune (BBQ) system. The processing of these BBQ signals is often perturbed by 50 Hz noise harmonics present in the beam. This causes the tune measurement algorithm, currently based [...] Read more.

The betatron tune in the Large Hadron Collider (LHC) is measured using a Base-Band Tune (BBQ) system. The processing of these BBQ signals is often perturbed by 50 Hz noise harmonics present in the beam. This causes the tune measurement algorithm, currently based on peak detection, to provide incorrect tune estimates during the acceleration cycle with values that oscillate between neighbouring harmonics. The LHC tune feedback (QFB) cannot be used to its full extent in these conditions as it relies on stable and reliable tune estimates. In this work, we propose new tune estimation algorithms, designed to mitigate this problem through different techniques. As ground-truth of the real tune measurement does not exist, we developed a surrogate model, which allowed us to perform a comparative analysis of a simple weighted moving average, Gaussian Processes and different deep learning techniques. The simulated dataset used to train the deep models was also improved using a variant of Generative Adversarial Networks (GANs) called SimGAN. In addition, we demonstrate how these methods perform with respect to the present tune estimation algorithm. Full article

(This article belongs to the Special Issue Machine Learning and Accelerator Technology)

► Show Figures

Figure 1

15 pages, 3560 KiB

Open AccessArticle

Adaptive Machine Learning for Robust Diagnostics and Control of Time-Varying Particle Accelerator Components and Beams

by Alexander Scheinker

Information 2021, 12(4), 161; https://0-doi-org.brum.beds.ac.uk/10.3390/info12040161 - 10 Apr 2021

Cited by 9 | Viewed by 2778

Abstract

Machine learning (ML) is growing in popularity for various particle accelerator applications including anomaly detection such as faulty beam position monitor or RF fault identification, for non-invasive diagnostics, and for creating surrogate models. ML methods such as neural networks (NN) are useful because [...] Read more.

Machine learning (ML) is growing in popularity for various particle accelerator applications including anomaly detection such as faulty beam position monitor or RF fault identification, for non-invasive diagnostics, and for creating surrogate models. ML methods such as neural networks (NN) are useful because they can learn input-output relationships in large complex systems based on large data sets. Once they are trained, methods such as NNs give instant predictions of complex phenomenon, which makes their use as surrogate models especially appealing for speeding up large parameter space searches which otherwise require computationally expensive simulations. However, quickly time varying systems are challenging for ML-based approaches because the actual system dynamics quickly drifts away from the description provided by any fixed data set, degrading the predictive power of any ML method, and limits their applicability for real time feedback control of quickly time-varying accelerator components and beams. In contrast to ML methods, adaptive model-independent feedback algorithms are by design robust to un-modeled changes and disturbances in dynamic systems, but are usually local in nature and susceptible to local extrema. In this work, we propose that the combination of adaptive feedback and machine learning, adaptive machine learning (AML), is a way to combine the global feature learning power of ML methods such as deep neural networks with the robustness of model-independent control. We present an overview of several ML and adaptive control methods, their strengths and limitations, and an overview of AML approaches. Full article

(This article belongs to the Special Issue Machine Learning and Accelerator Technology)

► Show Figures

Figure 1

21 pages, 1669 KiB

Open AccessArticle

A Novel Approach for Classification and Forecasting of Time Series in Particle Accelerators

by Sichen Li, Mélissa Zacharias, Jochem Snuverink, Jaime Coello de Portugal, Fernando Perez-Cruz, Davide Reggiani and Andreas Adelmann

Information 2021, 12(3), 121; https://0-doi-org.brum.beds.ac.uk/10.3390/info12030121 - 12 Mar 2021

Cited by 12 | Viewed by 2723

Abstract

The beam interruptions (interlocks) of particle accelerators, despite being necessary safety measures, lead to abrupt operational changes and a substantial loss of beam time. A novel time series classification approach is applied to decrease beam time loss in the High-Intensity Proton Accelerator complex [...] Read more.

The beam interruptions (interlocks) of particle accelerators, despite being necessary safety measures, lead to abrupt operational changes and a substantial loss of beam time. A novel time series classification approach is applied to decrease beam time loss in the High-Intensity Proton Accelerator complex by forecasting interlock events. The forecasting is performed through binary classification of windows of multivariate time series. The time series are transformed into Recurrence Plots which are then classified by a Convolutional Neural Network, which not only captures the inner structure of the time series but also uses the advances of image classification techniques. Our best-performing interlock-to-stable classifier reaches an Area under the ROC Curve value of

0.71 \pm 0.01

compared to

0.65 \pm 0.01

of a Random Forest model, and it can potentially reduce the beam time loss by

0.5 \pm 0.2

s per interlock. Full article

(This article belongs to the Special Issue Machine Learning and Accelerator Technology)

► Show Figures

Figure 1

13 pages, 5293 KiB

Open AccessArticle

Virtual Diagnostic Suite for Electron Beam Prediction and Control at FACET-II

by Claudio Emma, Auralee Edelen, Adi Hanuka, Brendan O’Shea and Alexander Scheinker

Information 2021, 12(2), 61; https://0-doi-org.brum.beds.ac.uk/10.3390/info12020061 - 31 Jan 2021

Cited by 4 | Viewed by 2494

Abstract

We discuss the implementation of a suite of virtual diagnostics at the FACET-II facility currently under commissioning at SLAC National Accelerator Laboratory. The diagnostics will be used for the prediction of the longitudinal phase space along the linac, spectral reconstruction of the bunch [...] Read more.

We discuss the implementation of a suite of virtual diagnostics at the FACET-II facility currently under commissioning at SLAC National Accelerator Laboratory. The diagnostics will be used for the prediction of the longitudinal phase space along the linac, spectral reconstruction of the bunch profile, and non-destructive inference of transverse beam quality (emittance) while using edge radiation at the injector dogleg and bunch compressor locations. These measurements will be folded into adaptive feedbacks and Machine Learning (ML)-based reinforcement learning controls to improve the stability and optimize the performance of the machine for different experimental configurations. In this paper we describe each of these diagnostics with expected measurement results that are based on simulation data and discuss progress towards implementation in regular operations. Full article

(This article belongs to the Special Issue Machine Learning and Accelerator Technology)

► Show Figures

Figure 1

22 pages, 2540 KiB

Open AccessArticle

Machine Learning Applied to the Analysis of Nonlinear Beam Dynamics Simulations for the CERN Large Hadron Collider and Its Luminosity Upgrade

by Massimo Giovannozzi, Ewen Maclean, Carlo Emilio Montanari, Gianluca Valentino and Frederik F. Van der Veken

Information 2021, 12(2), 53; https://0-doi-org.brum.beds.ac.uk/10.3390/info12020053 - 25 Jan 2021

Cited by 5 | Viewed by 2528

Abstract

A Machine Learning approach to scientific problems has been in use in Science and Engineering for decades. High-energy physics provided a natural domain of application of Machine Learning, profiting from these powerful tools for the advanced analysis of data from particle colliders. However, [...] Read more.

A Machine Learning approach to scientific problems has been in use in Science and Engineering for decades. High-energy physics provided a natural domain of application of Machine Learning, profiting from these powerful tools for the advanced analysis of data from particle colliders. However, Machine Learning has been applied to Accelerator Physics only recently, with several laboratories worldwide deploying intense efforts in this domain. At CERN, Machine Learning techniques have been applied to beam dynamics studies related to the Large Hadron Collider and its luminosity upgrade, in domains including beam measurements and machine performance optimization. In this paper, the recent applications of Machine Learning to the analyses of numerical simulations of nonlinear beam dynamics are presented and discussed in detail. The key concept of dynamic aperture provides a number of topics that have been selected to probe Machine Learning. Indeed, the research presented here aims to devise efficient algorithms to identify outliers and to improve the quality of the fitted models expressing the time evolution of the dynamic aperture. Full article

(This article belongs to the Special Issue Machine Learning and Accelerator Technology)

► Show Figures

Figure 1

Journal Menu

Journal Browser

Machine Learning and Accelerator Technology

Share This Special Issue

Special Issue Editor

Special Issue Information

Keywords

Published Papers (9 papers)

Research

Further Information

Guidelines

MDPI Initiatives

Follow MDPI