Next Article in Journal
Blind Witnesses Quench Quantum Interference without Transfer of Which-Path Information
Next Article in Special Issue
A Refinement of Recurrence Analysis to Determine the Time Delay of Causality in Presence of External Perturbations
Previous Article in Journal
Thermal Resonance and Cell Behavior
Previous Article in Special Issue
On the Potential of Time Delay Neural Networks to Detect Indirect Coupling between Time Series
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Image-Based Methods to Investigate Synchronization between Time Series Relevant for Plasma Fusion Diagnostics

by
Teddy Craciunescu
1,2,*,
Andrea Murari
2,3,4,
Ernesto Lerche
2,5,
Michela Gelfusa
2,6 and
JET Contributors
1
EUROfusion Consortium, JET, Culham Science Centre, Abingdon OX14 3DB, UK
2
National Institute for Laser, Plasma and Radiation Physics, 077126 Măgurele, Romania
3
Consorzio RFX (CNR, ENEA, INFN, Universita di Padova, Acciaierie Venete SpA), I-35127 Padova, Italy
4
EUROfusion Programme Management Unit, JET, Culham Science Centre, Abingdon OX14 3DB, UK
5
LPP-ERM/KMS, Association EUROFUSION-Belgian State, TEC Partner, 1000 Brussels, Belgium
6
Associazione EUROfusion—University of Rome “Tor Vergata”, Via Orazio Raimondo, 18, 00173 Roma, Italy
*
Author to whom correspondence should be addressed.
See the author list of E. Joffrin et al., Nucl. Fusion 59, 112021 (2019).
Submission received: 26 June 2020 / Revised: 15 July 2020 / Accepted: 15 July 2020 / Published: 16 July 2020

Abstract

:
Advanced time series analysis and causality detection techniques have been successfully applied to the assessment of synchronization experiments in tokamaks, such as Edge Localized Modes (ELMs) and sawtooth pacing. Lag synchronization is a typical strategy for fusion plasma instability control by pace-making techniques. The major difficulty, in evaluating the efficiency of the pacing methods, is the coexistence of the causal effects with the periodic or quasi-periodic nature of the plasma instabilities. In the present work, a set of methods based on the image representation of time series, are investigated as tools for evaluating the efficiency of the pace-making techniques. The main options rely on the Gramian Angular Field (GAF), the Markov Transition Field (MTF), previously used for time series classification, and the Chaos Game Representation (CGR), employed for the visualization of large collections of long time series. The paper proposes an original variation of the Markov Transition Matrix, defined for a couple of time series. Additionally, a recently proposed method, based on the mapping of time series as cross-visibility networks and their representation as images, is included in this study. The performances of the method are evaluated on synthetic data and applied to JET measurements.

1. Introduction

The diagnostic systems monitoring the experiments in Magnetic Confinement Nuclear Fusion (MCNF) produce a large amount of data, several tens of Gigabytes for a typical Joint European Torus (JET) experiment, mainly in the form of time series. Discovering temporal causal directions or assessing the causal relations between dynamical processes, represented as time series, is an important task in various fusion plasma studies. The investigation of instabilities and the assessment of the pacing techniques efficiency, the study of L–H transitions, for which a theoretical dynamical model is not yet available, or the study of plasma dynamics in relation to the impurity control are significant examples.
The control of major instabilities such as Edge Localized Modes (ELMs) and sawteeth [1], with a significant potentially harmful impact on the devices, represents a key issue for the development of the next large fusion devices such as ITER (International Thermonuclear Experimental Reactor). Various forms of pacing, based on external perturbations, have been proposed. In the case of ELMs, the periodic injection of small frozen pellets of fusion fuel into the plasma edge at high frequency is a very promising solution [2]. The modulation of the Ion Cyclotron Radiofrequency Heating (ICRH) power has proven to be an efficient solution for sawteeth pacing, reducing the fast ion component, which has a stabilizing effect [3]. Pellets and ICRH notches represent time localized perturbations of the natural evolution of the plasma, with a clear causal direction. On the other hand, the instabilities are quasiperiodic in nature and, therefore, if enough time is allowed to elapse, they are bound to reoccur, making difficult the interpretation of the experimental data. To evaluate the effectiveness of the triggering capabilities of the pacing techniques, it is, therefore, necessary to determine the time interval when the pacing has a causal influence on the instability dynamics.
The study of time series, generated by delayed coupled dynamical systems, is a very difficult problem, far from being completely solved in its full complexity [4,5]. Frequently the performances of the methods, evaluating the time series coupling, may vary depending on the type of the dynamic systems studied. In the case of fusion plasma instability pacing, some physics properties render the problem more tractable: the coupling is unidirectional and it may be assumed that its strength is relatively strong, lying in the domain where these kinds of techniques are more sensitive. Several methods such as Granger Causality, Transfer Entropy, Recurrence Plots, Convergent Cross Mapping have been successfully applied for the evaluation of the time-lagged causal relations between time series, related to the instabilities and pacing factors [6,7,8].
In this paper, the efficiency of a group of methods, based on the time series representation as images, is investigated. The methods are evaluated on synthetic data and then on the JET experimental data. We are using the same experimental data as in [7] in order to allow a comparison of the methods. The measurements have been performed during sawteeth pacing experiments with ICRH modulation in JET–ITER-like Wall (JET-ILW) L and H mode discharge. A typical example is presented in Figure 1. The reader is referred to [3,7] for a detailed description of the pacing technique.
The paper is organized as follows: the next section gives a brief overview of the methods for time series encoding as images and a more detailed description of the techniques used in this paper. Section 3 is devoted to the evaluation of the methods’ performances on synthetic data. An application to experimental measurements in thermonuclear fusion is also described in this section. Several conclusions are drawn in the last section of the paper.

2. Image Representation of Time Series

Encoding time series as images have emerged in the field of data mining as an alternative tool for measuring similarities. The great success of deep learning in computer vision has been also a factor in promoting the representation of time series as different types of images for visualization, allowing a quick overview of large datasets and the easy discovery of interesting patterns, anomalies, gaps, clusters, etc. It has to be noted that, even when the analysis process is not fully computerized, the human perceptual skills are able, in the case of adequate representations, to cope with such visual tasks in a few hundred milliseconds [9]. The image representation has also the advantage of greater scalability to larger datasets. A simple intuitive representation, capable of describing complex patterns of repetition in time series, has been introduced in [10]. The data is converted to string representation, by mean of a discretization technique, and arcs are drawn between identical string sequences. A different approach to pattern discovery has been introduced in [11]. The data is discretized in the same manner and the symbolic representation is encoded in a modified suffix tree, where each pattern corresponds to a branch of the tree. The frequency of the patterns is mapped into a property of the graph (usually color or thickness). The visualization of periodic time series data based on spirals has been introduced in [12].
More popular approaches, used also in the present paper, are the Gramian Angular Fields (GAF) and Markov Transition Fields (MTF) methods [13], adequate choices when using Convolutional Neural Networks (CNN) for time series classification, and the Chaos Game Representation (CGR), which allows a synthetic and compact representation of large time series [14]. A recently developed method, based on the transformation of time series in a complex network and the image entropy evaluation of a modified adjacency matrix [15], is also included in this study. These techniques are presented in the following subsections.
Other promising approaches have been proposed recently. A time series imaging encoding scheme called Motif Difference Field (MDF), based on the motifs of different lengths, has been described in [16]. The approach is particularly useful for time series clustering allowing higher-order patterns or structures discovery in time series data. The embedding of Recurrence Plots (RP) [17] in the Bag of Features (BoF) [18] model, which summarizes time series according to the frequencies of ”feature words” of a data-learned dictionary, has been documented in [19]. In this way, advanced image processing techniques (such as, e.g., Scale-invariant feature transform (SIFT) [20]), Histogram of Oriented Gradients (HOG) [21] and Local Binary Patterns (LBP) [22]) are integrated with the time series analysis. An alternative data representation scheme is introduced in [23]. Time series are transformed into a two-dimensional real-coordinate space of amplitude and first- or higher-order derivatives.

2.1. Gramian Angular Field (GAM)

The Gramian Angular Field (GAF) method represents the time series X = { x 1 ,   x 2 ,   , x n ,   } , after rescaling it in the interval [−1, 1], on a polar coordinate:
{ φ = arccos ( x i ) , 1 < x i < 1 r = t i N  
where t i is the time stamp and N is a constant introduced to regularize the span of the polar coordinate system. Depending on the evolution of the time series, the shape formed by the points defined in (1) twists at specific angular points, creating a unique encoding map, which preserves absolute temporal relations [13]. GAF images are represented as a Gramian matrix where each element is the trigonometric sum of different time intervals:
G = [ c o s ( φ 1 + φ 1 ) c o s ( φ 1 + φ n ) c o s ( φ n + φ 1 ) c o s ( φ n + φ n ) ]
Each element G k represents the relative correlation by superposition of directions with respect to the time interval k.
It may be assumed that, when synchronization progresses, the GAF images of the driver and the target will have an increased number of common features, leading to an increased degree of similarity. The GAF images similarity may be evaluated by mean of the Structural Similarity Index (SSIM) [24]. SSIM is a very popular metric that was originally introduced to quantify image quality degradation during various processes such as, e.g., compression or data transmission. It is considered to be correlated with the human visual system quality perception. SSIM models the image degradation based on a combination of luminance and contrast distortion plus the loss of correlation. It is defined by the relation:
S S I M ( f , g ) = l ( f , g ) · c ( f , g ) · s ( f , g )
where:
-
l ( f , g ) = 2 μ f μ g + C 1 μ f 2 + μ g 2 + C 1 is the luminance comparison term, μ f , μ g are the luminances of images f and g . This term is equal to one for identical luminaces.
-
c ( f , g ) = 2 σ f σ g + C 2 σ f 2 + σ g 2 + C 2 is the contrast comparison term, the contrast is measured by the standard deviation σ f , σ g of images f and g .
-
s ( f , g ) = σ f g + C 3 σ f σ f + C 3 , is the structure comparison term, measured by the correlation coefficient between the two images f and g , σ f g is the covariance between f and g .
The positive constants C i ,   i = 1 , 2 , 3 are introduced in order to avoid a null denominator. Typical choices are: C 1 = ( 0.01 · L ) 2 , C 2 = ( 0.03 · L ) 2 and C 3 = C 2 2 , where L is the dynamic range of the image element’s values. SSIM values lie in the interval [0, 1]

2.2. Markov Transition Field (MTF)

The idea of encoding the dynamical transition statistics has been exploited first by Campanharo et al. [25], who proposed the construction of a complex network, based on the transition probability in a Markov model. First, a number of Q quantile bins are identified and then each value of the time series x i X   is assigned to a specific bin q [ 1 , , Q ] . Each bin represents a node in the network and two nodes are connected with a weight proportional to the probability that a point in quantile q i is followed by a point in quantile q j in the time series. The corresponding adjacency matrix is given by the relation:
W = [ W 11 | P ( x t q 1 | P ( x t 1 q 1 ) W 1 Q | P ( x t q 1 | P ( x t 1 q Q ) . . . . . . . . . W Q 1 | P ( x t q Q | P ( x t 1 q 1 ) W Q Q | P ( x t q Q | P ( x t 1 q Q ) ]
where w i j gives the frequency with which a point in quantile q j follows a point in quantile q j . As shown in [25] an approximate inverse of the mapping W can be retrieved.
The Markov matrix W , incorporates the Markov dynamics but, on the other hand, discards the conditional relationship between the distribution of X and the temporal dependency on the time steps t i . In order to avoid this information loss, Wang et al. [13] proposed an extension of the Markov matrix by aligning each probability along the temporal order:
M T F = [ w i j | x 1 q i , x 1 q j w i j | x 1 q i , x n q j . . . . . . . . . w i j | x n q i , x 1 q j w i j | x n q i , x n q j ]
where M T F i j represents the transition probability from the quantile at t i to the quantile at t j , which now are not necessarily consecutive. Therefore, MTF encodes the multispan transition probabilities of the time series. For example, M T F i , j , | i k | = k represents the transition probability between the points separated by the temporal distance k . M T F is a unique representation for a fixed value of Q . However, the mapping is surjective and, therefore, it is not possible to recover the time series from M T F .
A M T F mapping can be created for each time series. In principle, it may be assumed that the similarity of the images will increase with the increase of the coupling between the time series. This assumption is tested by numerical examples in the next section of this paper. The SSIM factor can be again used as a similarity measure.
For a pair of coupled time series, we are proposing, for the first time in this paper, to calculate the Markov matrix (4) for a new time series, created by intercalating the values of the two time series:
{ z 2 · i 1 = x i z 2 · i = y i ,   i = 1 , , N
The intercalating technique described by (6) is illustrated in Figure 2. The corresponding matrix will be called the Cross Markov Matrix (CMM) and it will be denoted by W c r o s s . W c r o s s has an expression similar to Equation (4). Its elements w i j c r o s s represent the frequency with which a point from the time series X in the quantile q i X is followed by a point from the time series Y , in the quantile q j Y . For synchronized time series it may be expected that the transition between distant quantiles will diminish creating a specific pattern. The matrix W c r o s s can be represented as an image and its evolution towards a more organized structure can be monitored by the image entropy:
H = k p k log 2 p k
where, in general, k is the gray level index and p k is the probability associated with gray level k .
An increased coupling between time series is expected to translate into a lower value of the entropy H .

2.3. Chaos Game Representation (CGR)

The Chaos Game Representation (CGR) has been used for representing time series as a collection of thumbnails, allowing the fast and easy exploration and classification of large data sets [14]. CGR is an algorithm for producing pictures of fractal structures [26]. It is mathematically described by an iterated function system (IFS). An IFS is a set of affine maps { w i } , where each map consists of a pair of linear equations:
w ( x , y ) = ( a x + b y + e ,   c x + d y + f )
A certain probability is associated to map w i . The chaos game starts by generating a random point in the unit square. A map w k is randomly chosen from the set { w i } , according to its probability. Then, w k is applied to the current point to generate the next one. Different parameters of the IFS lead to different fractals.
A particular simple version of the algorithm (CGRS) starts by fixing a number of vertices N v and by generating a starting random point ( x 0 ,   y 0 ) . Then, at each step, one of the vertices N k is chosen randomly and the next point ( x k + 1 ,   y k + 1 ) is located halfway between the current point ( x k + 1 ,   y k + 1 ) and N k . When running CGR using a truly random generator, all the points in the geometrical shape defined by the vertices will be visited. However, if CGRS is run using a nonrandom sequence of numbers, which can be associated intuitively with a certain structure, then the visual representation will display some underlying structure in the sequence of numbers.
The data feeding the CGRS algorithm must be represented on an alphabet whose size should be equal to the number of vertices N v . Therefore, the real-valued time series should be converted into discrete symbols. A popular technique is the SAX algorithm introduced by Lin et al. [27], widely used in data mining due to the dimensionality reduction carried over the symbolic representation. SAX also allows defining a lowest bound distance measure for the original series. The SAX algorithm uses a sliding window circulating on the time axis and a division of the ordinate axis in a certain number of intervals. For each position of the window, the values of the time series are replaced by the mean values corresponding to the current position of the sliding window.
The output of the CGRS method consists of a graph P { x i , y i } located in the spatial domain D { 0 < x i < x m a x ;   0 < y i < y m a x } . The set of points P can be transformed into an image I m by superimposing a rectangular grid of size N × N on the domain D . The value of each image pixel is equal to the number of points { x i , y i } P falling inside the limits defining the image pixel ( i , j ) . Then images corresponding to different time series can be compared by means of an appropriate image similarity measure. An alternative approach is to use a graph similarity measure for comparing graphs corresponding to different time series.
The problem of deriving graph similarity measures is of key importance in structural pattern recognition. An efficient measure, the Symmetrized Normalized-Entropy-Square Variation (SNESV), has been proposed in [28]. For two graphs X ,   Y (or, in general, for two low-dimensional manifolds resulting from the commute time embedding of graphs Θ X ,   Θ Y ) the SNESV is defined by the relation:
S N E S V ( Θ X , Θ Y ) = ( H ( Θ Y ) H ( Θ X ) ) 2 H ( Θ Y ) + H ( Θ X ) = ( H ( Θ Y ) H ( Θ X ) ) 2 I ( Θ Y ,   Θ X ) + H ( Θ Y , Θ X )
where H ( . ) ,   H ( . , . ) are the Shannon and the joint entropy, respectively, and I ( . , . ) is the mutual information. The normalization by the sum of entropies is important when comparing graphs with a significantly different number of nodes.
In practical applications, the estimation of information quantities (entropy, mutual information, etc.) should be performed from the available samples. The samples are supposed to be i.i.d. drawn from a distribution that is unknown. One possible approach is to assume a certain form of the underlying distribution and to derive its parameters from the experimental samples. The strong and often questionable assumption, about the form of the probability distribution function, can be avoided by nonparametric approaches. A popular choice, initially proposed by Kozachenko and Leonenko [29], is the method based on the k-nearest neighbors (kNN) techniques [30]. Considering a graph X and the probability density p X ( X ) , the basic idea is to estimate the unknown p X ( x i ) through the k-nearest neighbors (kNN) of x i . Then the probability density and the subsequent quantities of interest are estimated based on distances (in an appropriate norm) of the samples to their k-nearest k-NN neighbors (see, e.g., [31] for a detailed example). The method proved to work well for a small fixed k (typically in the range of 4÷8) [32] providing significantly better results in comparison with other approaches like, e.g., kernel density estimator (KDE) [33] or entropy estimation using spacings [34].
An optimal choice for the estimation of SNESV is the kNN-based bypass estimator proposed by Leonenko [35], which provides the following expression of the entropy for SNESV [28]:
H ^ N , k = 1 N i = 1 N l o g { ( N 1 ) e Ψ ( k ) V d ( ρ k , N 1 ( i ) ) d }
where:
-
N is the number of samples { x 1 , , x N } X R d .
-
k the maximum number of nearest neighbors.
-
Ψ ( k ) is the digamma function: Ψ ( k ) = γ + A k 1 ,   γ = 0.5772 (Euler constant) A 0 = 0 ,   A j = i = 1 j 1 i , V d = π d 2 / Γ ( d 2 + 1 ) is the volume of the unit ball in R d and ρ k , N 1 ( i ) is the k -th nearest neighbor distance from x i to some other x j .
Leonenko’s estimator has the advantage of fast computation.

2.4. Complex Networks (CN)

The cross-visibility (CV) networks [36] extends the applicability of visibility graphs (VG) [37] to the study of coupled time series. VGs are based on the representation of time series by vertical bars, which create a landscape of peaks and valleys. Each bar corresponds to a node in the network and two nodes are connected if the corresponding bars are visible by each other, through the obstacles created by the other bars in the landscape. For the case of two time series, the CV method allows the creation of a link between nodes if the corresponding bars are reciprocally visible through the obstacles created by the shifted time series { y k } = { y k y i + x i }   [36]:
y k y i + x j x i j i ( k i ) ,         i < k < j
or
y k y i + x j x i j i ( k i ) ,         i < k < j
A weighted adjacency matrix W A M can be created for this network:
W A M i j = {   d ( y i ,   y j ) ,   i f   E q u a t i o n s   ( 18 )   o r   ( 19 )   a r e   s a t i s f i e d 0 ,   o t h e r w i s e
where d ( y i ,   y j ) is a similarity measure, between the time series segments located in between the connected nodes, for weighting the connections. It is calculated based on L p norms [38,39]:
d L p ( x , y ) [ i j ] = ( k = i j ( x k y k ) p ) 1 p
As shown in [15,40], WAM can be represented as an image and used for monitoring the complexity of the network, which is linked to the degree of coupling between time series. The image entropy H can be used to evaluate the complexity of the WAM image. For an independently evolving time series, the reciprocal visibility between two bars (corresponding to two components of the time series) is frequently limited by the obstacles created by the other time series. When coupled, the time series lean towards synchronization and the WAM image evolves toward a less random structure, characterized by lower entropy E W A M .

3. Results and Discussion

3.1. Numerical Tests

The evaluation of the efficacy of the coupling measures, based on the image representation of time series, has been performed by using the unidimensional coupled Rössler system [41,42], which generates time series characterized by a succession of regular shaped peaks, similar to those recorded in plasma instability pacing experiments. The Rössler system, frequently used in the study of dynamic coupled systems (see, e.g., [43,44]), is described by the relations:
x 1 ˙ = 0.95 x 2 x 3 x 2 ˙ = 0.95 x 1 + 0.15 x 2 x 3 ˙ = 0.2 + x 3 ( x 1 10 ) y 1 ˙ = 1.05 y 2 y 3 + C ( x 1 y 1 ) y 2 ˙ = 1.05 y 1 + 0.15 y 2 y 3 ˙ = 0.2 + y 3 ( y 1 10 )  
where C describes the coupling strength. The time series x 2 and y 2 have been used as input to the various methods. We have used SSIM index for GAF (Equation (2)), MTF (Equation (6)) and CGRS images as a coupling measure for the corresponding time series. SNSEV entropy has been used as an alternative measure in the case of CGRS represented as graphs, while the image entropy has been used for the newly introduced CMM and also for monitoring the evolution of the structure of the CV networks. The evolution of these measures when increasing the coupling factor C in the interval [0, 2], in steps of 0.01, is presented in Figure 3. We used 10,000 data points to compute the image representations and to evaluate the dependence on the coupling strength of the above-mentioned measures.
SSIM values calculated for the GAF representation lies on a quite limited range; however, the evolution with the coupling parameter is monotonic for C > 0.15 . The limited range of values can be explained by the structure of GAF images (Figure 4). Even for the case when the time series are not coupled ( C = 0 ) the images have a similar general structure, the differences lying at the level of details. For the same reason, the SSIM evolution reaches a saturation effect for C > 1 . In the case of MTF representation, the values cover a wider range but the evolution is characterized by various oscillations. The images corresponding to the driven time series (Figure 5) varies substantially with the variation of the coupling parameter. The MTF images have been obtained for a number of Q = 100 quantiles. The evolution of the absolute values of the Cross Markov Matrix entropy is characterized by both monotonicity (for C > 0.22 ) and by a wide range of variation and, therefore, it may be a good candidate for studying the lag coupling of fusion relevant time series. The evolution of the W c r o s s images towards a more structured form, with lower entropy, is illustrated in Figure 6.
The CGRS images and graphs have been constructed using a SAX algorithm with a 10 characters alphabet. An illustration is presented in Figure 7. Both SSIM and SNESV evolutions become sensitive to the increase of the coupling factor after the threshold C > 0.8 , but with significant oscillations. The graph representation seems to be more sensitive as the range of variation of SNSEV values becomes larger. In the case of complex networks, the evolution of the entropy E W A M is almost monotonic for the whole range of variation of C , with no saturation effects. The evolution of the WAM images is illustrated in Figure 8. When representing time series by cross-visibility networks, for low coupling, the reciprocal visibility between two bars is frequently limited by the obstacles created by the other time series. For stronger coupling, the time series becomes increasingly synchronized and the WAM image evolves into a less random structure, characterized by lower entropy.

3.2. Experiments

The discharges considered for this study are the same as in [7] in order to allow a comparison of the methods analyzed in these two papers. For these pulses, covering both L and H confinement modes, a central hydrogen minority ICRH, in the range of 3–4 MW with a modulation frequency of f = 5 Hz, was used and the H-mode discharges had approximately 10 MW of NBI applied to the plasma.
For each pulse, the time lag between the ICRH power and central electron temperature time series has been varied in the interval [0, 120] ms, in steps of 1 ms. The variation of each coupling measure has been recorded and the position of the main peak has been used to determine the time lag for which the pacing reaches its maximum efficiency. An illustrative example is presented in Figure 9 for JET pulse #89826. GAF and CMM methods capture the main tendency in the evolution of the coupling between the two time series providing a smooth curve. SNSEV and WAM profiles show various oscillations. The position of the main peak corresponds with those given by GAF and CMM methods. The MTF curve is characterized by significant spurious oscillations and the determination of the position of the main peak is ambiguous. In Figure 9, two different positions have been obtained when fitting the points located around the maximum values with a Gaussian or fitting the whole curve with a four-degree polynomial. In the case of the CMM method, introduced in this paper, Figure 10 shows the evolution of the W c r o s s image for various values of the time lag. The image corresponding to the time lag for which the W c r o s s entropy has its maximum absolute value marked by a red border and it clearly shows a more structured and sharper form.
The observations made for the JET pulse #89826 remain valid in general also for the other three pulses included in this study: #89822, #90005 and #90006. The time lag values, for which the various indicators reach their maximum, are listed in Table 1. This table shows also the values obtained with the methods reported in [7]. GAF, CMM and CN estimates are in good agreement with these values. Only in one case, for each method, the time lag value corresponding to the maximal coupling lies outside the interval given by the confidence interval reported in [7] but the difference is only of 2 ms (approx. 4%). In the case of the CGRS method, the differences increase by up to 8%. For the MTF method, the discrepancy increases significantly.
The present estimates can be compared also to the slowing-down time of the ions, shown in the last column in Table 1; the large uncertainty of these values reflect the strong variations of the central electron temperature during a sawtooth cycle. It can be observed that the causal influence of the ICRH on the sawteeth is estimated to occur in a time period, which agrees very well with the slowing-down time of the ions. This is in favor of the interpretation that the main factor in the pacing scheme is the stabilization effect of the fast particles.

4. Conclusions

A typical difficulty of the experiments, aimed at sawtooth pacing by modulating the ICRH power, is their reliable interpretation. The evaluation of the number of sawteeth effectively triggered by the intentional ICRH power modulations is not a simple task, since sawteeth are quasiperiodic and, therefore, if enough time is allowed to elapse, they would occur almost always after a notch in the RF. The determination, on the basis of time series analysis, of the time horizon over which the ICRH power modulations are effective in triggering the instabilities, could be a solution to this problem.
In this paper, a group of methods, based on the image representation of time series, has been introduced for the assessment of the pacing technique. A series of numerical tests have shown the potential of the three techniques to determine the time interval over which a causal-effect relationship takes place. The application to JET experiments shows that three methods give quite coherent results and in good agreement with the values obtained by other techniques, based on different principles [7]: the method based on the Gramian Angular Field representation; a variation of the Markov transition matrix defined for a pair of time series; a method which uses the time series transformation into a cross-visibility network whose adjacency matrix is represented as an image. The approach based on the chaos game representation has the advantage of a fast computation but its confidence intervals are larger. The small discrepancies between the estimates of the various methods can be interpreted as the confidence intervals in the results. From a physical point of view, the methods support the interpretation that the fast ions play a fundamental role in the stabilization of the sawteeth, in both L and H mode.
Significant future work will be dedicated to testing the applicability of these methods to other coupled dynamical systems, involving different complicated phenomena and characterized by full chaotic behavior. Sophisticated techniques for the generation of numerical time series [45], and applications coming from various domains (e.g., climatology, financial, etc.), should be addressed in order to obtain a comprehensive understanding of the efficiency of these methods.

Author Contributions

Conceptualization, T.C. and A.M.; methodology, T.C. and A.M.; Pacing experiments conceptualization and methodology, E.L.; software, T.C. and M.G.; validation, M.G.; writing—original draft preparation, T.C.; writing—review and editing, T.C. and A.M. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by EUROfusion, grant number 633053 and Romanian National ‘Nucleu’ Program LAPLAS VI—contract n. 16N/201.

Acknowledgments

This work has been carried out within the framework of the EUROfusion Consortium and has received funding from the Euratom research and training program 2014–2018 and 2019–2020 under grant agreement No 633053. The views and opinions expressed herein do not necessarily reflect those of the European Commission. The work of one of the authors (T.C.) has been supported also by the Romanian Ministry of Education and Research, under Romanian National ‘Nucleu’ Program LAPLAS VI—contract n. 16N/2019.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Wesson, J. Tokamaks, 3rd ed.; Clarendon Press Oxford: Oxford, UK, 2004. [Google Scholar]
  2. Lang, P.T.; Alonso, A.; Alper, B.; Belonohy, E.; Boboc, A.; Devaux, S.; Eich, T.; Frigione, D.; Gál, K.; Garzotti, L.; et al. ELM pacing investigations at JET with the new pellet launcher. Nucl. Fusion 2011, 51, 033010. [Google Scholar] [CrossRef] [Green Version]
  3. Lerche, E.; Lennholm, M.; Carvalho, I.S.; Dumortier, P.; Durodie, F.; Van Eester, D.; Graves Jacquet, J.P.; Murari, A. Sawtooth pacing with on-axis ICRH modulation in JET-ILW. Nucl. Fusion 2017, 57, 036027. [Google Scholar] [CrossRef] [Green Version]
  4. Coufal, D.; Jakubík, J.; Jajcay, N.; Hlinka, J.; Krakovská, A.; Paluš, M. Detection of coupling delay: A problem not yet solved. Chaos 2017, 27, 083109. [Google Scholar] [CrossRef]
  5. Krakovská, A.; Jakubík, J.; Chvosteková, M.; Coufal, D.; Jajcay, N.; Paluš, M. Comparison of six methods for the detection of causality in a bivariate time series. Phys. Rev. E 2018, 97, 042207. [Google Scholar] [CrossRef]
  6. Murari, A.; Craciunescu, T.; Peluso, E.; Gelfusa, M.; Lungaroni, M.; Garzotti, L.; Frigione, D.; Gaudio, P. How to assess the efficiency of synchronization experiments in tokamaks. Nucl. Fusion 2016, 56, 076008. [Google Scholar] [CrossRef]
  7. Murari, A.; Craciunescu, T.; Peluso, E.; Lerche, E.; Gelfusa, M. On efficiency and interpretation of sawteeth pacing with on-axis ICRH modulation in JET. Nucl. Fusion 2017, 57, 126057. [Google Scholar] [CrossRef] [Green Version]
  8. Murari, A.; Craciunescu, T.; Peluso, E.; Gelfusa, M. Detection of Causal Relations in Time Series Affected by Noise in Tokamaks Using Geodesic Distance on Gaussian Manifolds. Entropy 2017, 19, 569. [Google Scholar] [CrossRef] [Green Version]
  9. Shneiderman, B. Inventing discovery tools: Combining information visualization with data mining. Inf. Vis. 2002, 1, 5–12. [Google Scholar] [CrossRef]
  10. Wattenberg, M. Arc Diagrams: Visualizing Structure in Strings. In Proceedings of the IEEE Symposium on Information Visualization, Boston, MA, USA, 28–29 October 2002; pp. 110–116. [Google Scholar]
  11. Lin, J.; Keogh, E.; Lonardi, S.; Lankford, J.P.; Nystrom, D.M. Visually Mining and Monitoring Massive Time Series. In Proceedings of the tenth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Seattle, WA, USA, 22–25 August 2004; pp. 460–469. [Google Scholar] [CrossRef] [Green Version]
  12. Weber, M.; Alexa, M.; Mueller, W. Visualizing Time-Series on Spirals. In Proceedings of the IEEE Symposium on Information Visualization INFOVIS 2001, San Diego, CA, USA, 22–23 October 2001. [Google Scholar] [CrossRef]
  13. Wang, Z.; Oates, T. Encoding Time Series as Images for Visual Inspection and Classification Using Tiled Convolutional Neural Networks. In Trajectory-Based Behavior Analytics; Technical Report/Association for the Advancement of Artificial Intelligence WS; AAAI Press: Palo Alto, CA, USA, 2015; pp. 40–46. [Google Scholar]
  14. Kumar, N.; Lolla, V.N.; Keogh, E.J.; Lonardi, S.; Ratamanahatana, C.A. Time-series Bitmaps: A Practical Visualization Tool for Working with Large Time Series. In Proceedings of the 2005 SIAM International Conference on Data Mining, SDM 2005, Newport Beach, CA, USA, 21–23 April 2005; pp. 531–535. [Google Scholar] [CrossRef] [Green Version]
  15. Craciunescu, T.; Murari, A.; Gelfusa, M. Improving Entropy Estimates of Complex Network Topology for the Characterization of Coupling in Dynamical Systems. Entropy 2018, 20, 891. [Google Scholar] [CrossRef] [Green Version]
  16. Hatami, N.; Gavet, Y.; Debayle, J. Bag of recurrence patterns representation for time-series classification. Pattern Anal. Applic. 2019, 22, 877–887. [Google Scholar] [CrossRef] [Green Version]
  17. Marwan, N.; Romano, M.C.; Thiel, M.; Kurths, J. Recurrence plots for the analysis of complex systems. Phys. Rep. 2007, 438, 237–329. [Google Scholar] [CrossRef]
  18. Zhang, Y.; Jin, R.; Zhou, Z. Understanding bag-of-words model: A statistical framework. Int. J. Mach. Learn. Cyber. 2010, 1, 43–52. [Google Scholar] [CrossRef]
  19. Zhang, Y.; Chen, X. Motif Difference Field: A Simple and Effective Image Representation of Time Series for Classification. arXiv 2020, arXiv:2001.07582. [Google Scholar]
  20. Lowe, D. Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 2004, 60, 91–110. [Google Scholar] [CrossRef]
  21. Dalal, N.; Triggs, B. Histograms of oriented gradients for human detection. In Proceedings of the 2005 IEEE computer society conference on computer vision and pattern recognition (CVPR), San Diego, CA, USA, 20–26 June 2005. [Google Scholar]
  22. Ojala, T.; Pietikainen, M.; Maenpaa, T. Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. TPAMI 2002, 7, 971–987. [Google Scholar] [CrossRef]
  23. Jastrzebska, A. Time series classification through visual pattern recognition. J. King Saud Univ. Comput. Inf. Sci. 2019. [Google Scholar] [CrossRef]
  24. Wang, Z.; Bovik, A.C.; Sheikh, H.R.; Simoncelli, H.R. Image quality assessment: From error visibility to structural similarity. IEEE Trans. Image Process. 2004, 13, 600–612. [Google Scholar] [CrossRef] [Green Version]
  25. Campanharo, A.S.; Sirer, M.I.; Malmgren, R.D.; Ramos, F.M.; Amaral, L.A.N. Duality between time series and networks. PLoS ONE 2011, 6, e23378. [Google Scholar] [CrossRef] [Green Version]
  26. Jeffrey, H.J. Chaos game representation of gene structure. Nucleic Acids Res. 1990, 18, 2163–2170. [Google Scholar] [CrossRef] [Green Version]
  27. Lin, J.; Keogh, E.; Lonardi, S.; Chiu, B. A Symbolic Representation of Time Series, with Implications for Streaming Algorithms. In Proceedings of the eighth ACM SIGMOD Workshop on Research Issues in Data Mining and Knowledge Discovery, San Diego, CA, USA, 14–19 June 2003; ISBN 978-1-4503-7422-4. [Google Scholar]
  28. Escolano, F.; Hancock, E.; Lozano, M. Graph matching through entropic manifold alignment. In Proceedings of the Conference on Computer Vision and Pattern Recognition (CVPR), Providence, RI, USA, 20–25 June 2011. [Google Scholar] [CrossRef] [Green Version]
  29. Kozachenko, L.F.; Leonenko, N.N. Sample estimate of the entropy of a random vector. Probl. Peredachi Inf. 1987, 23, 9–16. [Google Scholar]
  30. Kraskov, A.; Stögbauer, H.; Grassberger, H. Erratum: Estimating mutual information [Phys. Rev. E 69, 066138 (2004)]. Phys. Rev. E 2011, E 83, 019903. [Google Scholar] [CrossRef] [Green Version]
  31. Lombardi, D.; Pant, S. Nonparametric k-nearest-neighbor entropy estimator. Phys. Rev. 2016, E 93, 013310. [Google Scholar]
  32. Gao, W.; Oh, S.; Viswanath, P. Demystifying Fixed k -Nearest Neighbor Information Estimators. IEEE Trans. Inf. Theory 2008, 64, 5629–5661. [Google Scholar] [CrossRef] [Green Version]
  33. Paninski, L.; Yajima, M. Undersmoothed kernel entropy estimators. IEEE Trans. Inf. Theory 2008, 54, 4384–4388. [Google Scholar] [CrossRef]
  34. Ver Steeg, G.; Galstyan, A. Discovering structure in high-dimensional data through correlation explanation. In Advances in Neural Information Processing Systems, Proceedings of the Annual Conference on Neural Information Processing Systems 2014, Montreal, QC, Canada, 8–13 December 2014; Massachusetts Institute of Technology Press: Cambridge, MA, USA, 2014; pp. 577–585. [Google Scholar]
  35. Leonenko, N.; Pronzato, L.; Savani, V. A class of renyi information estimators for multidimensional densities. Ann. Stat. 2008, 36, 2153–2182. [Google Scholar] [CrossRef]
  36. Mehraban, S.; Shirazi, A.H.; Zamani, M.; Jafari, G.R. Coupling between time series: A network view. EPL 2015, 103, 50011. [Google Scholar] [CrossRef] [Green Version]
  37. Lacasa, L.; Luque, B.; Ballesteros, F.; Luque, J.; Nun, J.C. From time series to complex networks: The visibility graph. PNAS 2008, 105–113, 4972–4975. [Google Scholar] [CrossRef] [Green Version]
  38. Ding, H.; Trajcevski, G.; Scheuermann, P.; Wang, X.; Keogh, E. Querying and Mining of Time Series Data: Experimental Comparison of Representations and Distance Measures. In Proceedings of the VLDB Endowment, Auckland, New Zealand, 24–30 August 2008; Volume 1, pp. 1542–1552. [Google Scholar]
  39. Iglesias, F.; Kastner, W. Analysis of Similarity Measures in Times Series Clustering for the Discovery of Building Energy Patterns. Energies 2013, 6, 579–597. [Google Scholar] [CrossRef] [Green Version]
  40. Craciunescu, T.; Murari, A.; Gelfusa, M. Causality Detection Methods Applied to the Investigation of Malaria Epidemics. Entropy 2019, 21, 784. [Google Scholar] [CrossRef] [Green Version]
  41. Rössler, O.E. An Equation for Continuous Chaos. Phys. Lett. 1976, 57A-5, 397–398. [Google Scholar] [CrossRef]
  42. Mormann, F.; Lehnertz, K.; David, P.; Elger, C.E. Mean phase coherence as a measure for phase synchronization and its application to the EEG of epilepsy patients. Physica D 2000, 144, 358–369. [Google Scholar] [CrossRef]
  43. Kreuz, T.; Mormann, F.; Andrzejak, R.G.; Kraskov, A.; Lehnertz, K.; Grassberger, P. Measuring synchronization in coupled model systems: A comparison of different approaches. Physica D 2007, 225, 29–42. [Google Scholar] [CrossRef]
  44. Janjarasjittab, S.; Loparo, K.A. An approach for characterizing coupling in dynamical systems. Physica D 2008, 237, 2482–2486. [Google Scholar] [CrossRef]
  45. Pano-Azucena, A.D.; Tlelo-Cuautle, E.; Tan, S.X.-D.; Ovilla-Martinez, B.; De la Fraga, L.G. FPGA-Based Implementation of a Multilayer Perceptron Suitable for Chaotic Time Series Prediction. Technologies 2018, 6, 90. [Google Scholar] [CrossRef] [Green Version]
Figure 1. An example of the time series obtained in sawteeth pacing with Ion Cyclotron Radiofrequency Heating (ICRH) modulation in the JET-ILW L mode discharge #89826. The ICRH power time series is presented in the top plot while the central electron temperature, influenced by the sawteeth, is shown in the bottom plot. The frequency of the modulation is 5 Hz (150 ms on and 50 ms off). The maximum power is 4 MW in a minority heating scheme with 4% of H in D. The sampling frequency in the sawteeth time series is 10−6 s.
Figure 1. An example of the time series obtained in sawteeth pacing with Ion Cyclotron Radiofrequency Heating (ICRH) modulation in the JET-ILW L mode discharge #89826. The ICRH power time series is presented in the top plot while the central electron temperature, influenced by the sawteeth, is shown in the bottom plot. The frequency of the modulation is 5 Hz (150 ms on and 50 ms off). The maximum power is 4 MW in a minority heating scheme with 4% of H in D. The sampling frequency in the sawteeth time series is 10−6 s.
Entropy 22 00775 g001
Figure 2. Illustration of the construction of a new time series by the intercalated merge of a pair of time series. The graphs have been obtained using a Rössler coupled system and two different values of the coupling parameter. The driver is the blue curve and the target the green one. In the case of the left plot the coupling is zero, while in the right plot the coupling coefficient is set to C = 0.5.
Figure 2. Illustration of the construction of a new time series by the intercalated merge of a pair of time series. The graphs have been obtained using a Rössler coupled system and two different values of the coupling parameter. The driver is the blue curve and the target the green one. In the case of the left plot the coupling is zero, while in the right plot the coupling coefficient is set to C = 0.5.
Entropy 22 00775 g002
Figure 3. The evolution of the coupling measures with the coupling strength for the Rössler system: Structural Similarity Index (SSIM) calculated for Gramian Angular Field (GAF) images (top-left), SSIM calculated for Markov Transition Field (MTF) images (top-right), absolute value of the W c r o s s image entropy (middle-left), SSIM calculated for the CGRS images (middle-right), SNSEV entropy for the CGRS graphs (bottom-left) and absolute value of the WAM image entropy (bottom-right). The absolute values of the entropies (SNSEV, E c r o s s and E W A M ) are normalized to their maximum value.
Figure 3. The evolution of the coupling measures with the coupling strength for the Rössler system: Structural Similarity Index (SSIM) calculated for Gramian Angular Field (GAF) images (top-left), SSIM calculated for Markov Transition Field (MTF) images (top-right), absolute value of the W c r o s s image entropy (middle-left), SSIM calculated for the CGRS images (middle-right), SNSEV entropy for the CGRS graphs (bottom-left) and absolute value of the WAM image entropy (bottom-right). The absolute values of the entropies (SNSEV, E c r o s s and E W A M ) are normalized to their maximum value.
Entropy 22 00775 g003
Figure 4. GAF image of the driver time series x 2 (left) and of the driven time series y 2 for C = 0 (middle) and C = 2 (left).
Figure 4. GAF image of the driver time series x 2 (left) and of the driven time series y 2 for C = 0 (middle) and C = 2 (left).
Entropy 22 00775 g004
Figure 5. MTF image of the driver time series x 2 (top) and of the driven time series y 2 for C = 0 ,   0.65 ,   1.35 (bottom, from left to right).
Figure 5. MTF image of the driver time series x 2 (top) and of the driven time series y 2 for C = 0 ,   0.65 ,   1.35 (bottom, from left to right).
Entropy 22 00775 g005
Figure 6. The evolution of the W c r o s s images with the coupling parameter. Top row show the images for C = 0 (left) and C = 0.5 (right) and the bottom row shows the values for C = 1.0 (left), C = 1.5 (middle) and C = 2 (right).
Figure 6. The evolution of the W c r o s s images with the coupling parameter. Top row show the images for C = 0 (left) and C = 0.5 (right) and the bottom row shows the values for C = 1.0 (left), C = 1.5 (middle) and C = 2 (right).
Entropy 22 00775 g006
Figure 7. CGRS graph for the driver time series x 2 (left) and for the driven time series y 2 for C = 0 (middle) and C = 2 (right). The graph has been generated using an alphabet with 10 symbols so all the points of the graph are inside the decagon drawn in red.
Figure 7. CGRS graph for the driver time series x 2 (left) and for the driven time series y 2 for C = 0 (middle) and C = 2 (right). The graph has been generated using an alphabet with 10 symbols so all the points of the graph are inside the decagon drawn in red.
Entropy 22 00775 g007
Figure 8. WAM images for C = 0 (top-left), C = 0.5 (top-right) and C = 1 (bottom).
Figure 8. WAM images for C = 0 (top-left), C = 0.5 (top-right) and C = 1 (bottom).
Entropy 22 00775 g008
Figure 9. The time-lagged evolution of the coupling measures for the JET discharge #89826: SSIM calculated for GAF images (top-left), SSIM calculated for MTF images (top-right), absolute value of the CMM W c r o s s image entropy (middle-left), SNSEV entropy for the CGRS graphs (middle-right) and the absolute values of the WAM image entropy (bottom-left). The absolute values of the entropies (SNSEV, E c r o s s and E W A M ) are normalized to their maximum value. The Gaussian fit of the peaks is reported in red. For the case of SSIM-MTF an alternative fit (reported in blue) has been performed using a 4-th order polynomial and all the points of the plot.
Figure 9. The time-lagged evolution of the coupling measures for the JET discharge #89826: SSIM calculated for GAF images (top-left), SSIM calculated for MTF images (top-right), absolute value of the CMM W c r o s s image entropy (middle-left), SNSEV entropy for the CGRS graphs (middle-right) and the absolute values of the WAM image entropy (bottom-left). The absolute values of the entropies (SNSEV, E c r o s s and E W A M ) are normalized to their maximum value. The Gaussian fit of the peaks is reported in red. For the case of SSIM-MTF an alternative fit (reported in blue) has been performed using a 4-th order polynomial and all the points of the plot.
Entropy 22 00775 g009
Figure 10. The evolution of the W c r o s s images for different time lag values. The top row shows the images for t = 0   ms (left) and t = 0.025 ms (middle) and t = 0.052   ms. The bottom row shows the values for t = 0.075   ms (left), t = 0.100   ms (middle) and t = 0.120 ms (right). The image for which the absolute value of Wcross entropy reaches its maximum is marked by a red border.
Figure 10. The evolution of the W c r o s s images for different time lag values. The top row shows the images for t = 0   ms (left) and t = 0.025 ms (middle) and t = 0.052   ms. The bottom row shows the values for t = 0.075   ms (left), t = 0.100   ms (middle) and t = 0.120 ms (right). The image for which the absolute value of Wcross entropy reaches its maximum is marked by a red border.
Entropy 22 00775 g010
Table 1. Time lag values for maximum coupling between the ICRH and electron temperature time series. The first column reports the shot number and the second the confinement regime (L or H). For each indicator, the following columns provide the estimated time corresponding to the maximum causal influence. The penultimate column shows the values’ interval reported in [7]. The last column reports the slowing-down time of the minority (hydrogen) ions. When the values of the indicators lie in the interval reported in [7] they are marked by bold numbers. The uncertain values and the values located outside the confidence interval of the ions’ slowing-down times are marked with italic numbers.
Table 1. Time lag values for maximum coupling between the ICRH and electron temperature time series. The first column reports the shot number and the second the confinement regime (L or H). For each indicator, the following columns provide the estimated time corresponding to the maximum causal influence. The penultimate column shows the values’ interval reported in [7]. The last column reports the slowing-down time of the minority (hydrogen) ions. When the values of the indicators lie in the interval reported in [7] they are marked by bold numbers. The uncertain values and the values located outside the confidence interval of the ions’ slowing-down times are marked with italic numbers.
Pulse NumberRegimeGAF (ms)MTF (ms)CMM (ms)CGRS (ms)CN (ms)Time of Maximum Causal Influence Reported in [7] (ms) Slowing-Down Time of the Ions (ms)
89822L5257524850[52, 54]50 (+/−10)
89826L5150/56525051[52, 54]50 (+/−10)
90005H7496736470[68, 72]80 (+/−20)
90006H85102/108878189[85, 95]80 (+/−20)

Share and Cite

MDPI and ACS Style

Craciunescu, T.; Murari, A.; Lerche, E.; Gelfusa, M.; JET Contributors. Image-Based Methods to Investigate Synchronization between Time Series Relevant for Plasma Fusion Diagnostics. Entropy 2020, 22, 775. https://0-doi-org.brum.beds.ac.uk/10.3390/e22070775

AMA Style

Craciunescu T, Murari A, Lerche E, Gelfusa M, JET Contributors. Image-Based Methods to Investigate Synchronization between Time Series Relevant for Plasma Fusion Diagnostics. Entropy. 2020; 22(7):775. https://0-doi-org.brum.beds.ac.uk/10.3390/e22070775

Chicago/Turabian Style

Craciunescu, Teddy, Andrea Murari, Ernesto Lerche, Michela Gelfusa, and JET Contributors. 2020. "Image-Based Methods to Investigate Synchronization between Time Series Relevant for Plasma Fusion Diagnostics" Entropy 22, no. 7: 775. https://0-doi-org.brum.beds.ac.uk/10.3390/e22070775

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop