Next Article in Journal
Data-Driven Voltage Prognostic for Solid Oxide Fuel Cell System Based on Deep Learning
Previous Article in Journal
Intake System Performance Stability as a Function of Flow Throttling
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Multivariate Empirical Mode Decomposition and Recurrence Quantification for the Multiscale, Spatiotemporal Analysis of Electricity Demand—A Case Study of Japan

Department of Management Science and Technology, Graduate School of Engineering, Tohoku University, Sendai 980-8579, Japan
*
Author to whom correspondence should be addressed.
Submission received: 29 July 2022 / Revised: 23 August 2022 / Accepted: 25 August 2022 / Published: 29 August 2022

Abstract

:
In the new energy systems’ modeling paradigm with high temporal and spatial resolutions, the complexity of renewable resources and demand dynamics is a major obstacle for the scenario analysis of future energy systems and the design of sustainable solutions. Most advanced models are indeed currently restricted by past temporal energy demand data, improper for the analysis of future systems and often insufficient in terms of quantity or spatial resolution. A deeper understanding on energy demand dynamics is thus necessary to improve energy system models and expand their possibilities. The present study introduces noise-assisted multivariate empirical mode decomposition and recurrence quantification analysis for the study of this problematic variable with a case study of Japan’s electricity demand data per region. These tools are adapted to nonlinear, complex systems’ data and are already applied in a wide range of scientific fields including climate studies. The decomposition of electricity demand as well as the detection of irregularities in its dynamics allow to identify relations with temperature variations, demand sector shares, life style and local culture at different temporal scales.

1. Introduction

The optimization of energy systems is one of the great challenges of this century to mitigate climate change. To this end, researchers of the field rely on models to search for efficient alternative designs and study various evolution scenarios [1]. These models are built from our extensive knowledge of the energy supply chains and transformation technologies as their architects, and hence the most studied and accepted solutions so far are focused on the energy systems’ structure, such as sector coupling [2,3,4,5] or spatial interconnections reinforcement [3,6,7]. However, these models remain limited by parameters with high uncertainty due to the complex nature of underlying processes, such as the variations of renewable resources and energy demand with time and space, or the market behavior. Indeed, the multitude of actors distributed in social, environmental, economical and political groups makes energy systems examples of complex systems [8,9]. Such systems are known to evolve in an unpredictable, nonlinear fashion due to the adaptation and self-organization of agents from the bottom-up without centralized control, which makes them particularly difficult to study with classical linear approaches.
The strategy to manage this complexity so far has been to rely on assumptions to aggregate problematic variables at the cost of ignoring the system’s dynamics and diversity, such as the total energy production and demand per country and year, or the energy demand division in industrial, commercial and residential sectors based on social criteria. Recent data with higher resolution, especially on the supply side with weather re-analysis data, have enabled the development of models such as dynamical networks [10,11] or agents models [12,13,14], some allowing to study more complex solutions such as demand-side management [15,16], peer-to-peer energy sharing [17,18], or policy making [19,20]. However, the demand dynamics and its dependence with environmental conditions, local culture and economical situation, or the spatial distribution of consumers from different sectors is still obscure, so modelers have to rely on assumptions to estimate missing data, based, for example, on the prorated disaggregation of global demand or extrapolation from short time averages. Furthermore, scenario analysis is limited, as data are bounded to current energy systems and environmental conditions.
Analysis tools from nonlinear and complexity science could help improve our understanding of these complex parameters’ dynamics from the currently limited data samples in order to more accurately consider them for better modeling, scenario building and long-term energy planning. Nonlinear and complexity science have long benefited from their interdisciplinary dimension to establish these analysis techniques based on data, as well as experimental and numerical platforms from various fields. They are designed to extract features and patterns or detect anomalies and transitions from data containing a large amount of information and/or having underlying nonlinear processes with limited a priori knowledge. A typical example well studied in energy systems is the clustering problem of consumers with similar demand profiles [21,22], which could ultimately replace or complement energy demand sectors in the design process.
Decomposition is used to disaggregate complex signals, often by frequencies, into simpler components to interpret them separately and identify intrinsic relations. It is particularly useful and adequate for meteorological and energy demand time series, as they are signals with dynamical components at multiple scales, and has already been applied as input for machine learning forecasting and clustering models, resulting in improved prediction accuracy [23]. Seasonal decomposition [24,25], Fourier transform [26,27], and wavelet transform [28,29] have so far been the standard approaches for this purpose, but they are affected by non-negligible limitations when applied on complex signals [30]: seasonal decomposition requires the a priori selection of a single scale (or season) of interest through the moving average window length; Fourier transform considers a basis of fixed functions not suitable for the analysis of intermittent or nonstationary data; and wavelet transform relies on the choice of a wavelet. Furthermore, the integration over time results in a loss of information on the temporality of analysis results. Recently, empirical mode decomposition was suggested as an alternative due to its advantages of being data-driven and adaptative, making it suited to nonlinear and nonstationary signals [31,32]. It still, however, suffers from artificial mode mixing or splitting, and from the fact that the number and scale of the resulting intrinsic mode functions (IMFs) depend on the data. The IMFs obtained from multi-channel signals are thus not comparable. Variants of EMD have been developed to mitigate these problems, such as ensemble empirical mode decomposition (EEMD), complete ensemble empirical mode decomposition (CEEMD), and multivariate empirical mode decomposition (MEMD) [33]. The latter is capable of producing mode-aligned IMFs from multi-channels signals and efficiently prevents artificial mode mixing with the addition of noise channels as a decomposition reference (Noise-Assisted MEMD).
Recurrence plots (RPs) and recurrence quantification analysis (RQA) paired with complex network analysis tools are other analysis techniques which have rapidly drawn increasing interest over the past decade and are now widely used to study systems’ dynamical states and transitions, measure synchronization, or evaluate dynamical invariants [34,35]. They have demonstrated their usefulness in the analysis of climate data, revealing hidden periods and transitions in wind time series [36] with seasonal differences in the dynamics impacting its predictability [37], the interdependence of climate data over large periods [38], as well as in power systems stability analysis [39]. These methods have still not been applied to the analysis of energy demand time series, or the intermittent generation from renewable resources with technical considerations, such as power curves and curtailment, to our knowledge.
The present study introduces MEMD and RQA for the analysis of energy demand variations with time and differences due to regions’ characteristics with the case study of electricity demand in Japan. This country is characterized by its variety of environmental and climate conditions, having an impact on the local energy demand [40], as well as by recurrently suffering from catastrophic events, such as earthquakes and typhoons. We demonstrate here the ability of these techniques to accurately capture these features from regional electricity demand time series and use them to discover and interpret hidden demand patterns at different temporal scales that could not be obtained with the traditional statistical approach.

2. Materials and Methods

2.1. Data

We consider the electricity demand provided by the 10 major energy carriers covering the regions, shown in Figure 1 [41]. It is calculated as the sum of the output electricity from each production company’s generators adjusted by the power exchanges with other regions and does not include the self-consumption at power stations or from rooftop solar PV. The data have one hour resolution over the period from 1 April 2016 to 31 October 2020 and are shown in Figure 2. The electricity demand in Hokkaido dropped in September 2018 due the strong earthquake that caused a blackout. Although some differences can be noticed in the demand of each region, the time series appear too complex to analyze in this shape. We describe in the following sections the methodology to decompose them into simpler components.
In order to interpret the various patterns observed at different temporal scales after decomposition, we pair the results with historical temperature data impacting the heat demand, as well as the annual share of electricity demand divided in industrial, commercial, and residential sectors. The temperature data are obtained from the Japan Meteorological Agency Numerical Weather Prediction Meso-Scale Model with 5 km meshes and 1 h resolution [42]. The model provides weather forecasts every 3 h, so the data are organized in series of initial values every three hours filled with forecast values [43]. The spatial average is calculated to obtain the single temperature time series for each region. The electricity demand sectors share are obtained from the energy statistics data provided by the Japan Ministry of Economy, Trade and Industry [44]. Results are summarized in Table 1 for the year 2015. These values are mostly unchanged in following years.

2.2. Empirical Mode Decomposition

Empirical mode decomposition (EMD) is a data-driven method to decompose a signal into its components at different time scales called intrinsic mode functions (IMFs). It works as a recursive nonlinear filter, which makes it adapted to nonlinear and nonstationary signals and allows for a precise definition of amplitude and frequency at the highest level of resolution, as it is not based on a temporal integration as the seasonal decomposition, Fourier transform or wavelet transform. The procedure to extract IMFs is described in Algorithm 1. Here, the stopping criterion is a critical parameter, as a too-small number of iterations for each IMF extraction (also called sifting) results in modes with artificial extrema, while a too-large number of iterations causes the smoothing of the modes amplitude. Several possibilities have been suggested for this criterion [45]. Here, we chose the standard stopping criterion specified in [46].
Algorithm 1 Empirical mode decomposition (EMD).
1:
Set the initial residue of signal to decompose x ( t ) as r ( t ) = x ( t ) and i = 1 ;
2:
Identify the local maxima and minima of r ( t ) ;
3:
Evaluate the upper and lower envelopes u ( t ) and l ( t ) by interpolating the local maxima and minima with a cubic spline;
4:
Calculate the mean of u ( t ) and l ( t ) as a ( t ) = [ u ( t ) + l ( t ) ] / 2 ;
5:
Let r ( t ) = r ( t ) a ( t ) and repeat 2 to 4 until a stopping criterion is reached;
6:
Extract the ith IMF as I M F i = r ( t ) ;
7:
Let r ( t ) = x ( t ) j = 1 i I M F j ;
8:
Increment i and repeat 2 to 7 until r ( t ) becomes a monotonic function.
Despite its advantages over other decomposition methods based on time integration and convolution, EMD suffers from several limitations, such as mode mixing or boundary distortions caused by the misidentification of end points as the local extrema. Moreover, it is not adapted to multivariate signals, as the IMFs obtained independently on different time series are not mode aligned.

2.3. Noise-Assisted Multivariate Empirical Mode Decomposition

Multivariate extensions of EMD have been proposed to extend the applications of EMD to signals with multiple channels [33]. The idea is to project the time series with p dimensions along a set of V vectors which points are on a p-dimensional hypersphere generated with a low-discrepancy Hammersley sequence. After estimating the upper and lower envelopes for each projection u v ( t ) v = 1 V and l v ( t ) v = 1 V from their local extrema, the unique mean is obtained as a ( t ) = 1 2 V v = 1 V u v ( t ) + l v ( t ) . The extraction process of IMFs is then similar to standard EMD. The complete procedure is described in Algorithm 2. In order to obtain meaningful IMFs, the number of directions vectors V should be much greater than p. Adding Gaussian noise channels to the multivariate signal before decomposition (noise-assisted multivariate EMD, or NA-MEMD) also demonstrated to efficiently reduce the overlapping and mixing of modes [47].
Algorithm 2 Multivariate empirical mode decomposition (MEMD).
1:
Generate V direction vectors based on a pointset on a p-dimensional hypersphere generated with a low-discrepancy Hammersley sequence;
2:
Set the initial residue of p-dimensional signal to decompose x ( t ) as r ( t ) = x ( t ) and i = 1 ;
3:
Get the projections set P v ( t ) v = 1 V of r ( t ) along each vector V;
4:
Identify the local maxima and minima of P v ( t ) v = 1 V ;
5:
Evaluate the upper and lower envelopes for each projection u v ( t ) v = 1 V and l v ( t ) v = 1 V by interpolating the local maxima and minima with a cubic spline;
6:
Calculate the mean of u v ( t ) and l v ( t ) as a ( t ) = 1 2 V v = 1 V u v ( t ) + l v ( t ) ;
7:
Let r ( t ) = r ( t ) a ( t ) and repeat 3 to 6 until a stopping criterion is reached;
8:
Extract the ith IMF as I M F i = r ( t ) ;
9:
Let r ( t ) = x ( t ) j = 1 i I M F j ;
10:
Increment i and repeat 3 to 9 until r ( t ) becomes a monotonic function.

2.4. Recurrence Analysis

Recurrence is an inherent property of dynamical systems and, as such, an important aspect to their study. The state of a system is said to be recurrent when its trajectory revisits a region of the phase space. One can keep track of these recurring states by building a thresholded pairwise distance matrix as
R i j = Θ ϵ z i z j , i , j = 1 , , N ,
where z is the position of each N points of the time series in the phase space, ϵ is the threshold distance from which the states are close enough to be considered recurrent, and Θ is the Heaviside step function. The analysis of the structures in this binary matrix, also called recurrence plot, allows to characterize the system’s behavior qualitatively and quantitatively through recurrence quantification analysis measures (RQA) [34]. For example, diagonal recurrent lines parallel to the LOI represent a periodicity in the system of which state is recurrent at regular time intervals, while vertical and horizontal recurrent lines show a stationary state. One can then measure, for example, the systems determinism D E T and laminarity L A M as the percentage of recurrence points forming diagonal and vertical/horizontal lines,
D E T = d = d m i n N d P ( d ) d = 1 N d P ( d ) ,
L A M = v = v m i n N v P ( v ) v = 1 N v P ( v ) ,
with P, the histogram of lengths, d and v, the diagonal and vertical lines, and d m i n and v m i n , the minimum lengths. Other recurrence quantifications include dynamical invariants, such as entropy or the correlation dimension, as well as measures from graph theory based on the interpretation of the recurrence matrix as the connectivity matrix of a complex network [35].
Figure 3 shows typical examples of recurrence plots for (a) a sine signal, (b) a chaotic Rössler system’s signal, and (c) a random Gaussian noise signal. In the periodic case, we observe complete diagonal lines so the system is fully deterministic. In the chaotic case, the recurrence plot shows diagonal lines with variable lengths, causing a drop in the measured determinism. The recurrence plot of the random signal only shows isolated recurrence points not forming a diagonal line, so it is non-deterministic.
Using a sliding window, one can furthermore study the time-dependent behavior of the system by computing RQA measures along the time series, allowing to identify regimes transitions and isolated events. For this purpose, some statistical testing can be employed to detect significant deviations in the RQA measure. In this study, we use the bootstrapping method, which consists in building the test distribution of the RQA measure from randomly drawn line structures in the local recurrence plots [48].

3. Results and Discussion

The following section presents the mode decomposition results for each region along with possible interpretations.

3.1. IMFs Selection

NA-MEMD is applied on the standardized time series with 26 parallel noise channels and 256 projection vectors. We first select significant IMFs to analyze from the total 16 extracted based on their amplitude and representative temporal scale. To do so, we calculate the instantaneous amplitude and frequency I A and I F as
I A = H ,
I F = 1 2 π d ( arg ( H ) ) d t ,
with H being the Hilbert transform of the IMF.
Figure 4 shows the amplitude and temporal scale of extracted IMFs. For better readability, we use the instantaneous period in hours as the unit, which is given by I F 1 . The IMFs of all regions are included here, and the first and last 5000 h of the time series are removed to exclude the distortions at the boundaries. Except for IMFs 4 and 5, all IMFs represent a clearly distinct temporal scale. One can see that IMFs 1, 2, 10, 11, 12, 15, and 16 have a negligible amplitude. IMFs 6 and 7 show a spike in amplitude, which was later confirmed to correspond to the blackout period caused by the Hokkaido earthquake in September 2018. IMf 9 has a relatively small amplitude, and its average period of 372 h does not seem to correspond with a physically meaningful temporal scale for electricity demand. The remaining IMFs selected for the analysis have both a non-negligible amplitude and meaningful period. IMFs 3, 4 and 5 represent the semi-daily and daily variations, IMF 8 the weekly variations, and IMFs 13 and 14 the seasonal or semi-annual and annual variations in the electricity demand.

3.2. Annual Period

Figure 5 shows the IMF 14 or annual demand fluctuations for the 10 regions along with temperature profiles smoothed using a four-week sliding window. Horizontal dashed lines indicate the temperature extrema over the covered period. Only the coldest and hottest regions, Hokkaido and Tohoku in the north, Hokuriku with its mountainous area, and Okinawa in the south, show a high amplitude in demand oscillations. The oscillations seem highly correlated with annual temperature fluctuations, with peaks during winter for Hokkaido, Tohoku and Hokuriku, and during summer for Okinawa.
This can trivially be explained by the heat demand, with coldest regions having harsh winters and mild summers, while hottest regions have mild winters and very hot summers. This does not mean that other regions do not have an electricity demand in winter or summer, but rather that their difference in demand between these seasons is smaller. One can further notice that the demand oscillations amplitude decays over the year for Tohoku and Hokuriku regions, following a slight increase in the temperature, with milder winters causing a decrease in heating demand, and hotter summers causing an increase in cooling demand. Similarly, in Okinawa, the year 2018 shows the mildest summer in this region, causing a decrease in cooling demand.

3.3. Semi-Annual Period

Figure 6 shows the IMF 13 or semi-annual demand fluctuations with the smoothed temperature profiles. All regions show high amplitude oscillations with two peaks per year, in winter and summer. Hokkaido, Tohoku, and Okinawa regions show a clear difference between the peaks’ height, with a higher peak in winter for Hokkaido and Tohoku and in summer for Okinawa.
Again, this can be explained by the heat demand, with colder regions having higher heating demand in winter and hotter regions having higher cooling demand in summer. All regions, except Hokkaido and Okinawa, show a higher amplitude around the winter of year 2018, caused by the coldest recorded temperatures over the covered period.

3.4. Weekly Period

Figure 7 shows the IMF 8 representing weekly demand fluctuations. The time series for each region are organized in a days by weeks matrix for better readability. One can see that the IMF for Chubu and Hokuriku have high amplitude oscillations, with a high demand during weekdays and a lower demand during weekends, corresponding with the typical schedules of public utilities, such as schools and administrative buildings. Other regions follow the same pattern to a lesser extent, with Okinawa showing almost no fluctuations.
Some possible interpretations of the difference in amplitude between regions can be drawn from the annual electricity shares of industrial, commercial and residential sectors in Table 1. Okinawa has the highest commercial share, while having an average residential share, meaning that it has a high proportion of private businesses per capita, including entertainment, hospitality, restaurants or shops. Such businesses operate with rotating shift schedules to provide services both during weekdays and weekends, which could explain the absence of observable weekly demand fluctuation in that region. On the opposite end, Hokuriku region, showing a high contrast between the weekday and weekend demand, has the lowest commercial share for the highest residential share after Hokkaido region. Chugoku region has a low commercial share but also a low residential share caused by its high industrial share. The high demand fluctuations in Chubu cannot yet be explained this way., as it has balanced shares between all sectors. However, the industrial sector of Nagoya city, the most populated area of that region, is known to be mostly occupied by the Toyota industry, which imposes weekends as rest days to its employees.
We use recurrence quantification analysis in order to detect irregularities in the time series and possibly identify some relations with real events and further demonstrate the accuracy and physical meaningfulness of the extracted IMF. We estimate the time series determinism using D E T measure with a sliding window of four weeks to detect these changes. A lack of regularity in weekdays/weekends schedules should result in a lack of consistency in the weekly demand fluctuations, and thus a drop in the local D E T measure. The recurrence plots are computed from the phase space built, using the delay embedding method [49], and a distance threshold ϵ equal to 10% of the attractor size [34]. The delay τ was set to 42 h, which corresponds to the quarter period of a week. The number of embedding dimensions m was determined using the false nearest neighbors algorithm and is equal to 3 [50]. When calculating D E T , we first removed the LOI in the recurrence plot with a Theiler window of ( m 1 ) τ [34]. The minimum diagonal lines length d m i n was also set to ( m 1 ) τ [34]. We used 10,000 bootstrap resampling to estimate the variance of D E T for statistical significance testing [48].
Figure 8 shows the IMF 8 time series with the variations of D E T . The horizontal dotted lines represent the lower threshold of 5% p-values. Overall, the significant drops in determinism coincide with either the new year period, Golden week which is week with several national holidays occurring between the 29th of April to early May, or Obon which is an event of several days for the commemoration of ancestors occurring in the middle of August. These periods are major national holidays followed by most of the population. Another noticeable determinism drop appears around February 2020 for most regions, yet does not seem to correspond with any holiday or cultural event. It in fact coincides with the first appearance of COVID-19 cases which caused a large-scale lock down of schools as well as disturbances in many businesses. The determinism variations for Okinawa region appear as an exception, with drops during summer caused by the cooling demand increase governed by chaotic temperature fluctuations.

3.5. Daily Period

IMFs 4 and 5 both represent the electricity demand variations with the daily period. Figure 9 shows the time series for IMF 5 organized in hours by days matrices. One can clearly see the difference between day and night demand, with typically a higher demand during daytime from 9 in the morning to 8 in the evening. There is also a difference between winter and summer for most regions, with a smaller contrast between day and night in winter. Notably, Hokkaido region shows a higher demand during winter nights than during daytime. Tokyo, Chubu, and Kansai regions appear to have a stable demand throughout the year.
The smaller demand contrast day/night in winter can be explained by either mild winters in southern regions or alternative heating solutions, such as gas and kerosene, or a combination of the two. Although electrical heaters have a high power consumption, kerosene- and gas-based heating is widely used, particularly in northern regions, such as Hokkaido, because electricity-based heating, including heat pumping, is insufficient due to the poor buildings’ insulation, as most households in Japan live in wood-framed houses. The higher demand during winter nights in Hokkaido can be explained by the necessary heating of water pipes to avoid freezing. As for Tokyo, Chubu, and Kansai regions, one might think that the stable demand can be explained by a higher industrial and commercial share, as they use the same working equipment throughout the year, but it is only the case for Tokyo and Kansai as seen in Table 1. Another possible interpretation can be drawn based on the fact that these three regions have the highest population density and regroup the largest cities in Japan, including Tokyo, Osaka, Kobe, Kyoto and Nagoya. Large cities tend to have more recent buildings, both for working places and households, equipped with heat pumps for room heating, which could explain the higher demand during winter daytime. Some households use a blanket heater in winter instead of room heating when sleeping, which can also explain the lower demand at night in these regions.
The IMF 4 for all regions is shown in Figure 10. One can see that only bursts of high amplitude are present at regular intervals in the middle of August, corresponding to the temperature peaks every year. There is no evident underlying the cause for the presence of such bursts, so we interpret for now this IMF as resulting from an artificial mode splitting with IMF 5.

3.6. Semi-Daily Period

Lastly, the electricity demand fluctuations with semi-daily period covered by IMF 3 are shown in Figure 11, again in hours by days matrices. Overall, three daily demand peaks can be observed here, one around 5 in the morning, one around 10 in the morning, and another around 8 in the evening. Hokkaido and Tohoku have both peaks at 5:00 a.m. and 8:00 p.m. with an additional small peak at 10:00 a.m. during summer. The early morning and evening peaks are more pronounced in winter. Hokuriku also has the three demand peaks but with a lower amplitude. Tokyo, Chubu and Kansai regions show similar demand patterns with peaks at 9:00 a.m. and 8:00 p.m. and a higher amplitude during winter. Chugoku, Shikoku and Kyushu regions’ demand alternates between three patterns: one during spring and fall with small peaks at 5:00 a.m. and 8:00 p.m., one during summer with small peaks at 10:00 a.m. and 8:00 p.m., and one during winter with the same peaks at 10:00 a.m. and 8:00 p.m. and a higher amplitude. Okinawa stands out with peaks at 10:00 a.m. and 8:00 p.m., with the one at 10:00 a.m. being higher during summer.
The peak at 10:00 a.m. can be associated with room heating or cooling at the start of schools, offices and businesses, which are mostly equipped with heat pumps. The demand drops in the afternoon because once the temperature has reached its desired state, it takes less energy to maintain it in a closed environment. This peak appears to be higher during winter in most regions because of the fact that the night temperature difference with comfortable room temperature (say 20 to 25 degrees) is higher in winter than summer, as well as heat pumps being less efficient for heating than cooling. It also starts later in summer because night temperatures are cooler and it takes some time in the morning for the room to heat up with rising ambient temperature. The peak is higher during summer in Okinawa because of the mild winters in this region. It is also not visible in Hokkaido during winter because of alternative fuel-based heating, notably city gas for bigger buildings.
The peak at 8:00 p.m. can be explained by room heating and cooling of households when people come back home from work, with higher heating demand during winter. We can assume that it also includes the electricity consumption of other equipment such as lighting, cooking, or televisions. The lighting demand of buildings and streets could furthermore explain the early start of this peak in winter, notably in Hokkaido, because of the days becoming dark around 5:00 to 6:00 p.m. in this period.
The peak around 5:00 a.m. can have different possible explanations. It can be interpreted as people waking up more or less early in the morning, rice cookers scheduled to heat breakfast, industries using electricity at night for cheaper prices, or even apartment blocks residences automatically switching back on outdoor lights before dawn. These interpretations yet do not explain the presence of this peak only during spring and fall for Chugoku, Shikoku, and Kyushu regions. This timing coincides with planting and harvesting schedules in the rice crop calendar and thus could also be related with seedlings and fields preparation works.

4. Summary

We studied the application of noise-assisted multivariate empirical mode decomposition (NA-MEMD) for the analysis of energy demand time series with the case of electricity demand per region in Japan. This algorithm allows to decompose the complex spatial–temporal data into intrinsic mode functions (IMFs) showing the demand dynamics at different temporal scales. The observed features in extracted IMFs could be explained by ambient temperature variations, demand sectors shares, and life style with working schedules and holidays. Recurrence quantification analysis could further accurately detect irregularities associated with cultural events, as well as prevention measures for the spread of COVID-19. These features could not properly be observed in total time series, which impairs their accurate analysis and modeling.
Time series decomposition is already used in the energy field as input for machine learning algorithms for short-term forecasting, but we advance the idea that it can also be used to fill the lack of knowledge on global energy demand dynamics to establish more accurate models for long-term scenario analysis with high temporal resolution. Future research directions thus include this modeling process, as well as analysis at smaller spatial scales, such as municipalities and the comparison between countries with different environmental conditions, economical development levels and cultures.

Author Contributions

Conceptualization, R.D.; methodology, R.D.; software, R.D.; validation, R.D.; formal analysis, R.D.; investigation, R.D.; resources, T.N.; data curation, R.D.; writing—original draft preparation, R.D.; writing—review and editing, R.D. and T.N.; visualization, R.D.; supervision, R.D. and T.N.; project administration, R.D. and T.N.; funding acquisition, T.N. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported by Council for Science, Technology and Innovation (CSTI), Cross-ministerial Strategic Innovation Promotion Program (SIP), “Energy systems of an Internet of Energy (IoE) society” (Funding agency: JST).

Conflicts of Interest

The authors declare no conflict of interest.

Abbreviations

The following abbreviations are used in this manuscript:
EMDEmpirical Mode Decomposition
IMFIntrinsic Mode Function
EEMDEnsemble Empirical Mode Decomposition
CEEMDComplete Ensemble Empirical Mode Decomposition
MEMDMultivariate Empirical Mode Decomposition
NA-MEMDNoise-Assisted Multivariate Empirical Mode Decomposition
RPRecurrence Plot
RQARecurrence Quantification Analysis

References

  1. Nakata, T.; Silva, D.; Rodionov, M. Application of energy system models for designing a low-carbon society. Prog. Energy Combust. Sci. 2011, 37, 462–502. [Google Scholar] [CrossRef]
  2. Robinius, M.; Otto, A.; Heuser, P.; Welder, L.; Syranidis, K.; Ryberg, D.; Grube, T.; Markewitz, P.; Peters, R.; Stolten, D. Linking the power and transport sectors—Part 1: The principle of sector coupling. Energies 2017, 10, 956. [Google Scholar] [CrossRef]
  3. Brown, T.; Schlachtberger, D.; Kies, A.; Schramm, S.; Greiner, M. Synergies of sector coupling and transmission reinforcement in a cost-optimised, highly renewable European energy system. Energy 2018, 160, 720–739. [Google Scholar] [CrossRef]
  4. Maruf, M.N.I. Sector coupling in the north sea region—A review on the energy system modelling perspective. Energies 2019, 12, 4298. [Google Scholar] [CrossRef]
  5. Lund, H.; Werner, S.; Wlitshire, R.; Svendsen, S.; Thorsen, J.E.; Hvelplund, F.; Mathiesen, B.V. 4th Generation District Heating (4GDH): Integrating smart thermal grids into future sustainable energy systems. Energy 2012, 68, 1–11. [Google Scholar] [CrossRef]
  6. Rodriguez, R.A.; Becker, S.; Andresen, G.B.; Heide, D.; Greiner, M. Transmission needs across a fully renewable European power system. Renew. Energy 2014, 63, 467–476. [Google Scholar] [CrossRef]
  7. Neuhoff, K.; Bach, S.; Diekmann, J.; Beznoska, M.; El-Laboudy, T. Distributional effects of energy transition: Impacts of renewable electricity support in Germany. Econ. Energy Environ. Policy 2013, 2, 41–54. [Google Scholar] [CrossRef]
  8. Bale, C.S.E.; Varga, L.; Foxon, T.J. Energy and complexity: New ways forward. Appl. Energy 2015, 138, 150–159. [Google Scholar] [CrossRef]
  9. Delage, R.; Nakata, T. Machine learning for modeling energy systems complexity. In Proceedings of the 33rd International Conference on Efficiency, Cost, Optimization, Simulation and Environmental Impact of Energy Systems, Osaka, Japan, 29 June–3 July 2020; pp. 2405–2414. [Google Scholar]
  10. Brown, T.; Horsch, J.; Schlachtberger, D. PyPSA: Python for Power System Analysis. J. Open Res. Softw. 2018, 6, 4. [Google Scholar] [CrossRef]
  11. Pfenninger, S.; Pickering, B. Calliope: A multi-scale energy systems modelling framework. J. Open Res. Softw. 2018, 3, 825. [Google Scholar] [CrossRef] [Green Version]
  12. Rai, V.; Henry, A.D. Agent-based modelling of consumer energy choices. Nat. Clim. Chang. 2016, 6, 556–562. [Google Scholar] [CrossRef]
  13. Rylatt, M.; Gammon, R.; Boait, P.; Varga, L.; Allen, P.; Savill, M.; Snape, R.; Lemon, M.; Ardestani, B.; Pakka, V.; et al. Cascade: An agent based framework for modeling the dynamics of smart electricity systems. Emerg. Complex. Organ. 2013, 15, 1–13. [Google Scholar]
  14. Kremers, E. Modelling and Simulation of Electrical Energy Systems through a Complex Systems Approach Using Agent-Based Models, 1st ed.; KIT Scientific Publishing: Karlsruhe, Germany, 2012. [Google Scholar]
  15. Logenthiran, T.; Srinivasan, D.; Shun, T.Z. Multi-Agent System for Demand Side Management in smart grid. In Proceedings of the 2011 IEEE Ninth International Conference on Power Electronics and Drive Systems, Singapore, 5–8 December 2011; pp. 424–429. [Google Scholar]
  16. Krause, S.M.; Borries, S.; Bornholdt, S. Econophysics of adaptive power markets:When a market does not dampen fluctuations but amplifies them. Phys. Rev. E 2015, 92, 012815. [Google Scholar] [CrossRef] [PubMed]
  17. Morstyn, T.; Farrell, N.; Evins, L.A.; Bollinger, L.A.; Carmeliet, J. Using peer-to-peer energy-trading platforms to incentivize prosumers to form federated power plants. Nat. Energy 2018, 3, 94–101. [Google Scholar] [CrossRef]
  18. Zhou, Y.; Wu, J.; Long, C. Evaluation of peer-to-peer energy sharing mechanisms based on a multiagent simulation framework. Appl. Energy 2018, 222, 993–1022. [Google Scholar] [CrossRef]
  19. Deissenroth, M.; Klein, M.; Nienhaus, K.; Reeg, M. Assessing the Plurality of Actors and Policy Interactions: Agent-Based Modelling of Renewable Energy Market Integration. Complexity 2017, 2017, 7494313. [Google Scholar] [CrossRef]
  20. Chappin, E.J.L.; de Vries, L.J.; Richstein, J.C.; Bhagwat, P.; Iychettira, K.; Khan, S. Simulating climate and energy policy with agent-based modelling: The Energy Modelling Laboratory (EMLab). Environ. Model. Softw. 2017, 96, 421–431. [Google Scholar] [CrossRef]
  21. Calikus, E.; Nowaczyk, S.; Sant’Anna, A.; Gadd, H.; Werner, S. A data-driven approach for discovering heat load patterns in district heating. Appl. Energy 2019, 252, 113409. [Google Scholar] [CrossRef]
  22. Nystrup, P.; Madsen, H.; Blomgren, E.M.V.; de Zotti, G. Clustering commercial and industrial load patterns for long-term energy planning. Smart Energy 2021, 2, 100010. [Google Scholar] [CrossRef]
  23. Mosavi, A.; Salimi, M.; Ardabili, S.F.; Rabczuk, T.; Shamshirband, S.; Varkonyi-Koczy, A.R. State of the art of machine learning models in energy systems, a systematic review. Energies 2019, 12, 1301. [Google Scholar] [CrossRef]
  24. Pickering, E.M.; Hossain, M.A.; French, R.H.; Abramson, A.R. Building electricity consumption: Data analytics of building operations with classical time series decomposition and case based subsetting. Energy Build. 2018, 177, 184–196. [Google Scholar] [CrossRef]
  25. Bogomolov, A.; Lepri, B.; Larcher, R.; Antonelli, F.; Pianesi, F.; Pentland, A. Energy consumption prediction using people dynamics derived from cellular network data. EPJ Data Sci. 2016, 5, 13. [Google Scholar] [CrossRef]
  26. Zhong, S.; Tam, K.S. Hierarchical Classification of Load Profiles Based on Their Characteristic Attributes in Frequency Domain. IEEE Trans. Power Syst. 2015, 30, 2434–2441. [Google Scholar] [CrossRef]
  27. Yukseltan, E.; Yucekaya, A.; Bilge, A.H. Hourly electricity demand forecasting using Fourier analysis with feedback. Energy Strategy Rev. 2020, 31, 100524. [Google Scholar] [CrossRef]
  28. Li, R.; Li, F.; Smith, N.D. Load Characterization and Low-Order Approximation for Smart Metering Data in the Spectral Domain. IEEE Trans. Ind. Inform. 2017, 13, 976–984. [Google Scholar] [CrossRef]
  29. Prema, V.; Uma Rao, K. Time series decomposition model for accurate wind speed forecast. Renewables 2015, 2, 18. [Google Scholar] [CrossRef]
  30. Gao, Z.; Yang, Y.; Dang, W.; Cai, Q.; Wang, Z.; Marwan, N.; Boccaletti, S.; Kurths, J. Reconstructing multi-mode networks from multivariate time series. Europhys. Lett. 2017, 119, 50008. [Google Scholar] [CrossRef]
  31. Luque, J.; Anguita, D.; Perez, F.; Denda, R. Spectral Analysis of Electricity Demand Using Hilbert–Huang Transform. Sensors 2020, 20, 2912. [Google Scholar] [CrossRef]
  32. Xia, C.; Wang, Z. Drivers analysis and empirical mode decomposition based forecasting of energy consumption structure. J. Clean. Prod. 2020, 254, 120107. [Google Scholar] [CrossRef]
  33. Looney, D.; Hemakom, A.; Mandic, D.P. Intrinsic multi-scale analysis: A multi-variate empirical mode decomposition framework. Proc. R. Soc. A 2015, 471, 20140709. [Google Scholar] [CrossRef]
  34. Marwan, N.; Romano, M.C.; Thiel, M.; Kurths, J. Recurrence plots for the analysis of complex systems. Phys. Rep. 2007, 438, 237–329. [Google Scholar] [CrossRef]
  35. Donner, R.V.; Zou, Y.; Donges, J.F.; Marwan, N.; Kurths, J. Recurrence networks—A novel paradigm for nonlinear time series analysis. New J. Phys. 2010, 12, 033025. [Google Scholar] [CrossRef]
  36. Charakopoulos, A.; Karakasidis, T.; Sarris, I. Pattern identification for wind power forecasting via complex network and recurrence plot time series analysis. Energy Policy 2019, 133, 110934. [Google Scholar] [CrossRef]
  37. Adenji, A.E.; Olusola, O.I.; Njah, A.N. Comparative study of chaotic features in hourly wind speed using recurrence quantification analysis. AIP Adv. 2018, 8, 025102. [Google Scholar] [CrossRef]
  38. Boers, N.; Kurths, J.; Marwan, N. Complex systems approaches for Earth system data analysis. J. Phys. Complex. 2021, 2, 011001. [Google Scholar] [CrossRef]
  39. Bhui, P.; Senroy, N. Application of Recurrence Quantification Analysis to Power System Dynamic Studies. IEEE Trans. Power Syst. 2016, 31, 581–591. [Google Scholar] [CrossRef]
  40. Delage, R.; Matsuoka, T.; Nakata, T. Spatial–Temporal Estimation and Analysis of Japan Onshore and Offshore Wind Energy Potential. Energies 2021, 14, 2168. [Google Scholar] [CrossRef]
  41. Institute for Sustainable Energy Policies. Electricity Generation and Demand. Available online: https://isep-energychart.com/en/graphics/ (accessed on 13 July 2021).
  42. Japan Meteorological Agency. Outline of the Operational Numerical Weather Prediction. Available online: https://www.jma.go.jp/jma/jma-eng/jma-center/nwp/outline2019-nwp/index.htm (accessed on 13 July 2021).
  43. Kyoto University. Japan Meteorological Agency Data. Available online: http://database.rish.kyoto-u.ac.jp/arch/jmadata/ (accessed on 11 March 2021).
  44. Japan Ministry of Economy. Trade and Industry: Energy Consumption Statistics by Prefectures. Available online: https://www.enecho.meti.go.jp/statistics/energy_consumption/ec002/results.html (accessed on 13 July 2021).
  45. Huang, N.E.; Wu, M.L.; Long, S.R.; Shen, S.S.P.; Qu, W.; Gloersen, P.; Fan, K.L. A confidence limit for the empirical mode decomposition and Hilbert spectral analysis. Proc. R. Soc. Lond. 2003, 459, 2317–2345. [Google Scholar] [CrossRef]
  46. Rilling, G.; Flandrin, P.; Goncalves, P. On Empirical Mode Decomposition and its Algorithms. In Proceedings of the IEEE-EURASIP Workshop on Nonlinear Signal and Image Processing, NSIP-03, Grado, Italy, 8–11 June 2003. [Google Scholar]
  47. Mandic, D.P.; Rehman, N.; Wu, Z.; Huang, N.E. Empirical Mode Decomposition-Based Time-Frequency Analysis of Multivariate Signals. IEEE Signal Process. Mag. 2013, 30, 74–86. [Google Scholar] [CrossRef]
  48. Marwan, N.; Schinkel, S.; Kurths, J. Recurrence plots 25 years later—Gaining confidence in dynamical transitions. EPL 2013, 101, 20007. [Google Scholar] [CrossRef]
  49. Packard, N.H.; Crutchfield, J.P.; Farmer, J.D.; Shaw, R.S. Geometry from a Time Series. Phys. Rev. Lett. 1980, 45, 712–716. [Google Scholar] [CrossRef]
  50. Kennel, M.B.; Brown, R.; Abarbanel, H.D. Determining embedding dimension for phase-space reconstruction using a geometrical construction. Phys. Rev. A 1992, 45, 3403–3411. [Google Scholar] [CrossRef] [PubMed] [Green Version]
Figure 1. Regions covered by the 10 major energy carriers in Japan.
Figure 1. Regions covered by the 10 major energy carriers in Japan.
Energies 15 06292 g001
Figure 2. Total electricity demand time series per region.
Figure 2. Total electricity demand time series per region.
Energies 15 06292 g002
Figure 3. Examples of recurrence plots and determinism measure D E T for (a) a periodic signal, (b) a chaotic signal from Rössler system, and (c) a random signal.
Figure 3. Examples of recurrence plots and determinism measure D E T for (a) a periodic signal, (b) a chaotic signal from Rössler system, and (c) a random signal.
Energies 15 06292 g003
Figure 4. Instantaneous amplitude vs period plot for the IMFs of all regions. End points are removed to exclude the distortion from end effect. (Color online).
Figure 4. Instantaneous amplitude vs period plot for the IMFs of all regions. End points are removed to exclude the distortion from end effect. (Color online).
Energies 15 06292 g004
Figure 5. IMF 14 for each region showing the electricity demand oscillations with annual period (standardized), along with the moving temperature averages using a four-week sliding window. The dashed lines indicate the temperature extrema over the covered period.
Figure 5. IMF 14 for each region showing the electricity demand oscillations with annual period (standardized), along with the moving temperature averages using a four-week sliding window. The dashed lines indicate the temperature extrema over the covered period.
Energies 15 06292 g005
Figure 6. IMF 13 for each region showing the electricity demand oscillations with semi-annual period (standardized), along with the moving temperature averages using a four-week sliding window.
Figure 6. IMF 13 for each region showing the electricity demand oscillations with semi-annual period (standardized), along with the moving temperature averages using a four-week sliding window.
Energies 15 06292 g006
Figure 7. IMF 8 for each region showing the electricity demand oscillations with weekly period (standardized). The time series are organized in days by weeks matrices for better readability. (Color online).
Figure 7. IMF 8 for each region showing the electricity demand oscillations with weekly period (standardized). The time series are organized in days by weeks matrices for better readability. (Color online).
Energies 15 06292 g007
Figure 8. Recurrence quantification analysis of IMF 8 using D E T for determinism estimation. The horizontal dashed lines represent the lower threshold of 5% p-values.
Figure 8. Recurrence quantification analysis of IMF 8 using D E T for determinism estimation. The horizontal dashed lines represent the lower threshold of 5% p-values.
Energies 15 06292 g008
Figure 9. IMF 5 for each region showing the electricity demand oscillations with daily period (standardized). The time series are organized in hours by days matrices for better readability. (Color online).
Figure 9. IMF 5 for each region showing the electricity demand oscillations with daily period (standardized). The time series are organized in hours by days matrices for better readability. (Color online).
Energies 15 06292 g009
Figure 10. IMF 4 for each region showing bursts in the electricity demand oscillations with daily period (standardized). The time series are organized in hours by days matrices for better readability. (Color online).
Figure 10. IMF 4 for each region showing bursts in the electricity demand oscillations with daily period (standardized). The time series are organized in hours by days matrices for better readability. (Color online).
Energies 15 06292 g010
Figure 11. IMF 3 for each region showing the electricity demand oscillations with semi-daily period (standardized). The time series are organized in hours by days matrices for better readability. (Color online).
Figure 11. IMF 3 for each region showing the electricity demand oscillations with semi-daily period (standardized). The time series are organized in hours by days matrices for better readability. (Color online).
Energies 15 06292 g011
Table 1. Annual electricity demand shares per sector for each region in 2015.
Table 1. Annual electricity demand shares per sector for each region in 2015.
Industrial (%)Commercial (%)Residential (%)
Hokkaido18.143.438.5
Tohoku31.133.835.2
Tokyo24.345.230.5
Chubu37.832.629.7
Hokuriku35.926.837.3
Kansai29.939.830.3
Chugoku45.827.726.6
Shikoku37.730.332.1
Kyushu34.634.730.7
Okinawa10.254.435.4
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Delage, R.; Nakata, T. Multivariate Empirical Mode Decomposition and Recurrence Quantification for the Multiscale, Spatiotemporal Analysis of Electricity Demand—A Case Study of Japan. Energies 2022, 15, 6292. https://0-doi-org.brum.beds.ac.uk/10.3390/en15176292

AMA Style

Delage R, Nakata T. Multivariate Empirical Mode Decomposition and Recurrence Quantification for the Multiscale, Spatiotemporal Analysis of Electricity Demand—A Case Study of Japan. Energies. 2022; 15(17):6292. https://0-doi-org.brum.beds.ac.uk/10.3390/en15176292

Chicago/Turabian Style

Delage, Rémi, and Toshihiko Nakata. 2022. "Multivariate Empirical Mode Decomposition and Recurrence Quantification for the Multiscale, Spatiotemporal Analysis of Electricity Demand—A Case Study of Japan" Energies 15, no. 17: 6292. https://0-doi-org.brum.beds.ac.uk/10.3390/en15176292

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop