Next Article in Journal
Comparison of Dual-Permanent-Magnet-Excited Machines and Surface-Mounted Permanent Magnet Machines in Terms of Force
Previous Article in Journal
Sequential Model Predictive Control of Three-Phase Direct Matrix Converter
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Recurrent Neural Network-Based Hourly Prediction of Photovoltaic Power Output Using Meteorological Information

Department of Industrial and Management Engineering, Incheon National University, 119 Academy-ro, Yeonsu-gu, Incheon 407-772, Korea
*
Author to whom correspondence should be addressed.
Submission received: 8 November 2018 / Revised: 3 December 2018 / Accepted: 4 December 2018 / Published: 10 January 2019
(This article belongs to the Section F: Electrical Engineering)

Abstract

:
Recently, the prediction of photovoltaic (PV) power has become of paramount importance to improve the expected revenue of PV operators and the effective operations of PV facility systems. Additionally, the precise PV power output prediction in an hourly manner enables more sophisticated strategies for PV operators and markets as the electricity price in a renewable energy market is continuously changing. However, the hourly prediction of PV power outputs is considered as a challenging problem due to the dynamic natures of meteorological information not only in a day but also across days. Therefore, in this paper, we suggest three PV power output prediction methods such as artificial neural network (ANN)-, deep neural network (DNN)-, and long and short term memory (LSTM)-based models that are capable to understand the hidden relationships between meteorological information and actual PV power outputs. In particular, the proposed LSTM based model is designed to capture both hourly patterns in a day and seasonal patterns across days. We conducted the experiments by using a real-world dataset. The experimental results show that the proposed ANN based model fails to yield satisfactory results, and the proposed LSTM based model successfully better performs more than 50% compared to the conventional statistical models in terms of mean absolute error.

1. Introduction

Recently, the importance of photovoltaic (PV) power prediction has been rapidly increasing due to the necessity of the clean energy sources harmless to the environment [1]. Since a PV system converts obtained solar power into electricity, PV operators are interested in stable PV power generation [2], and hybrid energy systems, which utilize multiple renewable power sources, have become popular due to their better efficiency [3,4].
The accurate photovoltaic (PV) power output prediction is considered as an essential for maximizing the potential revenues of PV operators due to price fluctuations [5]. In general, as the future price in a renewable energy market is determined by a bidding mechanism between PV operators and renewable market operators, the expected revenue of a PV operator is directly affected by the ability to predict when and how much electricity will be generated in the future [5]. In the meantime, in an electricity market perspective, PV power output prediction is beneficial to improve the effective operation of electrical system for their consumers though approximating the overall level of electricity that is able to be provided by their PV operators [6]. Moreover, as renewable intraday electricity markets that determine prices in an hourly manner becomes popular [7,8], the sophisticated hourly prediction ability of the PV power output is more required.
By extension, for the more sophisticated decisions of PV operators and the effective operations of electricity markets, the prediction of PV power outputs in a hourly level is crucially necessary [9]. Since the prices of electricity sold in the most electricity markets for renewable energy dynamically change over time according to the expected amount of generated electricity, the ability to predict PV power outputs for each particular hour in a day enables the adaptive adjustment of the transaction volumes with tailored schedules.
Figure 1 shows typical examples of PV power outputs during two consecutive days in summer and winter in South Korea obtained from the PV power system considered in this research. Here, easy and hard seasons divide according to fluctuation levels of the PV power output. For example, as shown Figure 1, more fluctuation of the PV power output occurs in winter compared to summer, meaning it is harder to predict the PV power output in winter. Naturally, PV power output starts to be generated when the sun rises (usually between 6:00 and 19:00), and it tends to increase until the daily solar intensity peaks (usually between 12:00 and 14:00). The highest PV power output is shown between 10:00 and 14:00 in many cases. After the peak time, it then decreases till sunset.
Although it is well known that PV power outputs are strongly related to a variety of meteorological factors such as solar intensity, humidity, temperature, and cloudiness [10], the dynamic changes of such meteorological values make the prediction of PV power outputs significantly challenging. In particular, in the dataset from a PV operation located in Gumi city in South Korea we considered in this study, the average solar intensity and temperature values in a day changed by 34% and 11%, respectively. Such meteorological changes in a day cause changes of the hourly PV power outputs in the day. For instance, the graph shown in the right in Figure 1 presents an example of a PV power outputs in a day with many significant PV power output changes in a jagged way.
Moreover, in many countries, the hourly patterns of PV power outputs across days also greatly differ with the seasons, which further increases the complexity of the problem. That is, in a particular season, both the specific patterns among hourly PV power outputs in a day and their overall trends across days are considerably different compared to those in other seasons. For instance, as shown in Figure 1, the average changes of hourly PV power outputs across days tend to be much higher (by 16.2%) in winter than in summer.
This implies that accurate PV power output prediction is achievable when a prediction model is capable of capturing not only the short term patterns occurring in every hour in a day but also the long term patterns across days affected across seasons. That is, on the one hand, since the PV power output for a particular hour in a day is highly associated with those for the previous hours in that day, understanding the hidden patterns over hours from sunrise to sunset is essential from a short term perspective. On the other hand, the PV power outputs during a day are also strongly related with seasonal information such as month of year and day of month from a long term perspective.
As suggested in [11], the prediction models of the PV power output are divided into methods such as regressive, artificial intelligence and remote sensing methods; among them, our models are categorized as intelligent methods. Therefore, based on previous study and prediction ranges, we fall into two categories, such as short-term and long-term predictions as shown in Table 1. Further, in previous studies, the denotation of the short-term was set either 0 to 4 h in [12] or 24 h in [13], while the long-term was denoted as one day in [14]. Therefore, considering to the previous studies, in this study the short-term is regarded as under 24 h, and the long-term is considered as 24 h.
There exist short-term PV power output prediction models using simple artificial neural networks (ANN) based on meteorological information [15,16,17], and deep neural networks by utilizing the solar radiation, module temperature [18,19], and clearness index [20]. Some prediction techniques based on machine learning such as support vector machine (SVM) [21,22,23], SVM and weather classification methods were proposed [21], support vector regression (SVR) [22] was also proposed, which predicts the PV power output by predicting cloudiness. Much more accurate prediction was reported by considering the time series features such as an adaptive time series model (SARIMA-SVM) [23]. Finally, a recurrent neural network (RNN) model was proposed to capture sequence patterns of PV power outputs [24,25], and the further developed version of RNN, called the long short term memory (LSTM) based model, was proposed [26].
There has been another line of research that aims to predict PV power outputs from a long-term perspective. Hybrid systems incorporating more than one renewable energy source are proposed to predict capacity of electricity generation, using solar and wind power models in [27], and solar and hydro power models in [28]. An ANN using classified weather information based on the past metrological information in [29], and there are other research results that suggest the better performance of DNN-based models with one more hidden layers using weather data [30,31,32]. Similarity, as an approximation method, the regularized partial functional linear regression model (PFLRM) and multivariate adaptive regression splines (MAR) [33,34] were developed. Further, the ARMAX model and a combination of linear regression (LR) and a machine learning method were proposed [35,36]. For more sophisticated approaches, time series-based models were suggested by utilizing a dynamic neural network [37] and radial basis function neural network (RBFNN) and additionally with weather classification [38,39]. However, in the previous research, the RNN model used for PV power prediction is limited to understand long-term dependences among prediction values [40]. In addition, the existing PV power prediction models based on ANN and DNN require additional information such as weather classification information that is unavailable for many areas.
Therefore, in this paper, we propose a deep learning based approach towards precise hourly prediction of PV power outputs by using meteorological and seasonal factors. For each hour, the proposed approach attempts to capture the relationships between the meteorological factors and the PV power outputs. In addition, unlike the previous approaches, the proposed models consider both the short term relationships among the hourly PV power outputs in a day and their long term relationships across days by combining the well-known deep learning techniques.
Specifically, our approach includes three particular models as follows: First, the proposed single-layer ANN-based model consisting of a single hidden layer attempts to learn PV power outputs in a short term manner without understanding their long term relationships. Second, the suggested multi-layer ANN-based model with multiple hidden layers and the increased number of parameters tries to estimate more accurate PV power outputs than the proposed ANN-based model. Finally, the proposed long and short term memory (LSTM)-based model is designed to understand both short and long term time series patterns, simultaneously, in a single model for further improved predictions.
These models are similar to ones mentioned in previous studies [26,41], but the LSTM- based model proposed in this study has a significant difference because it attempts to estimate hourly PV power output regardless for meteorological conditions and considering meteorological and seasonal trends. In addition, while some models attempt to predict solar radiation [42,43,44] rather than PV power output prediction, our study focuses on the direct estimation of PV power output.
As shown Figure 2, since the former two models—ANN and DNN-based models—assume that the PV power output in a particular hour is independent of the others, these models predict a single hour PV power by only using the corresponding meteorological and seasonal information for the particular hour. On the contrary, the last one, the LSTM-based model, sequentially utilizes all the hourly features in a day. The LSTM-based model produces the predictions of all the hours in a day at once unlike the ANN-based model. The experiment results using a real world PV power output dataset show that the proposed models can successfully predict PV power outputs compared to the conventional prediction models. In particular, the proposed LSTM model yields the best performance in all of the experimental settings.
The paper is composed as follows: in Section 2, we introduce the research framework and the three proposed models to address the considered problem. In Section 3, we evaluate the performances of the proposed models by using a real-world dataset, and we conclude this research in Section 4.

2. Proposed Methods

2.1. Research Framework

In this paper, we consider the hourly prediction of PV power outputs in a day by using the meteorological and seasonal information given for each hour. In detail, Table 2 summarizes the inputs and the output with the related notations used in this study. For the inputs, four meteorological factors including temperature, humidity, cloudiness, and radiation, and two seasonal factors (month of year and day of month) are considered.
For representing the status of the i-th hour in the j-th day, a six dimensional input vector, x i , j = t i , j ,   k i , j ,   c i , j ,   r i , j ,   a i , j ,   b i , j ,   i = 1 , , n ,   j = 1 , , m , is defined where n means the number of hours to predict in a day and m is the number of days considered. A set of n input vectors consist of meteorological and seasonal factors for the j-th day is used when proposed models repeatedly learn to minimize by calculating between its estimated PV power outputs, denoted as s ^ i , j ,   i = 1 , , n , and the actual PV power outputs, denoted as s i , j ,   i = 1 , , n , to search abstract patterns for accurate prediction of PV power outputs in the j-th day. Furthermore, as our models are executable whenever meteorological information is ready, the prediction outputs can be obtained without the limitations on when the predictions are performed.
Figure 3 illustrates how the proposed approach works in terms of the features defined in Table 2. The detailed process of the proposed approach involves two phases. In the training phase, the weights of the prediction models in the proposed framework are updated towards the minimum error between the predicted and actual PV power outputs.
Our models are to forecast future PV power output by using uncertain meteorological information with many noises. Although the uncertain information contains in historical data, our models attempt to learn hidden patterns that more accurately estimate the PV power output. As we evaluate the performance our models using unseen data, the performance is believed to be generated in real-world settings.
To predict PV power outputs in a daily manner, the proposed models consist of an input layer with n nodes where each node is for a particular hour, and an output layer with n nodes where each node is for the prediction of a particular hour corresponding to its input. As this framework attempts to predict the PV power outputs for 14 h in a day by using the corresponding input factors for each hour. Therefore, we set n to be 14 in the remainder of this paper. Although the daylight time naturally changes according to seasons, the average daylight times observed in Gumi city in Korea in summer and winter in 2016 were 14 and 12 h, respectively [45]. If these each become longer than 14, one could slightly modify our models by adding an input, a hidden, and an output layer for additional prediction. In the testing phase, by using the weights in the prediction models obtained in the learning phases, the predicted outputs are calculated against the unseen inputs.

2.2. ANN and DNN Based PV Power Output Prediction

We propose two types of ANN-based prediction models: single-layer and multi-layer models. Both are widely applied for many prediction problems [46,47], including PV power output predictions [16,20]. The single-layer model is well-known for its simple architecture yet quite impressive performances. It consists of a single hidden layer with six nodes, each of which is linearly connected to both inputs and output nodes about input values presented in Table 2. Figure 4a illustrates the network architecture of the proposed single-layer model.
In the proposed ANN-based models, each node in a layer is responsible for producing an output that is utilized as the input values for one or more nodes. By utilizing the weights and the activation function related with a node, the output value is calculated, and the produced output value is then utilized as an input value for the nodes in the next layer.
At first, for a node in the input layer, its input value is to be one of values related with meteorological and seasonal factors, presented in Table 2. For a node in the output layer, based on its input values that come from the nodes in the previous layer, its output value is used as the final prediction for a particular hour based on the position of the node in the output layer.
When a node receives the input values, it calculates the weighted summation of its input values, called the net value for the node. Here, the weight value for each input value is initially set to be a random value between zero and one, and it is updated during the training phase that will be discussed later. Specifically, the net value for node q, denoted as n e t q , is calculated by using Equation (1):
n e t q =   p = 1 P w q , p o p
where w q , p is the weight value corresponding to the connection from node p to node q, o p means the output value produced by node p in the previous layer, and P is the number of nodes connected to node q.
By using the net value for node q, its output value, denoted as u q , is obtained by using Equation (2):
u q = { v ( n e t q ) , i f   n e t q > 0 , 0 , o t h e r w i s e .
where v ( · ) is an activation function that is used to transform an input value into an output value in a non-linear manner.
As the outputs of the nodes in an output layer are considered as the final predicted values of PV power output, u q , q = 1 , , n . Therefore, for the j-th day, u q is considered to be the prediction value for the q-th hour in the day, denoted as s ^ q , j .
Among many popular ones, we adopt the rectified linear unit (ReLU) for all the nodes in the hidden and output layers. ReLU is well-known for providing enhanced training performances and preventing the gradient vanishing and radiant exploding problems [48].
Whenever the proposed model consumes given training instances involving both the meteorological information and the actual PV power output for a particular hour, its weights are gradually updated through an iterative learning process. The back propagation and the Adam optimizer are applied for optimizing the weights of the proposed models [49,50].
For the j-th day, the amount of errors between the predicted PV outputs, s ^ i , j , i = 1 , , n , and the actual PV outputs, s i , j , i = 1 , , n , is measured by means of mean square error (MSE). Based on the MSE values for each training epoch, the Adam optimizer determines how much the weights are needed to be adjusted toward minimizing MSE values for the entire training dataset. For a given training dataset, the MSE based loss value between the actuals and predictions is obtained by using Equation (3):
L =   1 m j = 1 m i = 1 n ( s i , j s ^ i , j ) 2 n
In the testing phase, for given input values for each hour, its six dimensional input vector is generated, and then the outputs using Equations (1) and (2) is then simply calculated by using the weights obtained through the training phase.
The second DNN-based model, called the multi-layer model, is the same to the proposed single-layer model except for the fact that it contains seven hidden layers (shown in Figure 4b). The performance difference occurs depending on the number of hidden layers, but we chose seven hidden layers with the best performance through repeated experiments. As an extended version of the first model, it conducts more nonlinear calculations by using more hidden layers before producing the final predictions compared to the first one. The activation function, loss function, and optimizer for this model are the same to those for the first model.

2.3. LSTM-Based PV Power Output Prediction

To precisely capture the sequential PV power output patterns hidden in a day and across days, a further improved model, called LSTM-based model, is developed. In details, the proposed model attempts to learn the long-term relationships among the meteorological factors by considering their seasonal changes but also to understand the short-term relationships across the PV power outputs in a day.
In particular, when the proposed models are compared in terms of the output, the major difference comes from whether a model is trained the dependency among the consecutive information. That is, the former two models produce output for an hour against the meteorological and seasonal information on hour, the last one results on the output for an hour against the meteorological and seasonal information on the previous hours.
The proposed model consists of a block, called block cell, that collectively determine the intermediate outputs based on the current and past input values by utilizing the long and short term sequential memories, which is borrowed from the basic concept of LSTM [51]. The inputs of a block cell involve the current observations and some parameters while its outputs are a value to present the long-term dependency.
For the i-th hour in the j-th day, Figure 5 illustrates the architecture of the block cell consisting of three gates such as input, forget, and output gates, denoted as f i , j , g i , j ,   and o i , j , respectively. Here, h i , j means the outputs of the block cell in charge of representing the short term pattern for the observation related with the i-th hour. Additionally, (i) b g , b f , and b o are the bias vectors, and (ii) W h g , W h f , and W h o are the weight matrices for the input, forget, and output gates, respectively.
For calculating the output for a gate, the logistic sigmoid function is applied, denoted as σ , for the weighted summation results with respect to the current inputs, the past outputs, and the bias values for the gate. In summary, the gate outputs in LSTM block cell are calculated as Equations (4)–(6):
f i , j =   σ ( W x i , j f x i , j + W h f h i 1 , j + b f )
g i , j =   σ ( W x i , j g x i , j + W h g h i 1 , j + b g )
o i , j =   σ ( W x i , j o x i , j + W h o h i 1 , j + b o )
To obtain long term patterns for a specific hour that represent the long-term relationship among PV power outputs across days, the input and forget gates are involved. In particular, for the i-th hour in the j-th day, c i , j , based on the input gate output, f i , j , and the forget gate output, g i , j , as defined in Equation (7), and the operation “·” is a Hadamard multiplication:
C i , j =   f i , j · C i 1 , j + C ˜ i , j · g i , j
In Equation (7), C ˜ i , j = tanh ( W x i , j g x i , j + W h g h i 1 , j + b c ) means the pre-long term information is calculated based on the current observation and the short term pattern for the previous hour. That is, f i , j and g i , j jointly determine the usage level of the current input information for the next long term pattern.
The final output of the block cell for the i-th hour of the j-th day, h i , j , is simply examined based on the output gate value, o i , j , and the long term pattern, c i , j , presented in Equation (8):
h i , j =   o i , j · tan h ( C i , j )
Figure 6 shows the entire structure of the proposed LSTM model in terms of the previously explained concept of the block cell. The input and output values used in the proposed LSTM model are zero-one normalized to resolve the inconsistencies among units [52]. To take advantage of multilayer LSTM that enables to capture the longer-term dependencies of input sequences [53], three block cells are used for each input and a block cell for a previous hour is connected to another block cell for the next hour. There are many learning algorithms for LSTM; we use the backpropagation through time method (BPTT) with the Adagrad optimizer [54,55,56]. The activation function and loss function used ReLU and MSE like the proposed ANN- and DNN-based models.

3. Experiments

For the experiments of this research, we used the deep learning toolkit Keras. Among the famous deep learning toolkits such as Keras, Tensorflow, Theano, and Pytorch, Keras has a great benefit due to being easy and simple. Moreover, we used parameters such as optimizer, activation and loss function necessary of learning offered in the Keras library. Our computer resources consist of an i7-6700CPU, 8 GB RAM, and GPU1080. The learning and experiments phase of the proposed models were conducted in in the GPU environment.
The dataset used for experiments was gathered from a PV power output dataset during 39 months (from 1 June 2013 to 31 August 2016) from a PV operator located in Gumi city in South Korea. Among the entire 16,820 instances in the dataset, 11,510 instances observed from 1 June 2013 to 31 August 2015 were used for training the considered prediction models, while the remainder were regarded as unseen observations and 3616 and 1694 used for validating and testing the performances.
Table 3 shows the examples of the dataset used in these experiments. The unit of temperature value is Celsius, and cloudiness values ranges from 0 to 10 which the higher number means the more clouds in the air. Further, the value of humidity ranges from 0 to 100 where the higher value means more humidity in the sky. These meteorological data related to the area where the PV operator is located were obtained from the open dataset provided by the Korea government [57].
In the training phase, as the performance of proposed models varies depending on batch size [58,59], the batch size for the proposed ANN- and DNN-based models was set to 128, and it was set to 1 for the proposed LSTM-based model. We set the number of training epochs for the ANN- and DNN-based model to be 250 while it was 25 for the LSTM-based model. The initial values for the weights of all the proposed models were randomly set between zero and one. The performance of the proposed models depends on overfitting or underfitting, according to the number of epochs. Following the suggestions in [60,61], through many experimental trials, we determined the above settings minimizing the over- and underfitting problems while maximizing the generalization ability of the proposed models in terms of the loss value obtained using Equation (3).
Figure 7 presents the changes of the loss values for the three proposed models according to epochs during the training phase. The decreased loss values of training and validation as the number of epochs increases shown in the three graphs indicate that our models successfully attempt to search for better solutions against the given training dataset.
In addition, for comparison purposes, we implemented two popular statistical time-series models, called ARIMA and S-ARIMA, and two deep learning-based models, presented as DNN2 and LSTM2 in this paper. DNN2 model consists of a single input for the meteorological and seasonal information of a particular hour and an output resulting in the PV power output for the hour. The LSTM2 model attempts to predict PV power output by only using meteorological information without seasonal information [26,41,62]. ARIMA and S-ARIMA are widely used in time-series analysis and forecasting applications. ARIMA attempts to predict the future values based on auto-regressive and moving average techniques [63,64]. Unlike ARIMA, that focuses only on a few number of past instances observed just before, S-ARIMA exploits a larger number of past instances to consider the seasonal patterns throughout them [65]. The parameters for the two models were set to be the same as presented in [64,66].
To quantify how well a prediction model estimate actual outputs, we calculated the mean absolute error (MAE) based on the difference between each predicted PV power output for a given input instance against its actual value. Specifically, the mean absolute error, denoted as MAE, for the testing dataset is obtained by using Equation (9). Here, in the case of the actual PV power is zero, since the value becomes infinite, we set the error to be zero:
M A E = 1 m i = 1 m j = 1 n | s i , j s ^ i , j | j = 1 n s i , j
where m is the number of instances used in the testing phase.
Figure 8 compares the overall performances of the considered prediction models. The proposed ANN-based model is quite less effective compared to the conventional methods, ARIMA, S-ARIMA, DNN2, and LSTM2 models, while the proposed DNN-based model shows better performances compared to both the ANN-based model and the conventional ones. Overall, MAE was decreased 19%, 26%, 18% and 40% by the proposed DNN-based model compared to ARIMA, S-ARIMA, DNN2, and LSTM2, respectively. Such poor performance of the ANN-based model implies the limitation of the relationships between the current observation and its expected output without considering the time-series patterns.
Much better performances are obtained by the proposed LSTM-based model compared to all the models considered through exploiting both the long and short term patterns hidden in the past PV power outputs. The proposed LSTM-based model significantly reduces MAE by 80% compared to the ANN-based model, and 56%, 60%, 55%, and 61% of the performances are improved compared to ARIMA, S-ARIMA, DNN2, and LSTM2, respectively. The improvements of LSTM-based model are 53% against the DNN-based model with respect to MAE.
In the short term perspective that focuses on the hourly changes of PV power outputs in a day, Figure 9 depicts how well the proposed methods produce robust performances. Here, to compare the prediction performances according to the difficulty levels of days, when (i) its PV power is increased compared to that of its previous PV power and decreased compared to its next PV power or (ii) its PV power is decreased compared to that of its previous PV power and increased compared to its next PV power. In this cases, the number of changes of PV power outputs for each day is calculated. It is reasonable since more changes of PV power output means much difficulty to predict. The experimental results show the outstanding performances of the proposed LSTM-based model compared to the others, especially when the prediction difficulty level becomes high.
As the difficulty level becomes higher, the errors of the prediction models tend to increase, especially when the number of PV power output changes is larger than four. The proposed ANN- based model shows the worst performances among the models considered in many cases, and the proposed DNN- and LSTM-based model yield quite low errors compared to the conventional models for all cases. For ARIMA, S-ARIMA, DNN, DNN2, and LSTM2 more than 1% errors are frequently observed for the days with many PV power output changes, while the proposed LSTM-based model yields quite low errors even for these days. Especially, the proposed LSTM-based model shows successful results regardless of the number of PV power output changes and produces the quite impressive results for the days with the larger number of PV power output changes.
Such results imply that the architecture of LSTM that is designed to capture short and long term patterns is quite effective to accommodate not only the cases with few changes of PV power outputs but also the cases with many PV power output changes. On the contrary, the previous statistical prediction models, ARIMA and S-ARIMA, which are based on the direct dependency of consecutive observations, fail to precisely predict PV power outputs, especially for the cases with many PV power output changes.
Figure 10 visualizes the MAE values of the predicted PV power outputs according to the numbers of hourly PV power output changes. As shown in Figure 10a, when the number of PV power output changes is low, quite successful results are observed for all the models considered except the proposed ANN-based model. However, when the number of PV power output changes becomes larger, as shown in Figure 10a,b, many more errors are obtained. When the number of PV power output changes is seven, as shown in Figure 10c, only the proposed LSTM-based model yields successful results. This means that the simple approach that considers only the relationships between meteorological information and PV power outputs shows limited performance when the prediction difficulty becomes high. On the other hand, overall, the proposed LSTM-based model results in the most accurate predictions.
In the long term perspective that concerns about changes of PV power outputs across days, we measured the difference between the amount of PV power outputs produced in a day and its consecutive day. For the four seasons, spring, summer, autumn, and winter, the average change of PV power outputs between days were calculated as 33.2%, 19.2%, 24.7%, and 22.9%. Therefore, as any two consecutive days in a season show larger changes in terms of the amount of the daily PV power output, the spring and autumn are considered as hard seasons compared to the other remaining seasons, considered as easy seasons.
Figure 11 illustrates the prediction performances of the models considered according to the easy and hard seasons. Here, plus means improved performance, while minus means worse performance. The higher values of the mean absolute error are observed in the easy season than in the hard seasons for all the models. On the average, MAE is increased by 23.8% when predicting PV power outputs for the hard seasons compared to the easy seasons.
Although the proposed LSTM-based model performs worse for the hard seasons compared to the easy seasons, its improvements compared to the others become larger as shown in Table 4. The LSTM-based model outperforms the others by 60.4% on average in the easy seasons, while it shows 62% in the hard seasons in terms of MAE. Table 5 shows the detailed experimental results according to the seasons and the models considered in this paper.
Figure 12 visualizes the predicted PV power results for three pairs of consecutive two days. To demonstrate the ability to accommodate on the dynamic changes of PV power outputs across days, we choose examples based on the changes of the actual PV power outputs on consecutive days. First, when the amount of PV power output is similar between days, most of the considered models show quite successful results. On the other hand, as seen in Figure 10b,c, as the PV power output change for the second day is larger, the proposed LSTM-based model shows better performances compared to the others. That is, the efforts that consider the long term patterns between days rather than the short term patterns in a day are helpful for further precise predictions, especially when there are unstable PV power outputs among days.
RMSE may more useful when the large errors measured are particularly undesirable [67]. For the performance evaluation of the proposed models, we additionally adopt to attempt the perform in terms of root mean square error (RMSE). Specifically, RMSE is calculated by using Equation (10):
R M S E = 1 m i = 1 m j = 1 n ( s i , j s ^ i , j ) 2 j = 1 n s i , j
where m is the number of instances used in the testing phase.
Table 6 compares the performances of the proposed models in terms of RMSE according to seasons. All the proposed models yield similar errors such as MAE, and outperform in summer like in previous research results [12]. The proposed ANN-based model performs in winter compared to the remaining seasons, while the proposed LSTM-based model yields quite fewer errors for all seasons.

4. Conclusions

In this study, we have proposed a PV power prediction method based on neural networks. First, we suggest a simple ANN-based model that focuses only on the relationships between metrological information and PV power output for a particular hour. Next, a developed version of the firstly proposed model, a DNN-based model, is suggested by using more hidden layers. Finally, a more sophisticated model, a LSTM-based model, which considers both short and long term patterns in a day and across days, respectively, is proposed.
By using the experiment results from a real-world dataset, although the proposed ANN-based model fails to result in better performances compared to the conventional models, the proposed DNN- and LSTM-based models outperform them. Especially, the LSTM-based model shows quite successful performances for most of the experiment settings. Moreover, for the days that involve many changes of PV power outputs, the proposed LSTM-based model yields much better results than the others.
In this paper, the PV power outputs on a particular day are assumed to be independent of those on another day, while the output at a particular hour depends on that during its previous hour. We note that incorporating information from previous hours and previous days would be helpful to improve prediction quality as suggested in [68], but it becomes very difficult due to the increased parameters to be learned. Therefore, to improve the performances of the proposed LSTM-based model in Section 2.3, we plan to utilize these information through enhancing techniques for more sophisticated prediction learns as a future study.
Further, based on the models suggested in this paper, we plan to further improve the proposed models towards PV power output prediction without metrological information. Since there still exist many areas where such detailed metrological information is unavailable, we believe that these prediction models are much practical.

Author Contributions

D.L. and K.K. conducted the initial design and developed the framework. D.L. wrote the draft of the manuscript, while K.K. reviewed and proof read the paper.

Funding

This work was supported by the Incheon National University (International Cooperative) Research Grant in 2015.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Saw, L.H.; Poon, H.M.; Thiam, H.S.; Cai, Z.; Chong, W.T.; Pambudi, N.A.; King, Y.J. Novel Thermal Management System Using Mist Cooling for Lithium-ion Battery Packs. Appl. Energy 2018, 223, 146–158. [Google Scholar] [CrossRef]
  2. Ming, B.; Liu, P.; Cheng, L.; Zhou, Y.; Wang, X. Optimal Daily Generation Ccheduling of Large Yydro-Photovoltaic Hybrid Power Plants. Energy Convers. Manag. 2018, 171, 528–540. [Google Scholar] [CrossRef]
  3. Deshmukh, M.K.; Deshmukh, S.S. Modeling of Hybrid Renewable Energy Systems. Renew. Sustain. Energy Rev. 2008, 12, 235–249. [Google Scholar] [CrossRef]
  4. Paska, J.; Biczel, P.; Kłos, M. Hybrid Power Systems-An Effective Way of Utilising Primary Energy Sources. Renew. Energy 2009, 34, 2414–2421. [Google Scholar] [CrossRef]
  5. Hoffmann, W. PV Solar Electricity Industry: Market Growth and Perspective. Sol. Energy Mater. Sol. Cells 2006, 90, 3285–3311. [Google Scholar] [CrossRef]
  6. Pierro, M.; Bucci, F.; De Felice, M.; Maggioni, E.; Moser, D.; Perotto, A.; Spada, F.; Cornaro, C. Multi-Model Ensemble for Day Ahead Prediction of Photovoltaic Power Generation. Sol. Energy 2016, 134, 132–146. [Google Scholar] [CrossRef]
  7. Zhou, Y.; Wang, C.; Wu, J.; Wang, J.; Cheng, M.; Li, G. Optimal Scheduling of Aggregated Thermostatically Controlled Loads with Renewable Generation in the Intraday Electricity Market. Appl. Energy 2017, 188, 456–465. [Google Scholar] [CrossRef]
  8. Ayón, X.; Moreno, M.Á.; Usaola, J. Aggregators’ Optimal Bidding Strategy in Sequential Day-Ahead and Intraday Electricity Spot Markets. Energies 2017, 10, 450. [Google Scholar] [CrossRef]
  9. Rowlands, I.H. Solar PV Electricity and Market Characteristics: Two Canadian Case-studies. Renew. Energy 2005, 30, 815–834. [Google Scholar] [CrossRef]
  10. Yona, A.; Senjyu, T.; Funabashi, T.; Mandal, P.; Kim, C.-H. Optimizing Re-planning Operation for Smart House Applying Solar Radiation Forecasting. Appl. Sci. 2014, 4, 366–379. [Google Scholar] [CrossRef] [Green Version]
  11. Inman, R.H.; Pedro, H.T.C.; Coimbra, C.F.M. Solar Forecasting Methods for Renewable Energy Integration. Prog. Energy Combust. Sci. 2013, 39, 535–576. [Google Scholar] [CrossRef]
  12. Kardakos, E.G.; Alexiadis, M.C.; Vagropoulos, S.I.; Simoglou, C.K.; Biskas, P.N.; Bakirtzis, A.G. Application of Time Series and Artificial Neural Network Models in Short-term Forecasting of PV Power Generation. In Proceedings of the 48th International Universities Power Engineering Conference, Dublin, Ireland, 2–5 September 2013; pp. 1–6. [Google Scholar]
  13. Cai, T.; Duan, S.; Chen, C. Forecasting Power Output for Grid-connected Photovoltaic Power System Without Using Solar Radiation Measurement. In Proceedings of the International Symposium on Power Electronics for Distributed Generation Systems, Hefei, China, 16–18 June 2010; pp. 773–777. [Google Scholar]
  14. Yona, A.; Senjyu, T.; Funabashi, T.; Kim, C.H. Determination Method of Insolation Prediction with Fuzzy and Applying Neural Network for Long-term Ahead PV Power Output Correction. IEEE Trans. Sustain. Energy 2013, 2, 527–533. [Google Scholar] [CrossRef]
  15. Dumitru, C.-D.; Gligor, A.; Enachescu, C. Solar Photovoltaic Energy Production Forecast Using Neural Networks. Procedia Technol. 2016, 22, 808–815. [Google Scholar] [CrossRef] [Green Version]
  16. Izgi, E.; Öztopal, A.; Yerli, B.; Kaymak, M.K.; Şahin, A.D. Short-mid-term Solar Power Prediction by Using Artificial Neural Networks. Sol. Energy 2012, 86, 725–733. [Google Scholar] [CrossRef]
  17. Sulaiman, S.I.; Rahman, T.K.A.; Musirin, I. Partial Evolutionary ANN for Output Prediction of a Grid-Connected Photovoltaic System. Int. J. Comput. Electr. Eng. 2009, 1, 40–45. [Google Scholar] [CrossRef]
  18. Wang, S.; Zhang, N.; Zhao, Y.; Zhan, J. Photovoltaic System Power Forecasting Based on Combined Grey Model and BP Neural Network. In Proceedings of the International Conference on Electrical and Control Engineering, Yichang, China, 16–18 September 2011; pp. 4623–4626. [Google Scholar]
  19. Son, J.; Park, Y.; Lee, J.; Kim, H. Sensorless PV Power Forecasting in Grid-Connected Buildings through Deep Learning. Sensors 2018, 18, 2529. [Google Scholar] [CrossRef] [PubMed]
  20. Ashraf, I. Chandra, a Artificial Neural Ntwork Bsed Mdels for Frecasting Eectricity Gneration of Gid Connected Solar PV Power Plant. Int. J. Glob. Energy Issues 2004, 21, 119–130. [Google Scholar] [CrossRef]
  21. Shi, J.; Lee, W.J.; Liu, Y.; Yang, Y.; Wang, P. Forecasting Power Output of Photovoltaic Systems Based on Weather Classification and Support Vector Machines. IEEE Trans. Ind. Appl. 2012, 48, 1064–1069. [Google Scholar] [CrossRef]
  22. Da Silva Fonseca, J.G.; Oozeki, T.; Takashima, T.; Koshimizu, G.; Uchida, Y.; Ogimoto, K. Use of Support Vector Regression and Numerically Predicted Cloudiness to Forecast Power Output of a Photovoltaic Power Plant in Kitakyushu, Japan. Proc. Photovolt. Res. Appl. 2012, 20, 874–882. [Google Scholar] [CrossRef]
  23. Bouzerdoum, M.; Mellit, A.; Massi Pavan, A. A Hybrid Model (SARIMA-SVM) for Short-term Power Forecasting of a Small-scale Grid-connected Photovoltaic Plant. Sol. Energy 2013, 98, 226–235. [Google Scholar] [CrossRef]
  24. Mellit, A.; Shaari, S. Recurrent Neural Network-Based Forecasting of The Daily Electricity Generation of a Photovoltaic Power System. In Proceedings of the Ecological Vehicle and Renewable Energy, Monte-Carlo, Monaco, 26–29 March 2009; pp. 26–29. [Google Scholar]
  25. Mandal, P.; Madhira, S.T.S.; Ul haque, A.; Meng, J.; Pineda, R.L. Forecasting Power Output of Solar Photovoltaic System Using Wavelet Transform and Artificial Intelligence Techniques. Procedia Comput. Sci. 2012, 12, 332–337. [Google Scholar] [CrossRef] [Green Version]
  26. Abdel-Nasser, M.; Mahmoud, K. Accurate Photovoltaic Power Forecasting Models Using Deep LSTM-RNN. In Neural Computing and Applications; Springer: London, UK, 2017; pp. 1–14. [Google Scholar]
  27. Chattopadhyay, K.; Kies, A.; Lorenz, E.; von Bremen, L.; Heinemann, D. The Impact of Different PV Module Configurations on Storage and Additional Balancing Needs for a fully Renewable European Power System. Renew. Energy 2017, 113, 176–189. [Google Scholar] [CrossRef]
  28. Jurasz, J.; Ciapała, B. Solar–hydro Hybrid Power Station as a Way to Smooth Power Output and Increase Water Retention. Sol. Energy 2018, 173, 675–690. [Google Scholar] [CrossRef]
  29. Ding, M.; Wang, L.; Bi, R. An ANN-based Approach for Forecasting The Power Output of Photovoltaic System. Procedia Environ. Sci. 2011, 11, 1308–1315. [Google Scholar] [CrossRef]
  30. Long, H.; Zhang, Z.; Su, Y. Analysis of Daily Solar Power Prediction with Data-driven Approaches. Appl. Energy 2014, 126, 29–37. [Google Scholar] [CrossRef]
  31. Jiahao, K.; Jun, L.; Qifan, L.; Wanliang, F.; Zhenhuan, C.; Linlin, L.; Tieying, G. Photovoltaic Power Forecasting Based on Artificial Neural Network and Meteorological Data. In Proceedings of the IEEE Region 10 Conference, Xi’an, China, 22–25 October 2013; pp. 1–4. [Google Scholar]
  32. Hiyama, T.; Kitabayashi, K. Neural Network Based Estimation of Maximum Power Generation from PV Module Using Environmental Information. IEEE Trans. Energy Convers. 1997, 12, 241–247. [Google Scholar] [CrossRef]
  33. Wang, G.; Su, Y.; Shu, L. One-day-ahead Daily Power Forecasting of Photovoltaic Systems Based on Partial Functional Linear Regression Models. Renew. Energy 2016, 96, 469–478. [Google Scholar] [CrossRef]
  34. Li, Y.; He, Y.; Su, Y.; Shu, L. Forecasting The Daily Power Output of a Grid-connected Photovoltaic System Based on Multivariate Adaptive Regression Splines. Appl. Energy 2016, 180, 392–401. [Google Scholar] [CrossRef]
  35. Li, Y.; Su, Y.; Shu, L. An ARMAX Model for Forecasting The Power Output of a Grid Connected Photovoltaic System. Renew. Energy 2014, 66, 78–89. [Google Scholar] [CrossRef]
  36. Mora-López, L.; Martinez-Marchena, I.; Piliougine, M.; Sidrach-deCardona, M. Machine Learning Approach for Next Day Energy Production Forecasting in Grid Connected Photovoltaic Plants. In Proceedings of the World Renewable Energy Congress-Sweden, Linköping, Sweden, 8–13 May 2011; pp. 2869–2874. [Google Scholar]
  37. Al-Messabi, N.; Li, Y.; El-Amin, I.; Goh, C. Forecasting of Photovoltaic Power Yield Using Dynamic Neural Networks. In Proceedings of the International Joint Conference on Neural Networks, Brisbane, Australia, 10–15 June 2012; pp. 1–5. [Google Scholar]
  38. Chen, C.; Duan, S.; Cai, T.; Liu, B. Online 24-h Solar Power Forecasting Based on Weather Type Classification Using Artificial Neural Network. Sol. Energy 2011, 85, 2856–2870. [Google Scholar] [CrossRef]
  39. Yona, A.; Senjyu, T.; Saber, A.Y.; Funabashi, T.; Sekine, H.; Kim, C.H. Application of Neural Network to 24-hour-ahead Generating Power Forecasting for PV System. In Proceedings of the IEEE Power and Energy Society General Meeting: Conversion and Delivery of Electrical Energy in the 21st Century, Niigata, Japan, 5–8 November 2008; pp. 1–6. [Google Scholar]
  40. Bengio, Y.; Simard, P.; Frasconi, P. Learning Long Term Dependencies with Gradient Descent is Difficult. IEEE Trans. Neural Netw. 1994, 5, 157–166. [Google Scholar] [CrossRef] [PubMed]
  41. Gensler, A.; Henze, J.; Sick, B.; Raabe, N. Deep Learning for Solar Power Forecasting—An Approach Using AutoEncoder and LSTM Neural Networks. In Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics, Budapest, Hungary, 9–12 October 2016; pp. 002858–002865. [Google Scholar]
  42. Wang, Y.; Shen, Y.; Mao, S.; Chen, X.; Zou, H. LASSO & LSTM Integrated Temporal Model for Short-term Solar Intensity Forecasting. IEEE Internet Things J. 2018. [Google Scholar] [CrossRef]
  43. Wang, F.; Yu, Y.; Zhang, Z.; Li, J.; Zhen, Z.; Li, K. Wavelet Decomposition and Convolutional LSTM Networks Based Improved Deep Learning Model for Solar Irradiance Forecasting. Appl. Sci. 2018, 8, 1286. [Google Scholar] [CrossRef]
  44. Sorkun, M.C.; Paoli, C.; Incel, Ö.D. Time Series Forecasting on Solar Irradiation Using Deep Learning. In Proceedings of the 10th International Conference on Electrical and Electronics Engineering, Bursa, Turkey, 30 November–2 December 2017; pp. 151–155. [Google Scholar]
  45. Wheather Data Release Portal. Available online: https://data.kma.go.kr/cmmn/main.do (accessed on 21 November 2018).
  46. Garro, B.A.; Rodríguez, K.; Vázquez, R.A. Classification of DNA Microarrays Using Artificial Neural Networks and ABC Algorithm. Appl. Soft Comput. 2015. [Google Scholar] [CrossRef]
  47. Pastur-Romay, L.A.; Cedrón, F.; Pazos, A.; Porto-Pazos, A.B. Deep Artificial Neural Networks and Neuromorphic Chips for Big Data Analysis: Pharmaceutical and Bioinformatics Applications. Int. J. Mol. Sci. 2016, 17, 1313. [Google Scholar] [CrossRef]
  48. Krizhevsky, A.; Sutskever, I.; Hinton, G. Imagenet Classification with Deep Convolutional Neural Networks. Adv. Neural Inf. 2012, 25, 1–9. [Google Scholar] [CrossRef]
  49. Hagan, M.T.; Menhaj, M.B. Training Feedforward Networks with The Marquardt Algorithm. IEEE Trans. Neural Netw. 1994, 5, 989–993. [Google Scholar] [CrossRef]
  50. Kingma, D.P.; Ba, J.L. Adam: A Method for Stochastic Optimization. arXiv, 2014; arXiv:1412.6980. [Google Scholar]
  51. Greff, K.; Srivastava, R.K.; Koutnik, J.; Steunebrink, B.R.; Schmidhuber, J. LSTM: A Search Space Odyssey. IEEE Trans. Neural Netw. Learn. Syst. 2017, 28, 2222–2232. [Google Scholar] [CrossRef] [Green Version]
  52. Sola, J.; Sevilla, J. Importance of Input Data Normalization for the Application of Neural Networks to Complex Industrial Problems. IEEE Trans. Nucl. Sci. 1997, 44, 1464–1468. [Google Scholar] [CrossRef]
  53. Zhang, S.; Liu, X.; Xiao, J. On Geometric Features for Skeleton-Based Action Recognition Using Multilayer LSTM Networks. In Proceedings of the IEEE Winter Conference on Applications of Computer Vision, Santa Rosa, CA, USA, 24–31 March 2017. [Google Scholar]
  54. Williams, R.J.; Zipser, D. Gradient-Based Learning Algorithms for Recurrent Networks and Their Computational Complexity. BackPropag. Theory Archit. Appl. 1995, 1, 433–486. [Google Scholar] [CrossRef]
  55. Graves, A. Generating Sequences with Recurrent Neural Networks. arXiv, 2013; arXiv:1308.0850. [Google Scholar] [CrossRef]
  56. Duchi, J.; Hazan, E.; Singer, Y. Adaptive Subgradient Methods for Online Learning and Stochastic Optimization. J. Mach. Learn. Res. 2011, 12, 2121–2159. [Google Scholar] [CrossRef]
  57. Astronomy Space Information of Korea Astronomy and Space Science Institute. Available online: https://astro.kasi.re.kr/life/pageView/6 (accessed on 21 November 2018).
  58. Dean, J.; Corrado, G.S.; Monga, R.; Chen, K.; Devin, M.; Le, Q.V.; Mao, M.Z.; Ranzato, M.A.; Senior, A.; Tucker, P.; et al. Large Scale Distributed Deep Networks. Adv. Neural Inf. Process. Syst. 2012. [Google Scholar] [CrossRef]
  59. Masters, D.; Luschi, C. Revisiting Small Batch Training for Deep Neural Networks. arXiv 2018, arXiv:1804.07612v1. [Google Scholar]
  60. Li, M.; Zhang, T.; Chen, Y.; Smola, A.J. Efficient Mini-batch Training for Stochastic Optimization. In Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, New York, NY, USA, 24–27 August 2014; pp. 661–670. [Google Scholar]
  61. Glorot, X.; Bengio, Y. Understanding the Difficulty of Training Deep Feedforward Neural Networks. In Proceedings of the Thirteenth International Conference on Artificial Intelligence and Statistics, Sardinia, Italy, 13–15 May 2010; Volume 9, pp. 249–256. [Google Scholar]
  62. Cui, S. Solar Energy prediction and task scheduling for wireless sensor nodes based on long short term memory. J. Phys. 2018, 1074, 1–14. [Google Scholar] [CrossRef]
  63. Zhang, G.P. Time Series Forecasting Using a Hybrid ARIMA and Neural Network Model. Neurocomputing 2003, 50, 159–175. [Google Scholar] [CrossRef]
  64. Box, G.E.P.; Jenkins, G.M.; Reinsel, G.C.; Ljung, G.M. Time Series Analysis: Forecasting & Control; Wiley: New York, NY, USA, 2015; ISBN 8131716333. [Google Scholar]
  65. Yu, L.; Zhou, L.; Tan, L.; Jiang, H.; Wang, Y.; Wei, S.; Nie, S. Application of a New Hybrid Model with Seasonal Auto-regressive Integrated Moving Average (ARIMA) and Nonlinear Auto-regressive Neural Network (NARNN) in Forecasting Incidence Cases of HFMD in Shenzhen, China. PLoS ONE 2014, 9, e98241. [Google Scholar] [CrossRef] [PubMed]
  66. Yule, G.U. Why do we Sometimes get Nonsense-Correlations between Time-Series?—A Study in Sampling and the Nature of Time-Series. J. R. Stat. Soc. 1926, 89, 1–63. [Google Scholar] [CrossRef]
  67. Willmott, C.J.; Matsuura, K. Advantages of the Mean Absolute Error (MAE) Over the Root Mean Square Error (RMSE) in Assessing Average Model Performance. Clim. Res. 2005, 30, 79–82. [Google Scholar] [CrossRef]
  68. Zhang, Y.; Wang, J. GEFCom2014 Probabilistic Solar Power Forecasting Based on k-nearest Neighbor and Kernel Density Estimator. In Proceedings of the Power & Energy Society General Meeting, Denver, CO, USA, 26–30 July 2015; pp. 1–5. [Google Scholar]
Figure 1. Examples of the PV power output distribution during two consecutive days.
Figure 1. Examples of the PV power output distribution during two consecutive days.
Energies 12 00215 g001
Figure 2. Development process of the proposed models.
Figure 2. Development process of the proposed models.
Energies 12 00215 g002
Figure 3. Proposed neural network-based framework for hourly PV power output prediction.
Figure 3. Proposed neural network-based framework for hourly PV power output prediction.
Energies 12 00215 g003
Figure 4. Proposed ANN-based models for hourly PV power prediction.
Figure 4. Proposed ANN-based models for hourly PV power prediction.
Energies 12 00215 g004
Figure 5. Block cell structure of the proposed LSTM model for hourly PV power prediction.
Figure 5. Block cell structure of the proposed LSTM model for hourly PV power prediction.
Energies 12 00215 g005
Figure 6. Overall structure of the proposed LSTM model for hourly PV power prediction.
Figure 6. Overall structure of the proposed LSTM model for hourly PV power prediction.
Energies 12 00215 g006
Figure 7. Changes of the loss values according to the number of epochs during the training phase.
Figure 7. Changes of the loss values according to the number of epochs during the training phase.
Energies 12 00215 g007
Figure 8. Performance comparisons using the testing dataset in terms of mean absolute error (MAE) (DNN and the LSTM are the proposed models).
Figure 8. Performance comparisons using the testing dataset in terms of mean absolute error (MAE) (DNN and the LSTM are the proposed models).
Energies 12 00215 g008
Figure 9. Distribution of mean absolute error (MAE) according to the hourly changes of PV power output in a day.
Figure 9. Distribution of mean absolute error (MAE) according to the hourly changes of PV power output in a day.
Energies 12 00215 g009
Figure 10. Examples of predicted PV power results of according to the numbers of PV power output changes.
Figure 10. Examples of predicted PV power results of according to the numbers of PV power output changes.
Energies 12 00215 g010aEnergies 12 00215 g010b
Figure 11. Performance comparisons according to easy and hard seasons.
Figure 11. Performance comparisons according to easy and hard seasons.
Energies 12 00215 g011
Figure 12. Visualizations of the predicted PV power outputs for consecutive two days.
Figure 12. Visualizations of the predicted PV power outputs for consecutive two days.
Energies 12 00215 g012aEnergies 12 00215 g012bEnergies 12 00215 g012c
Table 1. Overview of previous research related to PV power output prediction.
Table 1. Overview of previous research related to PV power output prediction.
CategoriesTechniques UsedReferences
Short-term predictionENNDumitru C.-D. et al. [15]
ANNIzgi, E. et al. [16], Sulaiman S. et al. [17]
RNNMellit, A., and Shaari, S. [24], Mandal, P. et al. [25], Abdel-Nasser et al. [26]
DNNWang, S. et al. [18], Son, J. et al. [19], Ashraf, I., and Chandra, A. [20]
SVMShi, J, et al. [21], Da Silva Fonseca, J. G. et al. [22], Bouzerdoum, M. et al. [23]
Long-term PredictionHybrid SystemsChattopadhyay, K et al. [27], Jurasz, J. and Ciapala, B. [28]
ANNDing, M. et al. [29], Long, H et al. [30]
DNNJiahao, K. et al. [31], Hiyama, T., and Kitabayashi, K. [32]
PFLRM and RPFLRMWang, G. et al. [33]
MAR, LR, ARMAXLi, Y. et al. [34], Li, Y. et al. [35], Mora-López, L. et al. [36]
Dynamic Neural NetworkAl-Messab, N. et al. [37]
RBFNNChen, C. et al. [38], Yona, A. et al. [39]
Table 2. Input and output features and notations for the i-th hour in the j-th day.
Table 2. Input and output features and notations for the i-th hour in the j-th day.
CategoriesFeaturesNotations
InputsMeteorological factorTemperature (t) t i , j
Humidity (k) k i , j
Cloudiness (c) c i , j
Radiation (r) r i , j
Seasonal factorMonth of year (a) a i , j
Day of month (b) b i , j
Output-Predicted
PV power output (s)
s ^ i , j
Table 3. Obtained input and output values for learning proposed models (11 August 2015).
Table 3. Obtained input and output values for learning proposed models (11 August 2015).
Input ValuesOutput Value
HourTemperature (°C)Humidity (%)Cloudiness IndexRadiation (W/m2)Month of Year (-)Day of Month (-)Actual PV Power Output (kW)
0623.49310MD0
0724.390193.1MD2
0826851249.7MD5
0927.5781346.1MD6
1029.7681408.9MD9
1130.8651447.1MD11
1233.6522677.7MD18
1333553656.5MD20
1433.1533663.9MD18
1531.4554592.5MD17
1632.1533423.5MD11
1730.9623323.4MD8
1829.3633196.3MD3
1927.271145.5MD0
Table 4. Improved ratio performance of between applied methods on easy and hard seasons.
Table 4. Improved ratio performance of between applied methods on easy and hard seasons.
Improvement Ratios (%)
ANNARIMAS-ARIMADNNDNN2LSTMLSTM2
AgainstANN-+68.657+66.468+75.283+68.897+85.882+58.666
ARIMA--−6.984+21.138+1.374+54.957−23.075
S-ARIMA---+26.287+7.889+57.898−17.894
DNN----−22.843+42.883−38.746
DNN2-----+56.506−27.753
LSTM------−62.912
LSTM2-------
(a) Performance improvements among the methods applied for the easy seasons
Improvement Ratios (%)
ANNARIMAS-ARIMADNNDNN2LSTMLSTM2
AgainstANN-+60.905+56.147+67.765+73.693+74.017+63.058
ARIMA--−12.169+29.548+31.549+34.559−3.159
S-ARIMA---+33.493+35.357+37.272+8.717
DNN----+3.492+7.314−45.443
DNN2-----+4.061−50.706
LSTM------−57.086
LSTM2-------
(b) Performance improvements among the methods applied for the hard seasons
Table 5. Details of the performances according to seasons in 2016 (underline means the highest performance for each week).
Table 5. Details of the performances according to seasons in 2016 (underline means the highest performance for each week).
Month of YearWeek of MonthMAE
ANNARIMAS-ARIMADNNDNN2LSTMLSTM2
14.5391.2141.2161.4091.0490.6860.998
Spring22.0991.0131.0490.8230.8480.4141.122
(April)32.6770.9160.9330.7100.7820.4091.174
42.0150.9340.9290.5330.7850.2831.062
12.4510.3900.3840.5110.7910.3180.864
Summer22.3280.4250.4070.4860.8780.3300.894
(August)32.1320.3530.3350.4930.8450.2390.799
42.6101.1311.3000.4680.6050.2630.924
12.3590.6550.8150.7530.7470.4681.035
Autumn22.0400.5920.5820.7360.6830.2960.955
(October)32.2000.4840.4470.9570.4890.2441.185
41.9971.9822.7670.5020.5960.5840.924
11.8830.9411.2670.4221.0450.3190.801
Winter21.9020.7410.7770.7550.8040.3890.857
(March)32.0050.8740.8420.6660.7750.2850.994
42.0010.5710.4930.4781.3560.3011.197
Table 6. Performance comparisons in terms of RMSE according to seasons in 2016.
Table 6. Performance comparisons in terms of RMSE according to seasons in 2016.
RMSE
ANNARIMAS-ARIMADNNDNN2LSTMLSTM2
Spring (April)3.6171.2541.2561.0231.2580.7801.797
Summer (August)1.6690.8890.8430.7010.9950.5631.262
Autumn (October)3.1181.2511.2401.0441.0610.6981.677
Winter (March)8.0151.8291.4501.0961.5920.8741.816

Share and Cite

MDPI and ACS Style

Lee, D.; Kim, K. Recurrent Neural Network-Based Hourly Prediction of Photovoltaic Power Output Using Meteorological Information. Energies 2019, 12, 215. https://0-doi-org.brum.beds.ac.uk/10.3390/en12020215

AMA Style

Lee D, Kim K. Recurrent Neural Network-Based Hourly Prediction of Photovoltaic Power Output Using Meteorological Information. Energies. 2019; 12(2):215. https://0-doi-org.brum.beds.ac.uk/10.3390/en12020215

Chicago/Turabian Style

Lee, Donghun, and Kwanho Kim. 2019. "Recurrent Neural Network-Based Hourly Prediction of Photovoltaic Power Output Using Meteorological Information" Energies 12, no. 2: 215. https://0-doi-org.brum.beds.ac.uk/10.3390/en12020215

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop