A Spatio-Temporal Graph Neural Network Approach for Traffic Flow Prediction
Abstract
:1. Introduction
2. Related Work
3. Statistical Methods
3.1. Traditional Machine Learning Methods
3.2. Deep Learning Methods
4. Methodology
4.1. The Define of STGNN
4.2. The Prediction Process of STGNN
5. Experiments
5.1. Datesets Details
5.2. Comparison Models
5.3. Evaluation Indicators
- RMSE: Root Mean Square Error
- MAPE: Mean Absolute Percentage Error
- MAE Mean Absolute Error
5.4. Performance Comparison
6. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
References
- Pavlyuk, D. Feature selection and extraction in spatiotemporal traffic forecasting: A systematic literature review. Eur. Transp. Res. Rev. 2019, 11, 6. [Google Scholar] [CrossRef]
- Yang, H.F.; Dillon, T.S.; Chen, Y.P.P. Optimized structure of the traffic flow forecasting model with a deep learning approach. IEEE Trans. Neural Netw. Learn. Syst. 2016, 28, 2371–2381. [Google Scholar] [CrossRef] [PubMed]
- Alsolami, B.; Mehmood, R.; Albeshri, A. Hybrid Statistical and Machine Learning Methods for Road Traffic Prediction: A Review and Tutorial. In Smart Infrastructure and Applications; Springer: New York, NY, USA, 2020; pp. 115–133. [Google Scholar]
- Zheng, Z.; Yang, Y.; Liu, J.; Dai, H.N.; Zhang, Y. Deep and Embedded Learning Approach for Traffic Flow Prediction in Urban Informatics. IEEE Trans. Intell. Transp. Syst. 2019, 20, 3927–3939. [Google Scholar] [CrossRef]
- Wu, Z.; Pan, S.; Chen, F.; Long, G.; Zhang, C.; Yu, P.S. A comprehensive survey on graph neural networks. arXiv 2019, arXiv:1901.00596. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Zhou, J.; Cui, G.; Zhang, Z.; Yang, C.; Liu, Z.; Wang, L.; Li, C.; Sun, M. Graph neural networks: A review of methods and applications. arXiv 2018, arXiv:1812.08434. [Google Scholar] [CrossRef]
- Ma, X.; Dai, Z.; He, Z.; Ma, J.; Wang, Y.; Wang, Y. Learning traffic as images: A deep convolutional neural network for large-scale transportation network speed prediction. Sensors 2017, 17, 818. [Google Scholar] [CrossRef] [Green Version]
- Gers, F.A.; Schmidhuber, J.; Cummins, F. Learning to forget: Continual prediction with LSTM. Neural Comput. 1999, 12, 2451–2471. [Google Scholar] [CrossRef]
- Gao, Y.; Er, M.J. NARMAX time series model prediction: Feedforward and recurrent fuzzy neural network approaches. Fuzzy Sets Syst. 2005, 150, 331–350. [Google Scholar] [CrossRef]
- Van Lint, J.; Hoogendoorn, S.; van Zuylen, H.J. Freeway travel time prediction with state-space neural networks: Modeling state-space dynamics with recurrent neural networks. Transp. Res. Rec. 2002, 1811, 30–39. [Google Scholar] [CrossRef]
- Hinton, G.E. Deep belief networks. Scholarpedia 2009, 4, 5947. [Google Scholar] [CrossRef]
- Moussavi-Khalkhali, A.; Jamshidi, M. Feature Fusion Models for Deep Autoencoders: Application to Traffic Flow Prediction. Appl. Artif. Intell. 2019, 33, 1179–1198. [Google Scholar] [CrossRef]
- Yu, G.; Zhang, C. Switching ARIMA model based forecasting for traffic flow. In Proceedings of the 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing, IEEE, Montreal, QC, Canada, 17–21 May 2004; Volume 2, pp. ii–429. [Google Scholar]
- Yu, B.; Song, X.; Guan, F.; Yang, Z.; Yao, B. k-Nearest neighbor model for multiple-time-step prediction of short-term traffic condition. J. Transp. Eng. 2016, 142, 04016018. [Google Scholar] [CrossRef]
- Innamaa, S. Short-term prediction of traffic situation using MLP-neural networks. In Proceedings of the 7th World Congress on Intelligent Transport Systems, Turin, Italy, 6–9 November 2000; pp. 6–9. [Google Scholar]
- Guo, J.; Huang, W.; Williams, B.M. Adaptive Kalman filter approach for stochastic short-term traffic flow rate prediction and uncertainty quantification. Transp. Res. Part C Emerg. Technol. 2014, 43, 50–64. [Google Scholar] [CrossRef]
- Ko, E.; Ahn, J.; Kim, E. 3D Markov process for traffic flow prediction in real-time. Sensors 2016, 16, 147. [Google Scholar] [CrossRef] [Green Version]
- Smith, B.L.; Demetsky, M.J. Short-term traffic flow prediction models—A comparison of neural network and nonparametric regression approaches. In Proceedings of the IEEE International Conference on Systems, Man and Cybernetics, San Antonio, TX, USA, 2–5 October 1994; Volume 2, pp. 1706–1709. [Google Scholar]
- Jiang, W.; Xiao, Y.; Liu, Y.; Liu, Q.; Li, Z. Bi-GRCN: A Spatio-Temporal Traffic Flow Prediction Model Based on Graph Neural Network. J. Adv. Transp. 2022, 2022, 5221362. [Google Scholar] [CrossRef]
- Ye, J.; Xue, S.; Jiang, A. Attention-based spatio-temporal graph convolutional network considering external factors for multi-step traffic flow prediction. Digit. Commun. Netw. 2021. [Google Scholar] [CrossRef]
- Ali, A.; Zhu, Y.; Zakarya, M. Exploiting dynamic spatio-temporal graph convolutional neural networks for citywide traffic flows prediction. Neural Netw. 2022, 145, 233–247. [Google Scholar] [CrossRef]
- Grubb, H.; Mason, A. Long lead-time forecasting of UK air passengers by Holt–Winters methods with damped trend. Int. J. Forecast. 2001, 17, 71–82. [Google Scholar] [CrossRef]
- Dantas, T.M.; Oliveira, F.L.C.; Repolho, H.M.V. Air transportation demand forecast through Bagging Holt Winters methods. J. Air Transp. Manag. 2017, 59, 116–123. [Google Scholar] [CrossRef]
- Abadi, A.; Rajabioun, T.; Ioannou, P.A. Traffic flow prediction for road transportation networks with limited traffic data. IEEE Trans. Intell. Transp. Syst. 2014, 16, 653–662. [Google Scholar] [CrossRef]
- Williams, B.M.; Hoel, L.A. Modeling and forecasting vehicular traffic flow as a seasonal ARIMA process: Theoretical basis and empirical results. J. Transp. Eng. 2003, 129, 664–672. [Google Scholar] [CrossRef] [Green Version]
- Patterson, D.W. Artificial Neural Networks: Theory and Applications; Prentice Hall PTR: Hoboken, NJ, USA, 1998. [Google Scholar]
- Cortes, C.; Vapnik, V. Support-vector networks. Mach. Learn. 1995, 20, 273–297. [Google Scholar] [CrossRef]
- Heckerman, D. A tutorial on learning with Bayesian networks. In Innovations in Bayesian Networks; Springer: Berlin, Germany, 2008; pp. 33–82. [Google Scholar]
- Keller, J.M.; Gray, M.R.; Givens, J.A. A fuzzy k-nearest neighbor algorithm. IEEE Trans. Syst. Man Cybern. 1985, 4, 580–585. [Google Scholar] [CrossRef]
- MacQueen, J. Some methods for classification and analysis of multivariate observations. In Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability, Oakland, CA, USA, 1 January 1967; Volume 1, pp. 281–297. [Google Scholar]
- Liou, C.Y.; Cheng, W.C.; Liou, J.W.; Liou, D.R. Autoencoder for words. Neurocomputing 2014, 139, 84–96. [Google Scholar] [CrossRef]
- Pearson, K. LIII. On lines and planes of closest fit to systems of points in space. Lond. Edinb. Dublin Philos. Mag. J. Sci. 1901, 2, 559–572. [Google Scholar] [CrossRef] [Green Version]
- Sun, S.; Zhang, C.; Yu, G. A Bayesian network approach to traffic flow forecasting. IEEE Trans. Intell. Transp. Syst. 2006, 7, 124–132. [Google Scholar] [CrossRef]
- Sun, S.; Zhang, C.; Zhang, Y. Traffic flow forecasting using a spatio-temporal bayesian network predictor. In Proceedings of the International Conference on Artificial Neural Networks, Warsaw, Poland, 11–15 September 2005; Springer: New York, NY, USA, 2005; pp. 273–278. [Google Scholar]
- Castillo, E.; Menéndez, J.M.; Sánchez-Cambronero, S. Predicting traffic flow using Bayesian networks. Transp. Res. Part B Methodol. 2008, 42, 482–509. [Google Scholar] [CrossRef]
- Castillo, E.; Menéndez, J.M.; Sánchez-Cambronero, S. Traffic estimation and optimal counting location without path enumeration using Bayesian networks. Comput.-Aided Civil Infrastruct. Eng. 2008, 23, 189–207. [Google Scholar] [CrossRef]
- Castillo, E.; Nogal, M.; Menendez, J.M.; Sanchez-Cambronero, S.; Jimenez, P. Stochastic demand dynamic traffic models using generalized beta-Gaussian Bayesian networks. IEEE Trans. Intell. Transp. Syst. 2011, 13, 565–581. [Google Scholar] [CrossRef]
- Huang, W.; Song, G.; Hong, H.; Xie, K. Deep architecture for traffic flow prediction: Deep belief networks with multitask learning. IEEE Trans. Intell. Transp. Syst. 2014, 15, 2191–2201. [Google Scholar] [CrossRef]
- Collobert, R.; Weston, J. A unified architecture for natural language processing: Deep neural networks with multitask learning. In Proceedings of the 25th International Conference on Machine Learning, Helsinki, Finland, 5–9 July 2008; pp. 160–167. [Google Scholar]
- Soua, R.; Koesdwiady, A.; Karray, F. Big-data-generated traffic flow prediction using deep learning and dempster-shafer theory. In Proceedings of the 2016 International Joint Conference on Neural Networks (IJCNN), IEEE, Vancouver, BC, Canada, 24–29 July 2016; pp. 3195–3202. [Google Scholar]
- Zhang, Y.; Huang, G. traffic flow prediction model based on deep belief network and genetic algorithm. IET Intell. Transp. Syst. 2018, 12, 533–541. [Google Scholar] [CrossRef]
- Tan, H.; Xuan, X.; Wu, Y.; Zhong, Z.; Ran, B. A comparison of traffic flow prediction methods based on DBN. In Proceedings of the CICTP 2016, Shanghai, China, 6–9 July 2016; American Society of Civil Engineers (ASCE): Shanghai, China, 2016; pp. 273–283. [Google Scholar]
- Perozzi, B.; Al-Rfou, R.; Skiena, S. Deepwalk: Online learning of social representations. In Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, New York, NY, USA, 24–27 August 2014; pp. 701–710. [Google Scholar]
- Jagadish, H.; Gehrke, J.; Labrinidis, A.; Papakonstantinou, Y.; Patel, J.M.; Ramakrishnan, R.; Shahabi, C. Big data and its technical challenges. Commun. ACM 2014, 57, 86–94. [Google Scholar] [CrossRef]
- Li, Y.; Yu, R.; Shahabi, C.; Liu, Y. Diffusion convolutional recurrent neural network: Data-driven traffic forecasting. arXiv 2017, arXiv:1707.01926. [Google Scholar]
- Hamilton, J.D. Time Series Analysis; Princeton University Press: Princeton, NJ, USA, 1994; Volume 2. [Google Scholar]
- Sutskever, I.; Vinyals, O.; Le, Q. Sequence to sequence learning with neural networks. In Proceedings of the NIPS 2014, Montreal, QC, Canada, 8–13 December 2014; Volume 27. [Google Scholar]
Methods | 15 min | 30 min | 1 h | ||||||
---|---|---|---|---|---|---|---|---|---|
MAE | RMSE | MAPE | MAE | RMSE | MAPE | MAE | RMSE | MAPE | |
HA | 4.16 | 7.80 | 13.0% | 4.16 | 7.80 | 13.0% | 4.16 | 7.80 | 13.0% |
3.99 | 8.21 | 9.6% | 5.15 | 10.45 | 12.7% | 6.90 | 13.23 | 17.4% | |
VAR | 4.42 | 7.89 | 10.2% | 5.41 | 9.13 | 12.7% | 6.52 | 10.11 | 15.8% |
SVR | 3.99 | 8.45 | 9.3% | 5.05 | 10.87 | 12.1% | 6.72 | 13.76 | 16.7% |
FNN | 3.99 | 7.94 | 9.9% | 4.23 | 8.17 | 12.9% | 4.49 | 8.69 | 14.0% |
FC-LSTM | 3.44 | 6.30 | 9.6% | 3.77 | 7.23 | 10.9% | 4.37 | 8.69 | 13.2% |
DCRNN | 2.77 | 5.38 | 7.3% | 3.15 | 6.45 | 8.8% | 3.60 | 7.59 | 10.5% |
STGNN | 2.51 | 4.93 | 7.1% | 3.12 | 6.27 | 7.8% | 3.35 | 6.34 | 9.8% |
Methods | 15 min | 30 min | 1 h | ||||||
---|---|---|---|---|---|---|---|---|---|
MAE | RMSE | MAPE | MAE | RMSE | MAPE | MAE | RMSE | MAPE | |
HA | 2.88 | 5.59 | 6.8% | 2.88 | 5.59 | 6.8% | 2.88 | 5.59 | 6.8% |
1.62 | 3.30 | 3.5% | 2.33 | 4.76 | 5.4% | 3.38 | 6.50 | 8.3% | |
VAR | 1.74 | 3.16 | 3.6% | 2.32 | 4.25 | 5.0% | 2.93 | 5.44 | 6.5% |
SVR | 1.85 | 3.59 | 3.8% | 2.48 | 5.18 | 5.5% | 3.28 | 7.08 | 8.0% |
FNN | 2.20 | 4.42 | 5.19% | 2.30 | 4.63 | 5.43% | 2.46 | 4.98 | 5.89% |
FC-LSTM | 2.05 | 4.19 | 4.8% | 2.20 | 4.55 | 5.2% | 2.37 | 4.96 | 5.7% |
DCRNN | 1.38 | 2.95 | 2.9% | 1.74 | 3.97 | 3.9% | 2.07 | 4.74 | 4.9% |
STGNN | 1.27 | 2.73 | 2.8% | 1.36 | 3.82 | 3.8% | 1.83 | 4.48 | 4.6% |
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. |
© 2022 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Li, Y.; Zhao, W.; Fan, H. A Spatio-Temporal Graph Neural Network Approach for Traffic Flow Prediction. Mathematics 2022, 10, 1754. https://0-doi-org.brum.beds.ac.uk/10.3390/math10101754
Li Y, Zhao W, Fan H. A Spatio-Temporal Graph Neural Network Approach for Traffic Flow Prediction. Mathematics. 2022; 10(10):1754. https://0-doi-org.brum.beds.ac.uk/10.3390/math10101754
Chicago/Turabian StyleLi, Yanbing, Wei Zhao, and Huilong Fan. 2022. "A Spatio-Temporal Graph Neural Network Approach for Traffic Flow Prediction" Mathematics 10, no. 10: 1754. https://0-doi-org.brum.beds.ac.uk/10.3390/math10101754