Login Register Cart 0
Generic placeholder image

Recent Patents on Mechanical Engineering

Editor-in-Chief

ISSN (Print): 2212-7976
ISSN (Online): 1874-477X

Back
Journal Home About Journal Editorial Board Journal Insight Current Issue Volumes/Issues
Subscribe
Research Article

Vehicle Trajectory Prediction Considering Multi-feature Independent Encoding Based on Graph Neural Network

Author(s): Xiao Su, Xiaolan Wang*, Haonan Li, Xin Xu and Yansong Wang*

Volume 17, Issue 1, 2024

Published on: 18 October, 2023

Page: [36 - 44] Pages: 9

DOI: 10.2174/0122127976268634230929182355

Price: $65

Abstract

Background: Today, self-driving cars are already on the roads. However, driving safety remains a huge challenge. Trajectory prediction of traffic targets is one of the important tasks of an autonomous driving environment perception system, and its output trajectory can provide necessary information for decision control and path planning. Although there are many patents and articles related to trajectory prediction, the accuracy of trajectory prediction still needs to be improved.

Objective: This paper aimed to propose a novel scheme that considers multi-feature independent encoding trajectory prediction (MFIE).

Methods: MFIE is an independently coded trajectory prediction algorithm that consists of a spacetime interaction module and trajectory prediction module, and considers speed characteristics and road characteristics. In the spatiotemporal interaction module, an undirected and weightless static traffic graph is used to represent the interaction between vehicles, and multiple graph convolution blocks are used to perform data mining on the historical information of target vehicles, capture temporal features, and process spatial interaction features. In the trajectory prediction module, three long short-term memory (LSTM) encoders are used to encode the trajectory feature, motion feature, and road constraint feature independently. The three hidden features are spliced into a tensor, and the LSTM decoder is used to predict the future trajectory.

Results: On datasets, such as Apollo and NGSIM, the proposed method has shown lower prediction error than traditional model-driven and data-driven methods, and predicted more target vehicles at the same time. It can provide a basis for vehicle path planning on highways and urban roads, and it is of great significance to the safety of autonomous driving.

Conclusion: This paper has proposed a multi-feature independent encoders’ trajectory prediction data-driven algorithm, and the effectiveness of the algorithm is verified with a public dataset. The trajectory prediction algorithm considering multi-feature independent encoders provides some reference value for decision planning.

« Previous Next »
[1]
Badue C, Guidolini R, Carneiro RV, et al. Self-driving cars: A survey. Expert Syst Appl 2021; 165: 113816.
[http://dx.doi.org/10.1016/j.eswa.2020.113816]
[2]
Schwarting W, Alonso-Mora J, Rus D. Planning and decision-making for autonomous vehicles. Annu Rev Control Robot Auton Syst 2018; 1(1): 187-210.
[http://dx.doi.org/10.1146/annurev-control-060117-105157]
[3]
Ye L, Yamamoto T. Modeling connected and autonomous vehicles in heterogeneous traffic flow. Physica A 2018; 490: 269-77.
[http://dx.doi.org/10.1016/j.physa.2017.08.015]
[4]
Sun Y, Zuo W, Liu M. See the future: A semantic segmentation network predicting ego-vehicle trajectory with a single monocular camera. IEEE Robot Autom Lett 2020; 5(2): 3066-73.
[http://dx.doi.org/10.1109/LRA.2020.2975414]
[5]
Mussone L, Ferrari A, Oneta M. An analysis of urban collisions using an artificial intelligence model. Accid Anal Prev 1999; 31(6): 705-18.
[http://dx.doi.org/10.1016/S0001-4575(99)00031-7] [PMID: 10487346]
[6]
Quintero Minguez R, Parra Alonso I, Fernández-Llorca D, Sotelo MA. Pedestrian path, pose, and intention prediction through gaussian process dynamical models and pedestrian activity recognition. IEEE Trans Intell Transp Syst 2019; 20(5): 1803-14.
[http://dx.doi.org/10.1109/TITS.2018.2836305]
[7]
Xie D, Shu T, Todorovic S, et al. Learning and inferring “dark matter” and predicting human intents and trajectories in videos. IEEE Trans Pattern Anal Mach Intell 2018; 40(7): 1639-52.
[http://dx.doi.org/10.1109/TPAMI.2017.2728788] [PMID: 28727549]
[8]
Chen K, Song X, Ren X. Modeling social interaction and intention for pedestrian trajectory prediction. Physica A 2021; 570: 125790.
[http://dx.doi.org/10.1016/j.physa.2021.125790]
[9]
Zyner A, Worrall S, Nebot E. A recurrent neural network solution for predicting driver intention at unsignalized intersections. IEEE Robot Autom Lett 2018; 3(3): 1759-64.
[http://dx.doi.org/10.1109/LRA.2018.2805314]
[10]
Zyner A, Worrall S, Ward J, Nebot E. Long short term memory for driver intent prediction. 2017 IEEE Intelligent Vehicles Symposium (IV).
[http://dx.doi.org/10.1109/IVS.2017.7995919]
[11]
Lefèvre Stéphanie, Vasquez Dizan, Laugier Christian. A survey on motion prediction and risk assessment for intelligent vehicles. ROBOMECH J 2014; 1(1)
[http://dx.doi.org/10.1186/s40648-014-0001-z]
[12]
Schubert R, Adam C, Obst M, Mattern N, Leonhardt V, Wanielik G. “Empirical evaluation of vehicular models for ego motion estimation” 2011 IEEE intelligent vehicles symposium (IV). Baden-Baden, Germany: IEEE 2011.
[13]
Xie G, Gao H, Qian L, Huang B, Li K, Wang J. Vehicle trajectory prediction by integrating physics-and maneuver-based approaches using interactive multiple models. IEEE Trans Ind Electron 2018; 65(7): 5999-6008.
[http://dx.doi.org/10.1109/TIE.2017.2782236]
[14]
Xie F, Lou J, Zhao K. A research on vehicle trajectory prediction method based on behavior recognition and curvature constraint. Automot Eng 2019; 41(9): 1036-42.
[15]
Chandra R, Guan T, Panuganti S, et al. Forecasting trajectory and behavior of road-agents using spectral clustering in graph-lstms. IEEE Robot Autom Lett 2020; 5(3): 4882-90.
[http://dx.doi.org/10.1109/LRA.2020.3004794]
[16]
Zyner A, Worrall S, Nebot E. Naturalistic driver intention and path prediction using recurrent neural networks. IEEE Trans Intell Transp Syst 2020; 21(4): 1584-94.
[http://dx.doi.org/10.1109/TITS.2019.2913166]
[17]
Park SH. ByeongDo Kim, Chang Mook Kang, Chung Choo Chung, and Jun Won Choi. “Sequence-to-sequence prediction of vehicle trajectory via LSTM encoder-decoder architecture. 2018 IEEE Intelligent Vehicles Symposium (IV).
[http://dx.doi.org/10.1109/IVS.2018.8500658]
[18]
Kim BD, Kang CM, Kim J, Lee SH, Chung CC, Choi JW. Probabilistic vehicle trajectory prediction over occupancy grid map via recurrent neural network. 2017 IEEE 20th International Conference on Intelligent Transportation Systems (ITSC). Yokohama, Japan. IEEE. 2017.
[http://dx.doi.org/10.1109/ITSC.2017.8317943]
[19]
Schreier Matthias. Bayesian environment representation, prediction, and criticality assessment for driver assistance systems. Berlin: De Gruyter 2017.
[http://dx.doi.org/10.1515/auto-2016-0129]
[20]
Ji XW, Fei C, He XK, Liu Y. Driving intention recognition and vehicle trajectory prediction based on LSTM network. Chinese Journal of Highway 2019; 32(6): 34-42.
[21]
Zaman M, Zohrabi N, Abdelwahed S. A CNN-based Path Trajectory Prediction Approach with Safety Constraints. 2020 IEEE Transportation Electrification Conference & Expo (ITEC).
[http://dx.doi.org/10.1109/ITEC48692.2020.9161731]
[22]
Bhattacharyya A, Fritz M, Schiele B. Long-term on-board prediction of people in traffic scenes under uncertainty. arXiv:171109026 2018.
[http://dx.doi.org/10.1109/CVPR.2018.00441]
[23]
Deo N, Trivedi MM. Multi-modal trajectory prediction of surrounding vehicles with maneuver based lstms. 2018 IEEE Intelligent Vehicles Symposium (IV).
[http://dx.doi.org/10.1109/IVS.2018.8500493]
[24]
Deo N, Rangesh A, Trivedi MM. How would surround vehicles move? a unified framework for maneuver classification and motion prediction. IEEE Trans Intell Veh 2018; 3(2): 129-40.
[http://dx.doi.org/10.1109/TIV.2018.2804159]
[25]
Deo N, Trivedi MM. Convolutional social pooling for vehicle trajectory prediction. arXiv:180506771 2018.
[http://dx.doi.org/10.1109/CVPRW.2018.00196]
[26]
Li X, Ying X, Chuah MC. Grip: Graph-based interaction-aware trajectory prediction 2019 IEEE Intelligent Transportation Systems Conference (ITSC).
[27]
Li X, Ying X, Chuah MC. Grip++: Enhanced graph-based interaction-aware trajectory prediction for autonomous driving. ar-Xiv:190707792 2019.
[28]
Kecheng XU, Sun H, Pan J, Xiangquan XIAO, Hu J, Miao J. Vehicle trajectory prediction model with semantic map and LSTM. Plus One 2021; 16(7): e0253868.
[29]
Zhang X, Chen Y, Guangyu LI. Prediction-based system and method for trajectory planning of autonomous vehicles. US20190072965A1, 2020.
[30]
Silva WA, Wang C. Occlusion prediction and trajectory evaluation. U.S. Patent 11,188,082, 2021.
[31]
Che WX, Chao WH. Convolution neural network for relation extraction. International conference on advanced data mining and applications. Berlin, Heidelberg: Springer. 2013; p. 231-42.
[32]
Eppstein D, Galil Z, Italiano GF, Nissenzweig A. Sparsification—a technique for speeding up dynamic graph algorithms. J Assoc Comput Mach 1997; 44(5): 669-96.
[http://dx.doi.org/10.1145/265910.265914]
[33]
Gers FA, Schmidhuber J, Cummins F. Learning to forget: Continual prediction with LSTM. Neural Comput 2000; 12(10): 2451-71.
[http://dx.doi.org/10.1162/089976600300015015] [PMID: 11032042]
[34]
Ma Y, Zhu X, Zhang S, Yang R, Wang W, Manocha D. Trafficpredict: Trajectory prediction for heterogeneous traffic-agents. Proc Conf AAAI Artif Intell 2019; 33(1): 6120-7.
[http://dx.doi.org/10.1609/aaai.v33i01.33016120]
[35]
Punzo V, Borzacchiello MT, Ciuffo B. On the assessment of vehicle trajectory data accuracy and application to the Next Generation SIMulation (NGSIM) program data. Transp Res, Part C Emerg Technol 2011; 19(6): 1243-62.
[http://dx.doi.org/10.1016/j.trc.2010.12.007]
[36]
Mandal S, Biswas S, Balas VE, Shaw RN, Ghosh A. Motion prediction for autonomous vehicles from lyft dataset using deep learning. 2020 IEEE 5th International Conference on Computing Communication and Automation (ICCCA). Greater Noida, India. IEEE. 2020.
[http://dx.doi.org/10.1109/ICCCA49541.2020.9250790]
[37]
Yogamani S, Hughes C, Horgan J, et al. Woodscape: A multi-task, multi-camera fisheye dataset for autonomous driving. ar-Xiv:190501489 2019.
[http://dx.doi.org/10.1109/ICCV.2019.00940]
[38]
Mozaffari S, Al-Jarrah OY, Dianati M, Jennings P, Mouzakitis A. Deep learning-based vehicle behavior prediction for autonomous driving applications: A review. IEEE Trans Intell Transp Syst 2022; 23(1): 33-47.
[http://dx.doi.org/10.1109/TITS.2020.3012034]
[39]
Sutskever I, Vinyals O, Le QV. Sequence to sequence learning with neural networks. arXiv:14093215 2014.

Rights & Permissions Print Cite
© 2024 Bentham Science Publishers | Privacy Policy