Generic placeholder image

Recent Advances in Computer Science and Communications

Editor-in-Chief

ISSN (Print): 2666-2558
ISSN (Online): 2666-2566

General Research Article

A Fast and Reliable Balanced Approach for Detecting and Tracking Road Vehicles

Author(s): Wael Farag*

Volume 15, Issue 2, 2022

Published on: 27 July, 2020

Page: [298 - 311] Pages: 14

DOI: 10.2174/2666255813999200727163102

Price: $65

Abstract

Introduction: An advanced, reliable and fast vehicle detection-and-tracking technique is proposed, implemented and tested. In this paper, an advanced-and-reliable vehicle detectionand- tracking technique is proposed and implemented. The Real-Time Vehicle Detection-and- Tracking (RT_VDT) technique is well suited for Advanced Driving Assistance Systems (ADAS) applications or Self-Driving Cars (SDC).

Methods: The Real-Time Vehicle Detection-and-Tracking (RT_VDT) is proposed, and it is mainly a pipeline of reliable computer-vision and machine-learning algorithms that augment each other and take in raw RGB images to produce the required boundary boxes of the vehicles that appear in the front driving space of the car. The main emphasis is the careful fusion of the employed algorithms, where some of them work in parallel to strengthen each other in order to produce a precise and sophisticated real-time output.

Results: The RT_VDT is tested and its performance is evaluated using actual road images and videos captured by the front-mounted camera of the car as well as on the KITTI benchmark. The evaluation of the RT_VDT shows that it reliably detects and tracks vehicle boundaries under various conditions.

Discussion: Robust real-time vehicle detection and tracking is required for Advanced Driving Assistance Systems (ADAS) applications or Self-Driving Cars (SDC).

Keywords: Computer vision, self-driving car, autonomous driving, ADAS, vehicle detection, vehicle tracking.

Graphical Abstract

[1]
W. Farag, "Traffic signs classification by deep learning for advanced driving assistance systems", Intell. Decision Technol., vol. 13, no. 3, pp. 215-231, 2019.
[http://dx.doi.org/10.3233/IDT-180064]
[2]
W. Farag, and Z. Saleh, "Road lane-lines detection in real-time for advanced driving assistance systems", In: 2018 International Conference on Innovation and Intelligence for Informatics, Computing and Technologies (3ICT), 2018, pp. 18-20.
[3]
K. Mansour, and W. Farag, "AiroDiag: A sophisticated tool that diagnoses and updates vehicles software over air", In: 2012 IEEE Intern. Electric Vehicle Conference (IEVC), 2012, pp. 1-7.
[http://dx.doi.org/10.1109/IEVC.2012.6183181]
[4]
W.A. Farag, "CANTrack: Enhancing automotive CAN bus security using intuitive encryption algorithms", In: 2017 7th International Conference on Modeling, Simulation, and Applied Optimization (ICMSAO), 2017, pp. 1-5.
[http://dx.doi.org/10.1109/ICMSAO.2017.7934878]
[5]
W. Farag, "Real-time detection of road lane-lines for autonomous driving", Recent Pat. Comput. Sci., vol. 13, no. 2, pp. 265-274, 2020.
[6]
W. Farag, and Z. Saleh, "An advanced road-lanes finding scheme for self-driving cars", Smart Cities Symposium (SCS’19), pp. 24-26, 2019.
[7]
W. Farag, and Z. Saleh, "Behavior cloning for autonomous driving using convolutional neural networks", In: 2018 International Conference on Innovation and Intelligence for Informatics, Computing, and Technologies (3ICT'18), 2018, pp. 18-20.
[8]
W. Farag, "“Recognition of traffic signs by convolutional neural nets for self-driving vehicles”, Int. J. Knowl.-based Intell", Eng. Syst., vol. 22, no. 3, pp. 205-214, 2018.
[http://dx.doi.org/10.3233/KES-180385]
[9]
W. Farag, and Z. Saleh, "Tuning of PID track followers for autonomous driving", In: 2018 International Conference on Innovation and Intelligence for Informatics, Computing, and Technologies (3ICT'18). pp. 18-20, Nov 2018.
[10]
W. Farag, "Safe-driving cloning by deep learning for autonomous cars", Int. J. Adv. Mechatron. Syst., vol. 7, no. 6, pp. 390-397, 2019.
[http://dx.doi.org/10.1504/IJAMECHS.2017.099318]
[11]
W. Farag, "Cloning safe driving behavior for self-driving cars using convolutional neural networks", Recent Pat. Comput. Sci., vol. 12, no. 2, pp. 120-127, 2019.
[http://dx.doi.org/10.2174/2213275911666181106160002]
[12]
W. Farag, and Z. Saleh, "An advanced vehicle detection and tracking scheme for self-driving cars", In: 2nd Smart Cities Symposium (SCS’19), 2019, pp. 1-6.
[13]
J. Wei, J. He, Y. Zhou, K. Chen, Z. Tang, and Z. Xiong, "Enhanced object detection with deep convolutional neural networks for advanced driving assistance", IEEE Trans. Intell. Transp. Syst., vol. 21, no. 4, pp. 1572-1583, 2019.
[http://dx.doi.org/10.1109/TITS.2019.2910643]
[14]
A. Geiger, P. Lenz, C. Stiller, and R. Urtasun, "Vision meets robotics: The KITTI dataset", Int. J. Robot. Res., vol. 32, no. 11, pp. 1231-1237, 2013.
[http://dx.doi.org/10.1177/0278364913491297]
[15]
X. Hu, X. Xu, Y. Xiao, H. Chen, S. He, J. Qin, and P.A. Heng, "SINet: A scale-insensitive convolutional neural network for fast vehicle detection", IEEE Trans. Intell. Transp. Syst., vol. 20, no. 3, pp. 1010-1019, 2019.
[http://dx.doi.org/10.1109/TITS.2018.2838132]
[16]
Y. Xiao, Vehicle Detection in Deep Learning. M.Sc. Thesis, Virginia Polytechnic Institute & State University, USA, 2019.
[17]
J. Botsch, Real-time lane detection and tracking on high-performance computing devices. Bachelor's Thesis in Informatics, 2015.
[18]
B.E. Rogowitz, T.N. Pappas, and S.J. Daly, "Human vision and electronic imaging XII", In: Proceedings of SPIE, The International Society for Optical Engineering, 2006.
[19]
K. Steven, The Science of Color. 2nd ed. Elsevier: Science & Technology, 2003, pp. 202-206.
[20]
N. Dalal, and B. Triggs, "Histograms of oriented gradients for human detection", In: 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’05), vol. 1. 2005, pp. 886-893.
[http://dx.doi.org/10.1109/CVPR.2005.177]
[21]
M.S. Kankanhallia, B.M. Mehtreb, and H.Y. Huang, "Color and spatial feature for content-based image retrieval", Pattern Recognit. Lett., vol. 20, no. 1, pp. 109-118, 1999.
[http://dx.doi.org/10.1016/S0167-8655(98)00100-7]
[22]
S. Sergyan, "Color histogram features based image classification in content-based image retrieval systems", In: 2008 6th International Symposium on Applied Machine Intelligence and Informatics, 2008.
[http://dx.doi.org/10.1109/SAMI.2008.4469170]
[23]
C. Cortes, and V.N. Vapnik, "Support-vector networks", Mach. Learn., vol. 20, no. 3, pp. 273-297, 1995.
[http://dx.doi.org/10.1007/BF00994018]
[24]
D. Feng, L. Rosenbaum, and K. Dietmayer, "Towards safe autonomous driving: Capture uncertainty in the deep neural network for lidar 3D vehicle detection", In: 2018 21st IEEE International Conference on Intelligent Transportation Systems (ITSC), 2018.
[http://dx.doi.org/10.1109/ITSC.2018.8569814]
[25]
A. Ben-Hur, D. Horn, H. Siegelmann, and V.N. Vapnik, "Support vector clustering", J. Mach. Learn. Res., vol. 2, pp. 125-137, 2001.
[26]
C.W. Hsu, and C.J. Lin, "A comparison of methods for multiclass support vector machines", IEEE Trans. Neural Netw., vol. 13, no. 2, pp. 415-425, 2002.
[http://dx.doi.org/10.1109/72.991427] [PMID: 18244442]
[27]
W. Farag, and A. Tawfik, "On fuzzy model identification and the gas furnace data", In: Proceedings of the IASTED International Conference Intelligent Systems and Control, 2000.
[28]
J. Nocedal, and S. Wright, Numerical Optimization., 2nd ed Springer-Verlag: Berlin, New York, 2006, p. 449.
[29]
A. Kaehler, and G. Bradski, Learning OpenCV 3: Computer Vision in C++ with the OpenCV Library., O'Reilly Media, 2016.
[30]
Python Pickle Module https://docs.python.org/3.1/library/pickle.html retrieved on (24 Sept. 2019)
[31]
Udacity vehicles data. Available at: https://s3.amazonaws.com/udacity-sdc/Vehicle_Tracking/vehicles.zip [Accessed on 06-Dec-2021].
[32]
Udacity non-vehicles data. Available at: https://s3.amazonaws.com/udacity-sdc/Vehicle_Tracking/non-vehicles.zip [Accessed on 06-Dec-2021].
[33]
GTI vehicle image database, http://www.gti.ssr.upm.es/data/Vehicle_database.html [Accessed on 06-Dec-2021].
[34]
The HOG feature descriptor. Available at: http://scikit-image.org/docs/dev/auto_examples/features_detection/plot_hog.html [Accessed on 06-Dec-2021].
[35]
SciKit-Learn StandardScaler Function http://scikit-learn.org/stable/modules/generated/sklearn.preprocessing.StandardScaler.html [Accessed on 06-Dec-2021].
[36]
Linear SVM Classifier Function. Available at: http://scikit-learn.org/stable/modules/generated/sklearn.svm.LinearSVC.html [Accessed on 06-Dec-2021].
[37]
M. Nagiub, and W. Farag, "Automatic selection of compiler options using genetic techniques for embedded software design", In: 2013 IEEE 14th International Symposium on Computational Intelligence and Informatics (CINTI), 2013, pp. 69-74.
[http://dx.doi.org/10.1109/CINTI.2013.6705166]
[38]
M. Everingham, L. Van Gool, C.K. Williams, J. Winn, and A. Zisserman, "The pascal Visual Object Classes (VOC) challenge", Int. J. Comput. Vis., vol. 88, no. 2, pp. 303-338, 2010.
[http://dx.doi.org/10.1007/s11263-009-0275-4]
[39]
W. Liu, "SSD: Single Shot Multi-box Detector", In: Computer Vision- ECCV., Springer: New York, NY, USA, 2016, pp. 21-37.
[40]
J. Redmon, and A. Farhadi, "Yolo9000: Better, faster, stronger", In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2017, pp. 7236-7271.
[41]
S. Ren, K. He, R. Girshick, and J. Sun, "Faster R-CNN: Towards real-time object detection with region proposal networks", IEEE Trans. Pattern Anal. Mach. Intell., vol. 39, no. 6, pp. 1137-1149, 2017.
[http://dx.doi.org/10.1109/TPAMI.2016.2577031] [PMID: 27295650]
[42]
Y. Liu, S. Cao, P. Lasang, and S. Shen, "Modular lightweight network for road object detection using a feature fusion approach", IEEE Trans. Systems, Man & Cybernetics, vol. 51, no. 8, pp. 4716-4728, 2021.
[http://dx.doi.org/10.1109/TSMC.2019.2945053]
[43]
Google Colaboratory. Available at: https://colab.research.google.com/notebooks/welcome.ipynb [Accessed on 06-Dec-2021].
[44]
W. Farag, Synthesis of Intelligent Hybrid Systems for Modeling and Control. Ph.D. Thesis, Universty of Waterloo, Canada, 1998.

Rights & Permissions Print Cite
© 2024 Bentham Science Publishers | Privacy Policy