The Simulation of Autonomous Vehicle Using ROS2 Based on Convolutional Neural Networks for Object Recognition

Muhammad Miftahudin; Nungki Selviandro; Muhammad Johan Alibasa

doi:10.47065/bits.v4i2.1965

Muhammad Miftahudin * Telkom University, Bandung, Indonesia
Nungki Selviandro Telkom University, Bandung, Indonesia
Muhammad Johan Alibasa Telkom University, Bandung, Indonesia

(*) Corresponding Author

DOI: https://doi.org/10.47065/bits.v4i2.1965

Keywords: Autonomous Vehicle; Object Recognition; Convolutional Neural Networks; ROS2

Abstract

The main justification for implementing an Autonomous Vehicle (AV) system in the real world is the safety aspect of driving, because if there is an error in driving then the error will become a gap that can threaten the safety of the driver himself and other drivers, therefore an AV system is made to reduce driver errors. in driving. The aim of this research is to implement one of the parts of the AV system, that is object recognition, and in this study, we also conduct an experiment with simulating the object recognition feature that has been implemented in order to get more concrete results. Architectural object recognition is designed to extract key features from traffic sign images, the traffic sign detection uses the customized Convolutional Neural Networks (CNNs) architecture. After the architectural has been implemented, training will be carried out using Custom Traffic Sign Dataset and experiments will also be conducted to simulate object recognition by applying ROS2 as a car robotic system that represents a car's functionality system in the real world. the results of this study for the implementation of the modified CNNs architecture is 99.96% and the results of the simulations carried out show that the prototype can detect traffic signs objects with a distance of 10m

Downloads

Download data is not yet available.

References

S. Kato, E. Takeuchi, Y. Ishiguro, Y. Ninomiya, K. Takeda, and T. Hamada, “An open approach to autonomous vehicles,” IEEE Micro, vol. 35, no. 6, pp. 60–68, 2015.

W. H. Organization, “Global status report on road safety 2018: Summary (No. WHO/NMH/NVI/18.20),” World Health Organization, 2018.

N. Lang et al., “Self-driving vehicles, robo-taxis, and the urban mobility revolution,” The Boston Consulting Group, vol. 7, p. 2016, 2016.

D. Pomerleau, “An autonomous land vehicle in a neural network,” Advances in Neural Information Processing Systems, vol. 1, 1998.

D. A. Pomerleau, “Knowledge-based training of artificial neural networks for autonomous robot driving,” in Robot learning, Springer, 1993, pp. 19–43.

L. Anis, T. Ghada, S. Anis, and M. Abdellatif, “Optimal feature selection based on hybridization of MSFLA and Gabor filters for enhanced MR brain image recognition using SVM,” International Journal of Tomography & Simulation, vol. 27, no. 3, pp. 3–5, 2014.

A. Ladgham, A. Sakly, and A. Mtibaa, “MRI brain tumor recognition using modified shuffled frog leaping algorithm,” in 2014 15th International Conference on Sciences and Techniques of Automatic Control and Computer Engineering (STA), 2014, pp. 504–507.

K. O’Shea and R. Nash, “An introduction to convolutional neural networks,” arXiv preprint arXiv:1511.08458, 2015.

O. Russakovsky et al., “Imagenet large scale visual recognition challenge,” Int J Comput Vis, vol. 115, no. 3, pp. 211–252, 2015.

S. S. Farfade, M. J. Saberian, and L.-J. Li, “Multi-view face detection using deep convolutional neural networks,” in Proceedings of the 5th ACM on International Conference on Multimedia Retrieval, 2015, pp. 643–650.

E. Dandıl and R. Özdemir, “Real-time facial emotion classification using deep learning,” Data Science and Applications, vol. 2, no. 1, pp. 13–17, 2019.

S.-H. Lee, C.-H. Yeh, T.-W. Hou, and C.-S. Yang, “A lightweight neural network based on AlexNet-SSD model for garbage detection,” in Proceedings of the 2019 3rd High Performance Computing and Cluster Technologies Conference, 2019, pp. 274–278.

S. Samir, E. Emary, K. El-Sayed, and H. Onsi, “Optimization of a pre-trained AlexNet model for detecting and localizing image forgeries,” Information, vol. 11, no. 5, p. 275, 2020.

R. Yamashita, M. Nishio, R. K. G. Do, and K. Togashi, “Convolutional neural networks: an overview and application in radiology,” Insights Imaging, vol. 9, no. 4, pp. 611–629, 2018.

L. Alzubaidi et al., “Review of deep learning: Concepts, CNN architectures, challenges, applications, future directions,” Journal of big Data, vol. 8, no. 1, pp. 1–74, 2021.

Á. Arcos-García, J. A. Alvarez-Garcia, and L. M. Soria-Morillo, “Deep neural network for traffic sign recognition systems: An analysis of spatial transformers and stochastic optimisation methods,” Neural Networks, vol. 99, pp. 158–165, 2018.

D. Tabernik and D. Skočaj, “Deep learning for large-scale traffic-sign detection and recognition,” IEEE transactions on intelligent transportation systems, vol. 21, no. 4, pp. 1427–1440, 2019.

A. Arcos-Garcia, J. A. Alvarez-Garcia, and L. M. Soria-Morillo, “Evaluation of deep neural networks for traffic sign detection systems,” Neurocomputing, vol. 316, pp. 332–344, 2018.

M. Reke et al., “A self-driving car architecture in ROS2,” in 2020 International SAUPEC/RobMech/PRASA Conference, 2020, pp. 1–6.

J. Murphy, “An overview of convolutional neural network architectures for deep learning,” Microway Inc, pp. 1–22, 2016.

P. Sermanet and Y. LeCun, “Traffic sign recognition with multi-scale convolutional networks,” in The 2011 international joint conference on neural networks, 2011, pp. 2809–2813.

F. Jurišić, I. Filković, and Z. Kalafatić, “Multiple-dataset traffic sign classification with OneCNN,” in 2015 3rd IAPR Asian Conference on Pattern Recognition (ACPR), 2015, pp. 614–618.

Bila bermanfaat silahkan share artikel ini

Berikan Komentar Anda terhadap artikel The Simulation of Autonomous Vehicle Using ROS2 Based on Convolutional Neural Networks for Object Recognition