Abstract
Simultaneously Localization and Map** (SLAM) plays a key role in tasks such as mobile robots navigation and path planning. How to achieve high localization accuracy in various scenarios is particularly important. This paper proposes a visual Semantic SLAM algorithm based on object tracking and static points detection, in order to eliminate the influence of dynamic objects on localization and map**. This algorithm is improved on the framework of ORB-SLAM2. For continuously acquired input images, tracking algorithm is combined with the object detection to achieve the inter-frame correlation of objects in the scene. Then, epipolar geometry is used to detect static points on each object, and depth constraint is introduced to improve robustness. After excluding dynamic objects, the static points are sent to the tracking thread to achieve more accurate localization result. Finally, we record the pose of the dynamic objects for robots autonomous navigation in the future. Experiments on the public datasets TUM and KITTI show that in dynamic scenes, the proposed algorithm has reduced the relative index of absolute trajectory error (ATE) by more than 90% compared with ORB-SLAM2. Our system is also superior than DynaSLAM and DS-SLAM in most cases, which proves that the proposed algorithm can effectively improve the localization accuracy of visual SLAM in dynamic scenes.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Data Availability
The data that support the findings of this study are available from the corresponding author Prof. Songlin Chen upon reasonable request.
Code Availability
Our source code is available at https://gitee.com/wizard_hai/slam-dynamic.git.
References
Fuentes-Pacheco, J., Ruiz-Ascencio, J., Rendón-Mancha, J.M.: Visual simultaneous locallization and map**: a survey. Artif. Intell. Rev. 43(1), 55 (2015)
Davison, A.J., Reid, I.D., Molton, N.D., Stasse, O.: MonoSLAM: Real-time single camera SLAM. IEEE Trans. Pattern Anal. Mach. Intell. 29(6), 1052–1067 (2007)
Klein, G., Murray, D.: “Parallel tracking and map** for small AR workspaces,” in Proc. IEEE ACM Int. Symp. Mixed Augmented Reality, 1-10 (2007)
Mur-Artal, R., Tardós, J.D.: ORB-SLAM2: An open-source SLAM system for monocular, stereo, and RGB-D cameras. IEEE Trans. Robot. 33(5), 1255–1262 (2017)
Engel, J., Schöps, T., Cremers, D.: “LSD-SLAM: Large-scale direct monocular SLAM,” in Proc. Eur. Conf. Comput. Vis., 834-849 (2014)
Fang, Y., Dai, B.: An Improved Moving Target Detecting and Tracking Based on Optical Flow Technique and Kalman Filter [C]// Proceedings of the 2009 4th International Conference on Computer Science & Education, pp. 1197–1202. IEEE, Piscataway (2009)
Bakkay, M.C., Majdi, A., Zagrouba, E.: Dense 3D SLAM in Dynamic Scenes Using Kinect[C]// 7th Iberian Conference IbPRIA, Pattern Recognition and Image Analysis, Lecture Notes in Computer Science, pp. 121–129. Springer, Cham (2015)
Kundu, A., Krishna, K. M., Sivaswamy, J.: “Moving object detection by multi-view geometric techniques from a single camera mounted robot,” in Proc. Intell. Robots Syst., 4306_4312 (2009)
Zhao, L., Liu, Z., Chen, J., et al.: A compatible framework for RGB-D SLAM in dynamic scenes[J] IEEE Access, (99):1–1 (2019)
Zhang, L., Wei, L., Shen, P., Wei, W., Zhu, G., Song, J.: Semantic SLAM based on object detection and improved octomap. IEEE Access. 6, 75545–75559 (2018)
** based on deep learning in dynamic environment. Robot. Auton. Syst. 117, 1–16 (2019)
Yu, C., Liu, Z., Liu, X.-J., ** and Inpainting in dynamic scenes[J]. IEEE Robot. Autom. Lett. 3(4), 1–1 (2018)
Wen, C., Mu, F., Liu, Y.H., et al.: Monocular semantic SLAM in dynamic street scene based on multiple object tracking[C]// 2017 IEEE International Conference on Cybernetics and Intelligent Systems (CIS) and IEEE Conference on Robotics, Automation and Mechatronics (RAM). IEEE (2017)
Liu, Y., Miura, J.: RDS-SLAM: real-time dynamic SLAM using semantic segmentation methods. IEEE Access. 9, 23772–23785 (2021). https://doi.org/10.1109/ACCESS.2021.3050617
Wojke, N., Bewley, A., Paulus, D.: "Simple online and realtime tracking with a deep association metric," 2017 IEEE International Conference on Image Processing (ICIP), pp. 3645–3649 (2017). https://doi.org/10.1109/ICIP.2017.8296962
Sahbani, B., Adiprawita, W.: "Kalman filter and Iterative-Hungarian Algorithm implementation for low complexity point tracking as part of fast multiple object tracking system," 2016 6th International Conference on System Engineering and Technology (ICSET), Bandung, 109–115 (2016)
Funding
This work was supported by the National Natural Science Foundation of China.
Author information
Authors and Affiliations
Contributions
Guihai Li: Algorithm design, experiment, writing the manuscript; Songlin Chen: Reviewing, Supervision, Analyses and Finalizing; All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Ethics Approval
Not applicable (this article does not contain any studies with human participants or animals performed by any of the authors).
Consent to Participate
All authors have participated in conception and design, or analysis and interpretation of the data; drafting the article or revising it critically for important intellectual content, and approval of the final version.
Consent for Publication
The authors declare no interest conflict regarding the publication of this paper.
Conflict of Interests
No conflict of interest exists in the submission of this manuscript.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Li, GH., Chen, SL. Visual Slam in Dynamic Scenes Based on Object Tracking and Static Points Detection. J Intell Robot Syst 104, 33 (2022). https://doi.org/10.1007/s10846-021-01563-3
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s10846-021-01563-3