Abstract
In development of formation control systems for modular robotic devices, especially relevant is the problem of analysis and, particularly, segmentation of complex surfaces, down which the robotic device will move. An approach based on fine-tuning of a neural network model HRNet was developed to solve the problem of segmentation of complex surfaces. Model fine-tuning was performed based on a custom dataset, which included 15,000 labeled images. The training dataset included the scenes of the following types: scenes with stairways, scenes with even surfaces, scenes with isolated obstacles and with groups of obstacles. Approbation and functional quality assessment of the developed approach were performed based on the test dataset, which included 3000 images with different levels of scene illumination. According to the results of the testing, the developed approach shows decent quality of segmentation on images with even surfaces (IoU = 90.2%) and with stairways (IoU = 71.3%) as well maintains some resilience to the variations in the scene luminosity levels. After fine-tuning, the averaged performance metrics of this neural network model on images with luminosity levels of 100% and 70% increased by 9.1% and 7.3% at average and resulted in 65.5% and 52%, respectively.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Grady, L.: Random walks for image segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 28(11), 1768–1783 (2006)
Kharinov, M.V., Khanykov, I.G.: Optimization of piecewise constant approximation for segmented image. SPIIRAS Proc. 3(40), 183–202 (2015). https://doi.org/10.15622/sp.40.12
Wu, Z., Leahy, R.: An optimal graph theoretic approach to data clustering: theory and its application to image segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 15(11), 1101–1113 (1993)
He, K., Gkioxari, G., Dollár, P., Girshick, R.: Mask r-cnn. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 2961–2969 (2017)
Ren, S., He, K., Girshick, R., Sun, J.: Faster r-cnn: towards real-time object detection with region proposal networks. IEEE Trans. Pattern Anal. Mach. Intell. 39(6), 1137–1149 (2016)
Lin, T.Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., Zitnick, C.L.: Microsoft coco: common objects in context. In: European Conference on Computer Vision, pp. 740–755. Springer, Cham (2014)
Tao, A., Sapra, K., Catanzaro, B.: Hierarchical Multi-Scale Attention for Semantic Segmentation. ar**v:2005.10821 (2020)
Cordts, M., Omran, M., Ramos, S., Rehfeld, T., Enzweiler, M., Benenson, R., Franke, U., Roth, S., Schiele, B.: The cityscapes dataset for semantic urban scene understanding. In: Proceedings of the IEEE Conference on Computer Vision And Pattern Recognition, pp. 3213–3223 (2016)
Neuhold, G., Ollmann, T., Rota Bulo, S., Kontschieder, P.: The mapillary vistas dataset for semantic understanding of street scenes. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 4990–4999 (2017)
Yu, C., Wang, J., Gao, C., Yu, G., Shen, C., Sang, N.: Context prior for scene segmentation. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 12416–12425 (2020)
Szegedy, C., Ioffe, S., Vanhoucke, V., Alemi, A.: Inception-v4, Inception-Resnet and the Impact of Residual Connections on Learning. ar**v:1602.07261 (2016)
Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., Fei-Fei, L.: Imagenet: a large-scale hierarchical image database. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition, pp. 248–255 (2009)
Mohan, R., Valada, A.: Efficientps: Efficient panoptic segmentation. ar**v:2004.02307 (2020)
Tan, M., Le, Q.V.: Efficientnet: Rethinking Model Scaling for Convolutional Neural Networks. ar**v:1905.11946 (2019)
Lin, T.Y., Dollár, P., Girshick, R., He, K., Hariharan, B., Belongie, S.: Feature pyramid networks for object detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2117–2125 (2017)
Zhang, X., Xu, H., Mo, H., Tan, J., Yang, C., Ren, W.: DCNAS: Densely Connected Neural Architecture Search for Semantic Image Segmentation. ar**v:2003.11883 (2020)
Chen, L.C.: Encoder-decoder with atrous separable convolution for semantic image segmentation. In: Proceedings of the European Conference on Computer Vision (ECCV), pp. 801–818 (2018)
Keselman, L., Iselin Woodfill, J., Grunnet-Jepsen, A., Bhowmik, A.: Intel realsense stereoscopic depth cameras. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 1–10 (2017)
McLure, C.E.: Implementing subnational value added taxes on internal trade: the compensating VAT (CVAT). Int. Tax Public Financ. 7(6), 723–740 (2000)
GOST R. 55710-2013 Illumination of workplaces inside buildings. In: Standards and Measurement Methods (2013) (in Russian)
Acknowledgements
This research is supported by the RFBR Project No. 20-08-01109_A.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Rubtsova, J. (2022). Approach to Image-Based Segmentation of Complex Surfaces Using Machine Learning Tools During Motion of Mobile Robots. In: Ronzhin, A., Shishlakov, V. (eds) Electromechanics and Robotics. Smart Innovation, Systems and Technologies, vol 232. Springer, Singapore. https://doi.org/10.1007/978-981-16-2814-6_17
Download citation
DOI: https://doi.org/10.1007/978-981-16-2814-6_17
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-16-2813-9
Online ISBN: 978-981-16-2814-6
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)