Abstract
Mobile Telepresence Robots represent a class of robotic platforms, characterized by a video conferencing system mounted on a mobile robotic base, which allows a pilot user to move around in the robot’s environment. These commercially available platforms are relatively cheap and straightforward, yet robust enough to operate continuously in a dynamic environment. Their simplicity and robustness make them particularly suitable for the application in an elderly care context. Although the technology used on these robotic platforms has evolved considerably in recent years, these tools are meant to have no or minimal autonomy and are, hence, mostly relegated to provide pure telepresence services for video calls between the older users and their carers.
This work aims to lay the foundations to increase the autonomy of mobile telepresence robots, both by supporting teleoperation through shared approaches and offering services to users in total autonomy. To this purpose, different artificial intelligence technologies such as Reasoning, Knowledge Representation, Automated Planning, Machine Learning, Natural Language Processing, Advanced Perception and Navigation must coexist on limited hardware. An architecture aiming to integrate these technologies is proposed together with backbone services that integrate classical and innovative AI with robotics. Additionally, the problems that arise from the integration of heterogeneous technologies such as plan adaptation needs, shared navigation challenges and the generation of data-driven models able to run on not-performant hardware, are presented along with possible solutions exemplified on the older users assistance domain.
Authors are supported by projects: SI-Robotics, Cleverness, FocAAL.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
- 1.
In its most general form, planning complexity is undecidable.
References
Agarap, A.F.: Deep learning using rectified linear units (ReLU). CoRR abs/1803.08375 (2018)
Beraldo, G., Tonin, L., Cesta, A., Menegatti, E.: Brain-driven telepresence robots: a fusion of user’s commands with robot’s intelligence. In: Baldoni, M., Bandini, S. (eds.) AIxIA 2020. LNCS (LNAI), vol. 12414, pp. 235–248. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-77091-4_15
Beraldo, G., Tonin, L., Menegatti, E.: Shared intelligence for user-supervised robots: from user’s commands to robot’s actions. In: Baldoni, M., Bandini, S. (eds.) AIxIA 2020. LNCS (LNAI), vol. 12414, pp. 457–465. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-77091-4_27
Calvo, M.G., Fernández-Martín, A., Recio, G., Lundqvist, D.: Human observers and automated assessment of dynamic emotional facial expressions: KDEF-dyn database validation. Front. Psychol. 9, 2052 (2018)
Calvo, M.G., Lundqvist, D.: Facial expressions of emotion (KDEF): identification under different display-duration conditions. Behav. Res. Methods 40(1), 109–115 (2008). https://doi.org/10.3758/BRM.40.1.109
Ceballos, A., et al.: A goal-oriented autonomous controller for space exploration. ASTRA 11 (2011)
Cesta, A., Cortellessa, G., Fracasso, F., Orlandini, A., Turno, M.: User needs and preferences on AAL systems that support older adults and their carers. J. Ambient Intell. Smart Environ. 10(1), 49–70 (2018). https://doi.org/10.3233/AIS-170471
Clevert, D.A., Unterthiner, T., Hochreiter, S.: Fast and accurate deep network learning by exponential linear units (ELUs). ar**v, Learning (2016)
De Benedictis, R., Cesta, A.: Lifted heuristics for timeline-based planning. In: 24th European Conference on Artificial Intelligence, ECAI 2020, Santiago de Compostela, Spain (2020)
Devaram, R.R., Allegra, D., Gallo, G., Stanco, F.: Hyperspectral image classification via convolutional neural network based on dilation layers. In: Ricci, E., Rota Bulò, S., Snoek, C., Lanz, O., Messelodi, S., Sebe, N. (eds.) ICIAP 2019. LNCS, vol. 11751, pp. 378–387. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-30642-7_34
He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2016
Isabet, B., Pino, M., Lewis, M., Benveniste, S., Rigaud, A.S.: Social telepresence robots: a narrative review of experiments involving older adults before and during the COVID-19 pandemic. Int. J. Environ. Res. Public Health 18(7) (2021). https://www.mdpi.com/1660-4601/18/7/3597
Kanade, T., Cohn, J.F., Tian, Y.: Comprehensive database for facial expression analysis. In: Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580), pp. 46–53. IEEE (2000)
Kristoffersson, A., Coradeschi, S., Loutfi, A.: A review of mobile robotic telepresence. Adv. Hum. Comput. Interact. 2013, 1–17 (2013)
Chen, L.-F., Yen, Y.S.: Taiwanese facial expression image database. Brain Map** Laboratory, Institute of Brain Science, National Yang-Ming University, Taipei, Taiwan (2007)
Laniel, S., Létourneau, D., Grondin, F., Labbé, M., Ferland, F., Michaud, F.: Toward enhancing the autonomy of a telepresence mobile robot for remote home care assistance. Paladyn J. Behav. Robot. 12(1), 214–237 (2021)
Lucey, P., Cohn, J.F., Kanade, T., Saragih, J., Ambadar, Z., Matthews, I.: The extended Cohn-Kanade Dataset (CK+): a complete dataset for action unit and emotion-specified expression. In: 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops. IEEE, June 2010
Lyons, M., Akamatsu, S., Kamachi, M., Gyoba, J.: Coding facial expressions with gabor wavelets. In: Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition. IEEE Computer Society (1998)
Melendez-Fernandez, F., Galindo, C., Gonzalez-Jimenez, J.: A web-based solution for robotic telepresence. Int. J. Adv. Robot. Syst. 14(6), 1729881417743738 (2017). https://doi.org/10.1177/1729881417743738
Moro, C., Nejat, G., Mihailidis, A.: Learning and personalizing socially assistive robot behaviors to aid with activities of daily living. ACM Trans. Hum. Robot Interact. 7(2), 15:1–15:25 (2018)
Muscettola, N., Smith, S., Cesta, A., D’Aloisi, D.: Coordinating space telescope operations in an integrated planning and scheduling architecture. IEEE Control. Syst. 12(1), 28–37 (1992)
Orlandini, A., et al.: ExCITE project: a review of forty-two months of robotic telepresence technology evolution. Presence 25(3), 204–221 (2016)
Riano, L., Burbridge, C., Mc Ginnity, M.: A study of enhanced robot autonomy in telepresence. In: Proceedings of Artificial Intelligence and Cognitive Systems, AICS, Ireland, 31 August 2011, pp. 271–283. AICS (2011)
Rossi, S., Ferland, F., Tapus, A.: User profiling and behavioral adaptation for HRI: a survey. Pattern Recogn. Lett. 99, 3–12 (2017)
Sheridan, T.B.: Musings on telepresence and virtual presence. Presence: Teleoper. Virtual Environ. 1(1), 120–126 (1992). https://doi.org/10.1162/pres.1992.1.1.120
Tsui, K.M., Desai, M., Yanco, H.A., Uhlik, C.: Exploring use cases for telepresence robots. In: 2011 6th ACM/IEEE International Conference on Human-Robot Interaction (HRI), pp. 11–18 (2011). https://doi.org/10.1145/1957656.1957664
Umbrico, A., Cesta, A., Cortellessa, G., Orlandini, A.: A holistic approach to behavior adaptation for socially assistive robots. Int. J. Soc. Robot. 12(3), 617–637 (2020). https://doi.org/10.1007/s12369-019-00617-9
Yu, F., Koltun, V.: Multi-scale context aggregation by dilated convolutions. In: Bengio, Y., LeCun, Y. (eds.) 4th International Conference on Learning Representations, ICLR 2016, San Juan, Puerto Rico, 2–4 May 2016, Conference Track Proceedings (2016)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
De Benedictis, R., Beraldo, G., Devaram, R.R., Cesta, A., Cortellessa, G. (2022). Enhancing Telepresence Robots with AI: Combining Services to Personalize and React. In: Bandini, S., Gasparini, F., Mascardi, V., Palmonari, M., Vizzari, G. (eds) AIxIA 2021 – Advances in Artificial Intelligence. AIxIA 2021. Lecture Notes in Computer Science(), vol 13196. Springer, Cham. https://doi.org/10.1007/978-3-031-08421-8_3
Download citation
DOI: https://doi.org/10.1007/978-3-031-08421-8_3
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-08420-1
Online ISBN: 978-3-031-08421-8
eBook Packages: Computer ScienceComputer Science (R0)