Abstract
Conventional automatic doors cannot distinguish between people wishing to pass through the door and people passing by the door, so they often open unnecessarily. This leads to the need to adopt new systems in both commercial and non-commercial environments: smart doors. In particular, a smart door system predicts the intention of people near the door based on the social context of the surrounding environment and then makes rational decisions about whether or not to open the door. This work proposes the first position paper related to smart doors, without bells and whistles. We first point out that the problem not only concerns reliability, climate control, safety, and mode of operation. Indeed, a system to predict the intention of people near the door also involves a deeper understanding of the social context of the scene through a complex combined analysis of proxemics and scene reasoning. Furthermore, we conduct an exhaustive literature review about automatic doors, providing a novel system formulation. Also, we present an analysis of the possible future application of smart doors, a description of the ethical shortcomings, and legislative issues.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Alahi, A., Goel, K., Ramanathan, V., Robicquet, A., Fei-Fei, L., Savarese, S.: Social lstm: human trajectory prediction in crowded spaces. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 961–971 (2016)
Andriluka, M., Roth, S., Schiele, B.: People-tracking-by-detection and people-detection-by-tracking. In: 2008 IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–8. IEEE (2008)
Becker, S., Hug, R., Hübner, W., Arens, M.: An evaluation of trajectory prediction approaches and notes on the trajnet benchmark (2018). ar**v preprint ar**v:1805.07663
Benenson, R., Omran, M., Hosang, J., Schiele, B.: Ten years of pedestrian detection, what have we learned? In: Agapito, L., Bronstein, M.M., Rother, C. (eds.) ECCV 2014. LNCS, vol. 8926, pp. 613–627. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-16181-5_47
Boominathan, L., Kruthiventi, S.S., Babu, R.V.: Crowdnet: a deep convolutional network for dense crowd counting. In: Proceedings of the 24th ACM International Conference on Multimedia, pp. 640–644 (2016)
Brunetti, A., Buongiorno, D., Trotta, G.F., Bevilacqua, V.: Computer vision and deep learning techniques for pedestrian detection and tracking: a survey. Neurocomputing 300, 17–33 (2018)
Chan, A.B., Liang, Z.S.J., Vasconcelos, N.: Privacy preserving crowd monitoring: counting people without people models or tracking. In: 2008 IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–7. IEEE (2008)
Chiu, S.Y., Chiu, S.Y., Tu, Y.J., Hsu, C.I.: Gesture-based intention prediction for automatic door opening using low-resolution thermal sensors: a u-net-based deep learning approach. In: 2021 IEEE 3rd Eurasia Conference on IOT, Communication and Engineering (ECICE), pp. 271–274. IEEE (2021)
Cho, K., et al.: Learning phrase representations using rnn encoder-decoder for statistical machine translation (2014). ar**v preprint ar**v:1406.1078
Cojocea, M.E., Rebedea, T.: An efficient solution for people tracking and profiling from video streams using low-power computer. In: Hernes, M., Wojtkiewicz, K., Szczerbicki, E. (eds.) ICCCI 2020. CCIS, vol. 1287, pp. 154–165. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-63119-2_13
Criminisi, A., Reid, I., Zisserman, A.: Single view metrology. Int. J. Comput. Vision 40(2), 123–148 (2000)
Dalal, N.: Finding people in images and videos. Ph.D. thesis, Institut National Polytechnique de Grenoble-INPG (2006)
Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. In: 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2005), vol. 1, pp. 886–893. IEEE (2005)
Donnelly, M., Paggetti, C., Nugent, C., Mokhtari, M. (eds.): ICOST 2012. LNCS, vol. 7251. Springer, Heidelberg (2012). https://doi.org/10.1007/978-3-642-30779-9
Fatima, I., Fahim, M., Lee, Y.-K., Lee, S.: Analysis and effects of smart home dataset characteristics for daily life activity recognition. J. Supercomput. 66(2), 760–780 (2013). https://doi.org/10.1007/s11227-013-0978-8
Feng, X., Yazawa, Y., Kita, E., Zuo, Y.: Control of automatic door by using kinect sensor. Bull. Netw. Comput. Syst. Softw. 6(1), 17–21 (2017)
Fosstveit, H.A.: Intelligent sliding doors. Master’s thesis, Institutt for datateknikk og informasjonsvitenskap (2012)
Franco, L., Placidi, L., Giuliari, F., Hasan, I., Cristani, M., Galasso, F.: Under the hood of transformer networks for trajectory forecasting. ar**v preprint ar**v:2203.11878 (2022)
Fuentes, L.M., Velastin, S.A.: People tracking in surveillance applications. Image Vision Comput. 24(11), 1165–1171 (2006)
García, V.H., Vega, N.: Low power sensor node applied to domotic using IoT. In: Mata-Rivera, M.F., Zagal-Flores, R. (eds.) WITCOM 2018. CCIS, vol. 944, pp. 56–69. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-03763-5_6
Gautschi, M., et al.: Near-threshold risc-v core with dsp extensions for scalable iot endpoint devices. IEEE Trans. Very Large Scale Integr. (VLSI) Syst. 25(10), 2700–2713 (2017)
Giuliari, F., Hasan, I., Cristani, M., Galasso, F.: Transformer networks for trajectory forecasting. In: 2020 25th International Conference on Pattern Recognition (ICPR), pp. 10335–10342. IEEE (2021)
Gupta, A., Johnson, J., Fei-Fei, L., Savarese, S., Alahi, A.: Social gan: socially acceptable trajectories with generative adversarial networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2255–2264 (2018)
Hochreiter, S., Schmidhuber, J.: Long short-term memory. Neural Comput. 9(8), 1735–1780 (1997)
Iskandar, D., Nugroho, E.W., Rahmawati, D., Rozikin, I.: Automatic door control system with body temperature sensor. Int. J. Comput. Inf. Syst. (IJCIS) 2(4), 111–114 (2021)
Jafari, O.H., Mitzel, D., Leibe, B.: Real-time rgb-d based people detection and tracking for mobile robots and head-worn cameras. In: 2014 IEEE International Conference on Robotics and Automation (ICRA), pp. 5636–5643. IEEE (2014)
Jimoh, I., Joshi, A., Mikail, O.O.: Intelligent voice-based door access control system using adaptive-network-based fuzzy inference systems (anfis). J. Comput. Sci. 3(5), 274–280 (2007)
Kim, G.D., Won, S.Y., Kim, H.S.: An object recognition performance improvement of automatic door using ultrasonic sensor. J. Inst. Electron. Inf. Eng. 54(3), 97–107 (2017)
Kiru, M.U., Belaton, B., Mohamad, S.M.S., Usman, G.M., Kazaure, A.A.: Intelligent automatic door system based on supervised learning. In: 2020 IEEE Conference on Open Systems (ICOS), pp. 43–47. IEEE (2020)
Leibe, B., Seemann, E., Schiele, B.: Pedestrian detection in crowded scenes. In: 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2005), vol. 1, pp. 878–885. IEEE (2005)
Liciotti, D., Paolanti, M., Frontoni, E., Zingaretti, P.: People detection and tracking from an RGB-D camera in top-view configuration: review of challenges and applications. In: Battiato, S., Farinella, G.M., Leo, M., Gallo, G. (eds.) ICIAP 2017. LNCS, vol. 10590, pp. 207–218. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-70742-6_20
Lin, T., Wang, Y., Liu, X., Qiu, X.: A survey of transformers (2021). ar**v preprint ar**v:2106.04554
Liu, J., Gao, C., Meng, D., Hauptmann, A.G.: Decidenet: counting varying density crowds through attention guided detection and density estimation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 5197–5206 (2018)
Lwin, H.H., Khaing, A.S., Tun, H.M.: Automatic door access system using face recognition. Int. J. Sci. Technol. Res 4(6), 294–299 (2015)
Lymperopoulos, P., Meade, K.: Pathpass: opening doors for people with disabilities. In: 2014 4th International Conference on Wireless Mobile Communication and Healthcare-Transforming Healthcare Through Innovations in Mobile and Wireless Technologies (MOBIHEALTH), pp. 32–35. IEEE (2014)
Mangalam, K., An, Y., Girase, H., Malik, J.: From goals, waypoints & paths to long term human trajectory forecasting. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 15233–15242 (2021)
Mangalam, K., et al.: It is not the journey but the destination: endpoint conditioned trajectory prediction. In: Vedaldi, A., Bischof, H., Brox, T., Frahm, J.-M. (eds.) ECCV 2020. LNCS, vol. 12347, pp. 759–776. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-58536-5_45
Morris, B.T., Trivedi, M.M.: A survey of vision-based trajectory learning and analysis for surveillance. IEEE Trans. Circ. Syst. Video Technol. 18(8), 1114–1127 (2008)
Nguyen, D.T., Li, W., Ogunbona, P.O.: Human detection from images and videos: a survey. Pattern Recogn. 51, 148–175 (2016)
Papadopoulos, E.: Heron of alexandria (c. 10–85 ad). In: Distinguished Figures in Mechanism and Machine Science, pp. 217–245. Springer, Heidelberg (2007). https://doi.org/10.1007/978-1-4020-6366-4_9
Robles, R.J., Kim, T.H., Cook, D., Das, S.: A review on security in smart home development. Int. J. Adv. Sci. Technol. 15 (2010)
Rother, C.: A new approach to vanishing point detection in architectural environments. Image Vision Comput. 20(9–10), 647–655 (2002)
Salzmann, T., Ivanovic, B., Chakravarty, P., Pavone, M.: Trajectron++: multi-agent generative trajectory forecasting with heterogeneous data for control (2020)
Scherer, M., Mayer, P., Di Mauro, A., Magno, M., Benini, L.: Towards always-on event-based cameras for long-lasting battery-operated smart sensor nodes. In: 2021 IEEE International Instrumentation and Measurement Technology Conference (I2MTC), pp. 1–6. IEEE (2021)
Skenderi, G., et al.: Dohmo: embedded computer vision in co-housing scenarios. In: 2021 Forum on specification & Design Languages (FDL), pp. 01–08. IEEE (2021)
Song, D.H., Chang, B.K.: Development of on intelligent automatic door system using ultrasonic sensors. J. Kor. Inst. Illuminat. Electr. Install. Eng. 23(6), 31–39 (2009)
Styles, O., Ross, A., Sanchez, V.: Forecasting pedestrian trajectory with machine-annotated training data. In: 2019 IEEE Intelligent Vehicles Symposium (IV), pp. 716–721. IEEE (2019)
Sümbül, H., Coşkun, A., Taşdemir, M.: The control of an automatic door using fuzzy logic. In: 2011 International Symposium on Innovations in Intelligent Systems and Applications, pp. 432–435. IEEE (2011)
Supriana, A., Prakosa, B.A., Ritzkal, R.: Implementation of body temperature checking system with automatic door lock web and arduino assistance. Jurnal Mantik 5(3), 1915–1921 (2021)
Terashima, T., Kawai, Y.: A proposal for an automatic door opening and closing interface based on speech recognition and pose estimation. In: Proceedings of the 9th International Conference on Human-Agent Interaction, pp. 283–285 (2021)
Tseng, T.E., Liu, A.S., Hsiao, P.H., Huang, C.M., Fu, L.C.: Real-time people detection and tracking for indoor surveillance using multiple top-view depth cameras. In: 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 4077–4082. IEEE (2014)
Varshini, B., Yogesh, H., Pasha, S.D., Suhail, M., Madhumitha, V., Sasi, A.: Iot-enabled smart doors for monitoring body temperature and face mask detection. Global Trans. Proc. 2(2), 246–254 (2021)
Vaswani, A., et al.: Attention is all you need. Adv. Neural Inf. Process. Syst. 30 (2017)
Walther, D.: Interactions of visual attention and object recognition: computational modeling, algorithms, and psychophysics. California Institute of Technology (2006)
Wang, X., **ao, T., Jiang, Y., Shao, S., Sun, J., Shen, C.: Repulsion loss: detecting pedestrians in a crowd. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 7774–7783 (2018)
Welch, G., Bishop, G., et al.: An introduction to the kalman filter (1995)
Wojke, N., Bewley, A., Paulus, D.: Simple online and realtime tracking with a deep association metric. In: 2017 IEEE International Conference on Image Processing (ICIP), pp. 3645–3649. IEEE (2017)
Wu, S.Y., Wang, Y.Y.: Design of a new intelligent electronic door system. Comput. Modern. 251(07), 115 (2016)
Xu, B., Qiu, G.: Crowd density estimation based on rich features and random projection forest. In: 2016 IEEE Winter Conference on Applications of Computer Vision (WACV), pp. 1–8. IEEE (2016)
Yang, J.C., Lai, C.L., Sheu, H.T., Chen, J.J.: An intelligent automated door control system based on a smart camera. Sensors 13(5), 5923–5936 (2013)
Yilmaz, A., Javed, O., Shah, M.: Object tracking: a survey. ACM Comput. Surv. (CSUR) 38(4), 13-es (2006)
Yoon, S.H., et al.: IoT open-source and AI based automatic door lock access control solution. Int. J. Internet Broadcast. Commun. 12(2), 8–14 (2020)
Zhao, L., Thorpe, C.E.: Stereo-and neural network-based pedestrian detection. IEEE Trans. Intell. Transp. Syst. 1(3), 148–154 (2000)
Acknowledgements
This work has been partially supported by the Italian Ministry of Education, University and Research (MIUR) with the grant “Dipartimenti di Eccellenza” 2018–2022.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 Springer Nature Switzerland AG
About this paper
Cite this paper
Capogrosso, L., Skenderi, G., Girella, F., Fummi, F., Cristani, M. (2023). Toward Smart Doors: A Position Paper. In: Rousseau, JJ., Kapralos, B. (eds) Pattern Recognition, Computer Vision, and Image Processing. ICPR 2022 International Workshops and Challenges. ICPR 2022. Lecture Notes in Computer Science, vol 13644. Springer, Cham. https://doi.org/10.1007/978-3-031-37742-6_51
Download citation
DOI: https://doi.org/10.1007/978-3-031-37742-6_51
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-37741-9
Online ISBN: 978-3-031-37742-6
eBook Packages: Computer ScienceComputer Science (R0)