Abstract
The pavilion combines multi-modal interaction based on Time-Division Long Term Evolution (TD-LTE) to increase the exhibition's interactivity and attractiveness with development of digital technology. Multi-modal interaction enables consumers to engage easily and intuitively with exhibitions or display material with the use of a touch screen, voice recognition, posture detection, and other interactive tools for immersive displays. This paper investigates the construction of a multi-modal interactive exhibition space using digital media technology. In contrast to the usual data collection techniques, which are costly, deficient in 3D pictures, suffer from a lack of spatial position data, and have other drawbacks, key techniques such as deep learning and posture estimation employed in immersive displays sometimes require huge training datasets to enhance the generality of the models. A 6D network architecture for target object estimation is proposed in this research to lower the cost of data collection. The interactive experience of visitors in the exhibition space, exhibit display, and exhibition space management can be improved by multi-modal interaction based on TD-LTE. Visitors can peruse exhibit material, watch movies, and play interactive games more freely due to the engagement modes. Exhibition managers may optimize the layout of the exhibition space and the placement of the exhibits through real-time monitoring, data collection, and analysis. The multi-mode interaction mode based on TD-LTE wireless communication technology can give visitors a rich and more user-friendly exhibition experience with a wide range of application prospects and potentials.
Similar content being viewed by others
Availability of data and material
The data used to support the findings of this study are available from the corresponding author upon request.
References
Steinicke, F., Wolf, K. (2020) New digital realities–blending our reality with virtuality. i-com, 19, pp. 61–65
Kim, S., Kang, S., Ryu, K. R., & Song, G. (2019). Real-time occupancy prediction in a large exhibition hall using deep learning approach. Energy and Buildings, 199, 216–222.
Zhao, L., (2022). Personalized healthcare museum exhibition system design based on VR and deep learning driven multimedia and multimodal sensing. Personal and Ubiquitous Computing, pp.1–16.
Wang, M., Lu, S., Zhu, D., Lin, J. and Wang, Z., 2018. A high-speed and low-complexity architecture for softmax function in deep learning. In 2018 IEEE asia pacific conference on circuits and systems (APCCAS) (pp. 223–226). IEEE.
Shang, Y., Pu, Y., Yu, Y., Gao, N., & Lu, Y. (2023). Role of the e-exhibition industry in the green growth of businesses and recovery. Economic Change and Restructuring, 56(3), 2003–2020.
Kim, Y., Jeong, H., Cho, J. D., & Shin, J. (2021). Construction of a soundscape-based media art exhibition to improve user appreciation experience by using deep neural networks. Electronics, 10(10), 1170.
Lu, S., Ding, Y., Liu, M., Yin, Z., Yin, L., & Zheng, W. (2023). Multiscale feature extraction and fusion of image and text in VQA. International Journal of Computational Intelligence Systems, 16(1), 54.
Zhou, X., & Zhang, L. (2022). SA-FPN: An effective feature pyramid network for crowded human detection. Applied Intelligence, 52(11), 12556–12568.
Zhou, L., Ye, Y., Tang, T., Nan, K., & Qin, Y. (2021). Robust matching for SAR and optical images using multiscale convolutional gradient features. IEEE Geoscience and Remote Sensing Letters, 19, 1–5.
Inci, A.F., Isgenc, M.M. and Marculescu, D., (2020). DeepNVM: A framework for modeling and analysis of non-volatile memory technologies for deep learning applications. In 2020 Design, Automation & Test in Europe Conference & Exhibition (DATE) (pp. 1295–1298). IEEE.
Huang, N.C., Chen, S.Y. and Wu, K.C., (2019). Sensor-based approximate adder design for accelerating error-tolerant and deep-learning applications. In 2019 Design, Automation & Test in Europe Conference & Exhibition (DATE) (pp. 692–697). IEEE.
Mondal, S., Ling, Y.S. and Ambikapathi, A., (2021). H-stegonet: A hybrid deep learning framework for robust steganalysis. In 2021 IEEE International Conference on Multimedia and Expo (ICME) (pp. 1–6). IEEE.
Liu, P., Liu, W. and Ma, H., (2017). Weighted sequence loss based spatial-temporal deep learning framework for human body orientation estimation. In 2017 IEEE International Conference on Multimedia and Expo (ICME) (pp. 97–102). IEEE.
Ouyang, W., Chu, X. and Wang, X., (2014). Multi-source deep learning for human pose estimation. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 2329–2336).
Zhou, G., Song, B., Liang, P., Xu, J., & Yue, T. (2022). Voids filling of DEM with multiattention generative adversarial network model. Remote Sensing, 14(5), 1206.
Pan, S., Lin, M., Xu, M., Zhu, S., Bian, L. A., & Li, G. (2021). A low-profile programmable beam scanning holographic array antenna without phase shifters. IEEE Internet of Things Journal, 9(11), 8838–8851.
Luvizon, D.C., Picard, D. and Tabia, H., (2018). 2d/3d pose estimation and action recognition using multitask deep learning. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 5137–5146).
Chen, Y., Tian, Y., & He, M. (2020). Monocular human pose estimation: A survey of deep learning-based methods. Computer Vision and Image Understanding, 192, 102897.
Gamra, M. B., & Akhloufi, M. A. (2021). A review of deep learning techniques for 2D and 3D human pose estimation. Image and Vision Computing, 114, 104282.
Hong, C., Yu, J., Zhang, J., **, X., & Lee, K. H. (2018). Multimodal face-pose estimation with multitask manifold deep learning. IEEE transactions on industrial informatics, 15(7), 3952–3961.
Chatzis, T., Stergioulas, A., Konstantinidis, D., Dimitropoulos, K., & Daras, P. (2020). A comprehensive study on deep learning-based 3D hand pose estimation methods. Applied Sciences, 10(19), 6850.
Liu, S., Yin, Y., & Ostadabbas, S. (2019). In-bed pose estimation: Deep learning with shallow dataset. IEEE journal of translational engineering in health and medicine, 7, 1–12.
Zeng, A., Yu, K.T., Song, S., Suo, D., Walker, E., Rodriguez, A. and **ao, J., (2017). Multi-view self-supervised deep learning for 6d pose estimation in the amazon picking challenge. In 2017 IEEE international conference on robotics and automation (ICRA) (pp. 1386–1383). IEEE.
Ali, G., Le, H.Q., Kim, J., Hwang, S.W. and Hwang, J.I., (2019). Design of seamless multi-modal interaction framework for intelligent virtual agents in wearable mixed reality environment. In Proceedings of the 32nd International Conference on Computer Animation and Social Agents (pp. 47–52).
Yu, W., & Jiang, T. (2021). Research on the direction of innovation and entrepreneurship education reform within the digital media art design major in the digital economy. Frontiers in psychology, 12, 719754.
Li, T., Hua, S., Kang, L., & Chang, S. H. (2021). Research on TD-LTE wireless communication network propagation model optimization based on visual simulation and GIS. EURASIP Journal on Wireless Communications and Networking, 2021(1), 1–14.
Acknowledgements
The paper did not receive any financial support
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
Declares that he has no conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Jie, Y. Multi-modal interaction using time division long-term evolution (TD-LTE) for space designing exhibition. Wireless Netw 29, 3625–3636 (2023). https://doi.org/10.1007/s11276-023-03427-0
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11276-023-03427-0