Abstract
Mixed reality (MR) is a rapidly expanding technology whose usability is constantly growing. Some applications of MR technology have already matured, while others are still in development. MR offers new possibilities in the area of interaction with objects in space. This can be used in technical solutions, especially in employee training, education, and virtual product prototy**. In addition, users can “virtually” test and train products and machines using before they even exist, which can lead to improved usability and better ergonomic design. This article provides an overview of tools and devices for building mixed reality applications. In the design part, a step-by-step manual is devoted to the creation of an MR application depicting machinery, with which it is possible to work with a hologram in a real environment. This procedure is subsequently generalized into a methodological algorithm for creating an MR application. The universal procedure can be used by designers, application programmers, but also by the general public, as a manual according to which we can import any 3D model into HoloLens 2 smart glasses. The proposed methodology offers unlimited potential for the use of MR in technical solutions.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
O. Blimber, Spatial Augmented Reality: Merging Real and Virtual Worlds (A K Peters, Wellesley, 2005)
J. Husár, L. Knapčíková, Possibilities of using augmented reality in warehouse management: A study. Acta Logist. 8(2), 133–139 (2021). https://doi.org/10.1007/10.22306/al.v8i2.212
T. Mazuryk, M. Gervautz, Virtual Reality-History, Applications, Technology and Future (TU Wien University, Vienna, Austria, 1996)
O. Hansson, O. Nadum, Model based operator instructions using AR-technology. M.S. thesis, Department of Industrial and Materials Science, Chalmers University of Technology, Gothenburg, Sweden, 2019. https://hdl.handle.net/20.500.12380/300753. Last accessed 2022/11/04
P. Milgram, H. Takemura, A. Utsumi, F. Kishino, Augmented reality: A class of displays on the reality-virtuality continuum, in Telemanipulator and Telepresence Technologies, ed. by H. Das, (SPIE, Bellingham, 1995), pp. 282–292. https://doi.org/10.1117/12.197321
P. Milgram, F. Kishino, A taxonomy of Mixed Reality visual displays. IEICE Trans. Inf. Syst. E77-D(12), 1321–1329 (1994)
C. Forrest, Infographic: The history of AR and VR, and what the future holds, https://www.techrepublic.com/article/infographic-the-history-of-ar-and-vr-and-what-the-future-holds/. Last accessed 2022/11/04
Y. Zinchenko, P. Khoroshikh, A. Sergievich, et al., Virtual reality is more efficient in learning human heart anatomy especially for subjects with low baseline knowledge. New Ideas Psychol. 59, 100786 (2020). https://doi.org/10.1016/j.newideapsych.2020.100786
A. Mahmutovic, A. Andreasson, L. Söderström, Effektivisering av plockprocessen i lager med hjälp AV AR. Bachelor thesis, Department of Industrial and Materials Science, Chalmers University of Technology, Gothenburg, Sweden, 2018. https://hdl.handle.net/20.500.12380/255328. Last accessed 2022/11/03
V. Kaushal, Exploratory study: Implementation and applications of extended reality. Master’s thesis, Faculty of Science and Technology, University of Stavanger, Department of Mechanical and Structural Engineering and Materials Science, 2019
A. Heinzel, S. Azhar, A. Nadeem, Uses of augmented reality technology during construction phase, in 9th International Conference of Construction in the Twenty-first Century (CITC9), 5–7 March 2017, Dubai, UAE (2017)
J. Kaščak, J. Husár, L. Knapčíková, J. Trojanowska, V. Ivanov, Conceptual use of augmented reality in the maintenance of manufacturing facilities, in Advances in Manufacturing III. MANUFACTURING 2022, Lecture notes in mechanical engineering, ed. by J. Trojanowska, A. Kujawińska, J. Machado, I. Pavlenko, (Springer, Cham, 2022). https://doi.org/10.1007/978-3-030-99310-8_19
Unity. https://unity.com/. Last accessed 2022/11/04
J. Kascak, M. Teliskova, J. Torok, et al., Implementation of augmented reality into the training and educational process in order to support spatial perception in technical documentation, in Proceeding of the IEEE 6th International Conference on Industrial Engineering and Applications (ICIEA), 26–29 April 2019, Tokyo, Japan (2019), pp. 583–587, https://doi.org/10.1109/IEA.2019.8715120
H. Dhiman, S. Buttner, C. Rocker, R. Reisch, Handling work complexity with AR/deep learning, in Proceedings of the 31st Australian Conference on Human-Computer-Interaction (OZCHI’19), 2–5 December 2019, New York, USA (2020), pp. 518–522, https://doi.org/10.1145/3369457.3370919
F. Lamberti, F. Manuri, A. Sanna, G. Paravati, P. Pezzolla, P. Montuschi, Challenges, opportunities, and future trends of emerging techniques for augmented reality-based maintenance. IEEE Trans. Emerg. Top. Comput. 2(4), 411–421 (2014). https://doi.org/10.1109/TETC.2014.2368833
X.W. Chen, X. **, K. Wang, Lighting virtual objects in a single image via coarse scene understanding. Sci. China Inf. Sci. 57(9), 092105 (2014). https://doi.org/10.1007/s11432-013-4936-0
J. Husár, L. Knapčíková, Implementation of augmented reality in smart engineering manufacturing: Literature review. Mobile Netw. Appl. (2023). https://doi.org/10.1007/s11036-023-02121-x
E. Kucera, O. Haffner, R. Leskovský, Interactive and virtual/mixed reality applications for mechatronics education developed in unity engine, in 2018 Cybernetics & Informatics (K&I), Lazy pod Makytou, Slovakia (2018), pp. 1–5, https://doi.org/10.1109/CYBERI.2018.8337533
V.T. Nguyen, T. Dang, Setting up virtual reality and augmented reality learning environment in unity, in 2017 IEEE International Symposium on Mixed and Augmented Reality (ISMAR-Adjunct), Nantes, France (2017), pp. 315–320, https://doi.org/10.1109/ISMAR-Adjunct.2017.97
D.Q. Gbadago, J. Moon, S. Hwang, Mixed Reality-based chemical reactor visualization. IFAC-PapersOnLine 55(7), 580–585 (2022). https://doi.org/10.1016/j.ifacol.2022.07.506
P. Maniam, P. Schnell, L. Dan, R. Portelli, C. Erolin, R. Mountain, T. Wilkinson, Exploration of temporal bone anatomy using mixed reality (HoloLens): Development of a mixed reality anatomy teaching resource prototype. J. Vis. Commun. Med. 43(1), 17–26 (2020). https://doi.org/10.1080/17453054.2019.1671813
A. Maffei, M. Dalle Mura, F.M. Monetti, E. Boffa, Dynamic mixed reality assembly guidance using optical recognition methods. Appl. Sci. 13, 1760 (2023). https://doi.org/10.3390/app13031760
B.A.D. Marques, E.W.G. Clua, C.N. Vasconcelos, Deep spherical harmonics light probe estimator for mixed reality games. Comput. Graph. 76, 96–106 (2018). https://doi.org/10.1016/j.cag.2018.09.003
S. Hrehova, L. Knapcikova, The study of machine learning assisted the design of selected composites properties. Appl. Sci. 12, 10863 (2022). https://doi.org/10.3390/app122110863
J. Mascenik, Implementation of the designed program for calculation and check of chain gears. MM Sci. J. 2019, 3431–3434 (2019). https://doi.org/10.17973/MMSJ.2019_12_2019008
M. Wieczorowski, J. Trojanowska, O. Sokolov, Digital and information technologies in Metrology 4.0, in Advances in Design, Simulation and Manufacturing VI. DSMIE 2023, Lecture notes in mechanical engineering, ed. by V. Ivanov, J. Trojanowska, I. Pavlenko, E. Rauch, J. Piteľ, (Springer, Cham, 2023). https://doi.org/10.1007/978-3-031-32767-4_8
P. Buń, J. Husár, J. Kaščak, Hand tracking in extended reality educational applications, in Advances in Manufacturing III. MANUFACTURING 2022, Lecture notes in mechanical engineering, ed. by J. Trojanowska, A. Kujawińska, J. Machado, I. Pavlenko, (Springer, Cham, 2022). https://doi.org/10.1007/978-3-030-99310-8_25
Acknowledgments
This work was supported by the projects VEGA 1/0268/22, KEGA 038TUKE-4/2022 granted by the Ministry of Education, Science, Research and Sport of the Slovak Republic.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Husár, J., Hrehová, S., Knapčíková, L., Trojanowska, J. (2024). Concept of Mixed Reality Application Design for Technical Solutions. In: Knapčíková, L., Peraković, D. (eds) 8th EAI International Conference on Management of Manufacturing Systems. MMS 2023. EAI/Springer Innovations in Communication and Computing. Springer, Cham. https://doi.org/10.1007/978-3-031-53161-3_10
Download citation
DOI: https://doi.org/10.1007/978-3-031-53161-3_10
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-53160-6
Online ISBN: 978-3-031-53161-3
eBook Packages: EngineeringEngineering (R0)