Figure - available via license: Creative Commons Attribution 4.0 International
Content may be subject to copyright.
Source publication
Metaverses embedded in our lives create virtual experiences inside of the physical world. Moving towards metaverses in aircraft maintenance, mixed reality (MR) creates enormous opportunities for the interaction with virtual airplanes (digital twin) that deliver a near-real experience, keeping physical distancing during pandemics. 3D twins of modern...
Context in source publication
Context 1
... sum up this experiment, the results of the best model in the form of the confusion matrix are illustrated in Table 2 for test data, Table 3 for test English data, and Table 4 for test Korean data, which shows the exact amount of correct and incorrect predictions. Next, we demonstrated the results of the language classification part in Table 5. This experiment shows that, for all test sets, the proposed speech commands classification network performed nearly perfectly, with about 99% for all metrics. ...Similar publications
In the emerging world of metaverses, it is essential for speech communication systems to be aware of context to interact with virtual assets in the 3D world. This paper proposes the metaverse for aircraft maintenance training and education of Boeing-737, supplied with legacy manuals, 3D models, 3D simulators, and aircraft maintenance knowledge. Fur...
Citations
... Zhang et al. [197] introduced a projection-based AR-assisted assembly system that supports multimodal interaction, including voice, gestures, and finger taps. Siyaev et al. [196] developed a voice interaction module for aircraft maintenance training in the HoloLens 2. Their system can processes mixed requests in English and Korean and provide corresponding feedback. This setup enables maintenance workers to utilize voice commands for controlling virtual AR content and workflow effectively. ...
... After qualitative analysis of the literature in Table 4, we summarized [170], (c) Voice interaction [196], (d) Bare hand interaction [51], (e) Head pointer [194,195], (f) Eye gaze [170]. [193]. ...
As an emerging manufacturing paradigm, Industry 5.0 emphasizes human-centric intelligent manufacturing. XR technology (a general term of virtual reality, augmented reality and mixed reality) brings unprecedented opportunities for assembly in such manufacturing paradigm. We provide a comprehensive review, in-depth analysis , and prospect on XR in product intelligent assembly from two points of views of technology and application. Subsequently, the benefits and potential of XR in assembly are discussed from three perspectives of users, enterprises and industries. Finally, challenges and future research directions for XR are outlined from the perspectives of hardware issues and technological maturity. This review is expected to provide useful references for XR-related research and application in the future.
... In recent years, the tourism sector is one of the sectors that has begun to be affected by the impact of scientific and technological developments. At the beginning of 2022, the introduction of metaverse tourism, metaverse is likened to creating a real-world (physical) experience in virtual space by utilizing technology [2]. ...
This research examines the strategy and planning of metaverse in the National Gallery. The purpose of this research is to find out and learn the right strategy and planning in tourism, especially at the National Gallery tourist attraction. The research method used is the literature study method by collecting library data, reading and recording, and processing research materials. The results show that regarding the strategy of Augmented Reality (AR) and Virtual Reality (VR) technology that will be carried in the development of Metaverse and analysis of the use of information media, it can be summarized and concluded that Metaverse has considerable potential and opportunities as information media and the latest interactive educational media for the National Gallery.
... Numerous organizations consider the metaverse as the next generation of digital transformation (Gökhan, 2021). Besides, the metaverse has been defined as a 3D virtual world that could break physical boundaries; it allows users to communicate and interact with each other in the form of virtual characters (Davis et al. 2009;Siyaev and Jo 2021). Furthermore, the metaverse is an upgraded version of the Massively Multiplayer Online Role-Playing Game (MMORPG). ...
... Some studies have discussed the practical application of the metaverse. For example, Siyaev and Jo (2021) demonstrated MR-based education in aircraft maintenance to provide a near-real maintenance experience. Choi and Kim (2017) presented a content service for museum exhibitions that was enabled by a Head-Mounted Display (HMD), enhanced with a storytelling feature, and made through a combination of AR and a virtual world. ...
... Numerous organizations have established virtual metaverse platforms (such as Roblox, Decentraland, and Opensea), which break physical boundaries and allow users to utilize their virtual characters to communicate with each other (Siyaev and Jo 2021). Users can project their ideal life into the metaverse using digital avatars and leading their second life in parallel space. ...
The issue of the metaverse has been widely discussed. The purpose of this research is to investigate users’ willingness to participate in the metaverse. This study used the self-efficacy theory and Theory of Reasoned Action (TRA) to explore their willingness to attend the metaverse. Furthermore, the study explored how the basic concepts of the metaverse (Avatars, Decentralized Value Exchange, and Immersive Experience) influence the users’ attitudes (Presence in Second-Life, 3D Interactivity, and Play-to-Earn) toward and willingness with respect to participating in the metaverse. A total of 150 valid experts’ responses were collected through an online questionnaire and analyzed through structural equation modeling. The results revealed that Presence in Second-Life and Play-to-Earn significantly impact the respondents’ willingness to participate in the metaverse. Moreover, 3D Interactivity affected their participation to willingness through Presence in Second-Life and Play-to-Earn.
... Leveraging its benefits, speech interaction has been explored in various fields such as medicine for treating social phobia [73], collaborative data analysis [12], and managing digital twins of complex machinery [68]. With the rise of advanced deep learning NLP models, speaker-dependent systems have become less relevant. ...
... standard deviation=1.44). Study conducted by Siyaev (2021) found results that aligned with the study findings. Their results revealed that aircraft with advanced and complex systems indeed necessitate more frequent and extensive maintenance procedures. ...
... A review of case studies demonstrated that the metaverse can be applied in a wide range of training domains, including safety (Fajar et al., 2022), disaster response (Hsu et al., 2013), maintenance (Siyaev and Jo, 2021), health care and military (Optimus system, 2019). The metaverse provides a realistic training simulation that can mitigate the risks associated with onsite training. ...
Purpose
The purpose of this study is to explore the potential contribution of the metaverse to improve training and development as a function of human resource development (HRD) perspective. The authors explore the benefits and challenges of the metaverse and introduce cases of companies using the metaverse in training.
Design/methodology/approach
A narrative literature review was conducted to collect information on the metaverse in training. The authors reviewed peer- and non-peer-reviewed articles, book chapters, white papers, corporate websites and blogs and business magazines.
Findings
A total of 75 articles were reviewed, including 14 cases, which were summarized to demonstrate how companies are applying metaverse technology in training contexts. For a more in-depth review, three cases were selected and summarized in terms of context, process and outcomes.
Originality/value
The metaverse is an emergent topic in HRD. It has the potential to revolutionize the functions of training and development through the combination of advanced technologies, including virtual reality, augmented reality and mixed reality. This article is the foundational attempt to provide a comprehensive summary of existing literature and case studies that highlight the potential of the metaverse in training within the context of HRD.
... There are several studies that investigate planning [25] and scheduling problems [26] that can be included in topic 1 Development and Digitalization of the Operational Process for MRO Applications. Even research that concerns digitalization [24], Augmented Reality (AR) new maintenance manuals [28], Virtual Reality (VR) new training material [29], speech recognition to aid technicians [30], and even applications [31] and software development [32]. As for the second concept, the literature is full of novel ideas that help with the detection and inspection of the aircraft structure. ...
... This metaverse-based aircraft maintenance system provides a more economical and scale-able solution for aviation educational institutions. In another similar work by the authors in [48], a CNN architecture is used for enabling the learning and classification of audio features for identification of the commands for controlling the virtual digital twin of the Boeing 737 aircraft. Further, this work has reported higher prediction accuracy with improved training capabilities through immersive interaction and effective control of virtual objects in the 3D twin model of the aircraft. ...
Metaverse has evolved as one of the popular research agendas that let users learn, socialize, and collaborate in a networked three-dimensional (3D) immersive virtual world. Due to the rich multimedia streaming capability and immersive user experience with high-speed communication, the metaverse is an ideal model for education, training, and skill development tasks. To facilitate research in this area, we provide a comprehensive review of the various educational use cases and explore how enabling technologies such as Extended reality (XR) and the Internet of Everything (IoE) will play a major role in educational services in future metaverses. Secondly, we provide an overview of metaverse-based educational applications focusing on education, training, and skill development and analyze the technologies they are built upon. We identify common research problems and future research directions in the domain. The paper also identifies core ethical considerations of metaverse for education and potential pitfalls. We believe this survey can fully demonstrate the versatility of metaverse-driven education, which could serve as a potential guideline for the researchers.
... In particular, Facebook focuses on creating the future Metaverse by rebranding itself as "Meta" [14]. Also, the ability to manipulate, exchange, and update 3D twins of advanced machines exported to Mixed Reality (MR) creates huge benefits for aviation institutions [15]. ...
Metaverse is an instance of the future web. It describes a collective virtual shared space, where users can engage with virtual environments in real-time. Using Artificial Intelligence (AI), Virtual Reality (VR), Augmented Reality (AR), digital twin, and blockchain technology, the Metaverse is becoming a reality in science fiction. With these technologies, the Metaverse will inevitably emerge with new cybersecurity challenges and risks. Thus, significant privacy and security breaches in the Metaverse could hamper its widespread deployment. This review and analysis paper attempts to dissect the cybersecurity threats related to the Metaverse by outlining the supporting technologies and exploring the cybersecurity vulnerabilities in each of these technologies. The motive is to assess security challenges, privacy threats, and potential controls to manage virtual reality environments with real-time ambience.
... Companies like BMW, Porsche, and Boeing have utilized XR for vehicle maintenance, streamlining engineering processes, and enhancing in-vehicle experiences [63], [64]. In the aviation industry, MR is prominently used in aircraft maintenance, enabling virtual interactions with airplane digital twins for enhanced training and safety in transportation within the metaverse [65]. ...
Intelligent transportation systems (ITS) have made significant advancements in enhancing transportation safety, reliability, and efficiency. However, challenges persist in security, privacy, data management, and integration. Metaverse, an emerging technology enabling immersive and simulated experiences, presents promising solutions to overcome these challenges. By establishing secure communication channels, facilitating virtual simulations for safe testing and training, and enabling centralized data management with real-time analytics, metaverse offers a transformative approach to address these challenges. While metaverse has found extensive applications across industries, its potential in transportation remains largely untapped. This comprehensive review delves into the integration of the metaverse in ITS, exploring key technologies like virtual reality, digital twin, blockchain, and artificial intelligence, and their specific applications in the context of ITS. Real-world case studies, research projects, and initiatives are compiled to showcase the metaverse’s potential for ITS. It also examines the societal, economic, and technological implications of metaverse integration in ITS and highlights the associated integration challenges. Lastly, future research directions are identified to unlock the metaverse’s full potential in enhancing transportation systems.
