Figure - available via license: Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International
Content may be subject to copyright.
Evaluation of Pre-trained wav2vec2.0 models on Test Real Data
Source publication
In the emerging world of metaverses, it is essential for speech communication systems to be aware of context to interact with virtual assets in the 3D world. This paper proposes the metaverse for aircraft maintenance training and education of Boeing-737, supplied with legacy manuals, 3D models, 3D simulators, and aircraft maintenance knowledge. Fur...
Contexts in source publication
Context 1
... of experimented pre-trained models in Table 1 and Table 2, the wav2vec2.0 model trained on 960 hours of Libri Speech (Pre-trained Libri-960h) dataset shows the best performance, among others. ...Context 2
... Model WER WRR CER MER WIL WIP ACC Base 1.000 0.000 1.000 1.000 1.000 0.000 0.000 Libri-100h 0.521 0.479 0.095 0.443 0.634 0.366 0.512 Libri-960h 0.454 0.546 0.068 0.388 0.560 0.440 0.597 Timit 0.600 0.401 0.159 0.523 0.738 0.262 0.377 the Fine-Tuned Libri-960h model in Table 3 and evaluated performances on Test Real and compare the results in Table 2 and Table 4. The best models on Test Real data show 14.1% of WER and 89.4% of overall Accuracy, which is about 10% lower in comparison with Test API. ...Citations
... Professional Development for Educators: Educators can benefit from metaverse technologies for their professional development. Virtual workshops, conferences, and collaborative spaces can bring teachers together to share best practices, discuss innovative teaching methods, and stay updated on the latest educational trends Siyaev, & Jo, 2021;Li, et al., 2022). This ongoing professional development contributes to the overall improvement of teaching quality. ...
This paper undertakes a comprehensive examination of the framework, applications,
challenges, and future development prospects of metaverse technologies within the educational
domain, focusing on a diverse array of techniques that contribute to the continuous evolution of this
innovative educational landscape. The framework analysis delves into the design and
implementation strategies that form the foundation of metaverse-based educational platforms.
Utilizing augmented reality (AR), virtual reality (VR), and mixed reality (MR), these frameworks
strive to create dynamic and captivating learning environments that transcend geographical
limitations. Studies and examples illustrate their utilization across disciplines, spanning from science
and mathematics to humanities and vocational training. The paper underscores the significance of
artificial intelligence (AI) and machine learning (ML) algorithms in tailoring educational content to
individual learning styles, thereby enhancing personalization and adaptability within metaverse-
based educational systems. Looking ahead, the paper outlines potential developments in metaverse
education, exploring emerging technologies and trends such as blockchain -based credentialing,
haptic feedback integration, and the incorporation of the Internet of Things (IoT). The paper
acknowledges the diverse techniques contributing to its ongoing evolution, emphasizing the dynamic
nature of this transformative educational landscape.
Keywords: Metaverse, Education, Learning, Virtual reality, Augmented reality, E-learning,
Students, Artificial intelligence.
... Thinking about content creation and teaching and learning methodologies, one can mention the use of games as a possibility to establish new relationships with students, allowing them to connect with their context (Hare & Tang, 2023). Simulation is also a strong point in projecting the new in teaching and learning processes, enabling students to observe and interact directly (Siyaev & Jo, 2021). The approximation to reality in the use of these environments in education extends to different levels, from basic education to higher education and professional training. ...
... The use of VR and XR, combined with social networks, is highlighted as a way to create immersive and collaborative educational experiences (Wu, Zhang & Lee, 2023). The adoption of devices such as glasses and 3D simulators and machine learning techniques demonstrates an innovative approach to technology use, while the use of NSSE (Neuro-Symbolic Speech Executor) with neural networks, another identified resource, underscores the importance of natural interaction in virtual environments (Siyaev & Jo, 2021). ...
In an increasingly digital world, the metaverse emerges as a new horizon of possibilities, uniting the real and the virtual in an immersive and transformative experience. This work, “ IMMERSING IN THE METAVERSE: Theoretical and Practical Reflections,” brings together insights from researchers in different fields, providing a comprehensive view of this constantly evolving universe.
The book explores various facets of the metaverse, from its foundational technologies and innovative applications to its implications for society, the economy, and education. Through clear and accessible language, the authors invite the reader on a journey of discovery, exploring the challenges and opportunities that the metaverse presents.
... There are several studies that investigate planning [25] and scheduling problems [26] that can be included in topic 1 Development and Digitalization of the Operational Process for MRO Applications. Even research that concerns digitalization [24], Augmented Reality (AR) new maintenance manuals [28], Virtual Reality (VR) new training material [29], speech recognition to aid technicians [30], and even applications [31] and software development [32]. As for the second concept, the literature is full of novel ideas that help with the detection and inspection of the aircraft structure. ...
... A case study by Short (2013) highlighted a global company's savings of $1,000,000 in U.S. dollars over two years through the adoption of metaverse-based HRD interventions. Siyaev and Jo (2021) observed that delivering aircraft maintenance training for Boeing 737 airplanes via the metaverse proved to be a more cost-effective option for institutions than conventional training conducted on outdated aircraft models. Furthermore, Gavish et al. (2015) found in their experiments that VR-and AR-based training methods for industrial maintenance and assembly tasks delivered superior time efficiency compared to traditional training methods. ...
This study reviews the potential applications of the metaverse to various areas of human resource development (HRD) and reflects on the applications’ significance for employee and organizational development. Adopting a narrative review approach to this study, we selected and reviewed 34 cases. From our review, we found several findings that contributes to the HRD field in several ways. First, it draws the attention of HRD researchers and practitioners to a critical emerging trend that has been overlooked in the field. Second, it offers an analytical view of the metaverse in comparison to other training or learning technologies, assessing its effectiveness in employee development. Third, this study enhances the perspectives of HRD researchers and practitioners regarding this new technology by providing practical and theoretical insights into how metaverse-based interventions can reshape organizational culture and improve employee performance in the workplace. Lastly, it addresses compelling theoretical and practical questions related to HRD issues arising from the metaverse.
... Metaverse-based navigation systems offer tailored experiences that cater to individual preferences and enable informed decision-making to avoid congestion [109]. Advancements in AR navigation systems [110], aircraft metaverse [111], and real-time deep learning models [112] showcase the transformative potential of metaverse technologies in revolutionizing navigation across diverse domains. ...
Intelligent transportation systems (ITS) have made significant advancements in enhancing transportation safety, reliability, and efficiency. However, challenges persist in security, privacy, data management, and integration. Metaverse, an emerging technology enabling immersive and simulated experiences, presents promising solutions to overcome these challenges. By establishing secure communication channels, facilitating virtual simulations for safe testing and training, and enabling centralized data management with real-time analytics, metaverse offers a transformative approach to address these challenges. While metaverse has found extensive applications across industries, its potential in transportation remains largely untapped. This comprehensive review delves into the integration of the metaverse in ITS, exploring key technologies like virtual reality, digital twin, blockchain, and artificial intelligence, and their specific applications in the context of ITS. Real-world case studies, research projects, and initiatives are compiled to showcase the metaverse’s potential for ITS. It also examines the societal, economic, and technological implications of metaverse integration in ITS and highlights the associated integration challenges. Lastly, future research directions are identified to unlock the metaverse’s full potential in enhancing transportation systems.
... The literature already reports some efforts in this direction. For instance, Siyaev et al. [47] developed a simulator for training employees to carry out efficient maintenance of Boeing-737 aircraft through metaverses along with the 3D models of the aircraft. The simulator is evaluated in terms of the amount of technical guidance and directions provided to field experts. ...
Metaverse has evolved as one of the popular research agendas that let users learn, socialize, and collaborate in a networked three-dimensional (3D) immersive virtual world. Due to the rich multimedia streaming capability and immersive user experience with high-speed communication, the metaverse is an ideal model for education, training, and skill development tasks. To facilitate research in this area, we provide a comprehensive review of the various educational use cases and explore how enabling technologies such as Extended reality (XR) and the Internet of Everything (IoE) will play a major role in educational services in future metaverses. Secondly, we provide an overview of metaverse-based educational applications focusing on education, training, and skill development and analyze the technologies they are built upon. We identify common research problems and future research directions in the domain. The paper also identifies core ethical considerations of metaverse for education and potential pitfalls. We believe this survey can fully demonstrate the versatility of metaverse-driven education, which could serve as a potential guideline for the researchers.
... In manufacturing, the metaverse is expected to speed up production process design, motivate collaborative product development, improve condition control and fault detection, as well as obtain high transparency for producers and customers (Huynh-The et al., 2023). In addition, the metaverse can provide new possibilities for training (Mystakidis, 2022;Siyaev and Jo, 2021a). ...
... In manufacturing, the metaverse is expected to speed up production process design, motivate collaborative product development, improve condition control and fault detection, as well as obtain high transparency for producers and customers (Huynh-The et al., 2023). In addition, the metaverse can provide new possibilities for training (Mystakidis, 2022;Siyaev and Jo, 2021a). ...
... Electromechanical systems (ES) are an indispensable part of aircraft on-board equipment, as well as an equipment to ensure the normal, safe and stable flight of the aircraft, which is the core system of the aircraft [1]. The safety of ES directly affects the safety of the aircraft. ...
In recent years, Prognostics Health Management (PHM) technology has become an important reference technology in fields such as avionics and electromechanical systems due to its ability to reduce costs and achieve state based maintenance and autonomous support. However, with the operation of large and complex electromechanical systems (ES), the data generated gradually ages the status of components, and traditional PHM technology is difficult to solve the problem of electromechanical system components becoming more complex. Based on this, this study takes the hydraulic actuator cylinder as an example to construct a local component fault detection model. Firstly, fault data features are extracted using wavelet packet energy spectrum, and then a fault detection model is constructed based on support vector machine (SVM). In response to the shortcomings of SVM, a smooth support vector machine (SSVM) is proposed to replace SVM, and an improved crow search algorithm (ICSA) is used to improve SVM. Finally, an intelligent detection model for hydraulic actuator cylinder faults based on ICSA-SSVM was constructed based on the above algorithms. The experimental results show that the ICSA-SSVM model has the fastest Rate of convergence, among which, the positioning accuracy is 0.96, the fitting degree is 0.984, the fault detection accuracy is 99.16 %, the recall value is 94.52 %, and the AUC value is 0.986, all of which are better than the existing fault detection models. From this, it can be seen that the precise local anomaly localization technology for large-scale complex electromechanical systems based on the ICSA-SSVM algorithm proposed in this study can improve the efficiency and accuracy of fault detection, achieve accurate and intelligent detection of ES local anomalies, and have certain positive significance for the development of China’s industry.
... Resource allocation influences training scalability through optimal AI-driven resource management [11] [12]. Successful integration of training AI into global industrial systems accelerates adaptation and boosts efficiency [13]. ...
