Figure 6 - available via license: Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International
Content may be subject to copyright.
a) Earthquake exhibit regularly used at the Science Center. b) Our matched Unfacilitated Exhibit Condition consisting of the same earthquake table set up used in the Intelligent Exhibit Condition, with the AI turned off to match the standard earthquake exhibit and the same materials used to minimize the variables.
Source publication
Background
Museum exhibits encourage exploration with physical materials typically with minimal signage or guidance. Ideally children get interactive support as they explore, but it is not always feasible to have knowledgeable staff regularly present. Technology-based interactive support can provide guidance to help learners achieve scientific unde...
Contexts in source publication
Context 1
... approach also controls for exhibit location as there is just one exhibit, sometimes with the interactive guidance turned on (Intelligent Science Exhibit) and sometimes turned off (Unfacilitated Exhibit). Figure 6a shows the earthquake exhibit at Carnegie Science Center where the study took place. Visitors control the shaking using the "Start" and "Stop" buttons. ...
Context 2
... build towers using the given materials and may shake them on the earthquake table to observe if their towers stay up or not. Similarly, our Unfacilitated Exhibit Condition (see, Figure 6b) consists of the same earthquake table set up we used in the Intelligent Exhibit Condition. On the touch screen, there are "Start" and "Stop" buttons. ...
Similar publications
Designing for and facilitating intergenerational group learning is an important objective of informal science institutions as most visitors in those settings engage with scientific thinking in the context of a group. New, deeply engaging, and interactive technologies such augmented reality (AR) have been shown to have positive outcomes in education...
Nowadays, the primary purpose of information representation is to supportusers in understanding complex phenomena. Avoiding the 'black hole between dataand knowledge" means research tools and methods that help people experience andbenefit from this data. Through the analysis of case studies, the contribution aims toprovide an overview of existing d...
Citations
... This AI-based technology encourages guided inquiry thinking processes through a predict, explain, observe, explain cycle. A gorilla character appears on a large display to guide students as they make predictions, observations and explain results in the physical environment (Yannier et al., 2016(Yannier et al., , 2021(Yannier et al., , 2022. Our design uses evidence-based principles from learning science (e.g., Clark & Mayer, 2016;Gibson & Gibson, 1955;Chi et al., 1989;White & Gunstone, 1992) and game design (e.g., Falloon, 2010) including contrasting cases, self-explanation, predict-observe-explain, and real-time (Gibson & Gibson, 1955) suggests use of aligned cases with minimal differences to help students notice information that they might otherwise overlook. ...
... Our previous research has demonstrated that having a mixed-reality system combining hands-on experience with interactive AI guidance and feedback in our Intelligent Science Stations improves children's learning significantly compared to a tightly matched screen-only version without the hands-on interaction (Yannier et al., 2015(Yannier et al., , 2016(Yannier et al., , 2021, as well as compared to hands-on exploration without the interactive AI layer (Yannier et al., 2020(Yannier et al., , 2022. ...
Adaptivity in advanced learning technologies offer the possibility to adapt to different student backgrounds, which is difficult to do in a traditional classroom setting. However, there are mixed results on the effectiveness of adaptivity based on different implementations and contexts. In this paper, we introduce AI adaptivity in the context of a new genre of Intelligent Science Stations that bring intelligent tutoring into the physical world. Intelligent Science Stations are mixed-reality systems that bridge the physical and virtual worlds to improve children’s inquiry-based STEM learning. Automated reactive guidance is made possible by a specialized AI computer vision algorithm, providing personalized interactive feedback to children as they experiment and make discoveries in their physical environment. We report on a randomized controlled experiment where we compare learning outcomes of children interacting with the Intelligent Science Station that has task-loop adaptivity incorporated, compared to another version that provides tasks randomly without adaptivity. Our results show that adaptivity using Bayesian Knowledge Tracing in the context of a mixed-reality system leads to better learning of scientific principles, without sacrificing enjoyment. These results demonstrate benefits of adaptivity in a mixed-reality setting to improve children’s science learning.
... In this tech-savvy generation, immersive learning has professed advantages that encourage embracing technologies like MR as a pedagogical tool in STEM education. Despite the fact that the MR technology learning design in different studies has shown very positive and encouraging results [131] [314], this study has mainly focused on the controller-free hand interaction, use of machine learning as self-guided learning using agents and implementation of kinesthetic learning approach. The fundamental contribution of this thesis is providing new directions of research in immersive learning technology using the real-time hand interaction approach for kinesthetic learning pedagogy and ML-agents for self-guided learning in immersive environments. ...
The recent surge in the adoption of new technologies and innovations in connectivity, interaction technology, and artificial realities can fundamentally change the digital world. eXtended Reality (XR), with its potential to bridge the virtual and real environments, creates new possibilities to develop more engaging and productive learning experiences. Evidence is emerging that this sophisticated technology offers new ways to improve the learning process for better student interaction and engagement. Recently, immersive technology has garnered much attention as an interactive technology that facilitates direct interaction with virtual objects in the real world. Furthermore, these virtual objects can be surrogates for real-world teaching resources, allowing for virtual labs. Thus XR could enable learning experiences that would not be possible in impoverished educational systems worldwide. Interestingly, concepts such as virtual hand interaction and techniques such as machine learning are still not widely investigated in immersive learning. Hand interaction technologies in virtual environments can support the kinesthetic learning pedagogical approach, and the need for its touchless interaction nature has increased exceptionally in the post-COVID world. By implementing and evaluating real-time hand interaction technology for kinesthetic learning and machine learning agents for self-guided learning, this research has addressed these underutilized technologies to demonstrate the efficiency of immersive learning. This thesis has explored different hand-tracking APIs and devices to integrate real-time hand interaction techniques. These hand interaction techniques and integrated machine learning agents using reinforcement learning are evaluated with different display devices to test compatibility. The proposed approach aims to provide self-guided, more productive, and interactive learning experiences. Further, this research has investigated ethics, privacy, and security issues in XR and covered the future of immersive learning in the Metaverse.
In educational research, there is the general trade-off that empirical evidence should be generalizable to be applicable across contexts; at the same time, empirical evidence should be as specific as possible to be localizable in subject-specific educational interventions to successfully transfer the empirical evidence to educational practice. This trade-off is further increased by the fact that the diverse instructional contexts, such as school or student characteristics constrain the applicability of empirical evidence. Several approaches have been proposed to address this issue, however, emphasized the different problems (i.e., localization, generalization, transferability) rather in an isolated manner. To this end, in this article, we introduce a synergistic approach, the LoGeT (localize, generalize, transfer) model, which systematically integrates co-design (localization strategies) and ManyClasses principles (generalization strategies) with co-constructive transfer activities, to generate empirical evidence that may be applicable in educational practice. To illustrate the LoGeT model, we present three long-term projects, covering different granularities and durations of educational interventions across different fields of education (teacher education, adaptive teaching, non-interactive teaching) that successfully applied the LoGeT approach. Finally, we outline further directions for future iterations of the LoGeT model. We hope that the LoGeT approach may be a stimulus to guide researchers as well as practitioners alike to design generalizable and evidence-based educational interventions that are rooted in localized instructional contexts.
In an era of swift societal changes and escalating consumerism, this paper presents an exploration of an innovative approach that integrates product marketing strategies, mixed reality (MR) technology, and affective neuroscience theories to actualize consumers’ existential dreams. MR, with its unique capacity to blend the virtual and real worlds, can enhance the consumer experience by creating immersive, personalized environments that resonate with consumers’ existential aspirations. Insights from affective neuroscience, specifically the brain’s processing of emotions, guide the development of emotionally engaging marketing strategies, which strengthen the connection between consumers, products, and brands. These integrated strategies not only present a novel blueprint for companies to deepen consumer engagement but also promise more fulfilling and meaningful consumer experiences. Moreover, this approach contributes to societal well-being and prosperity, marking a significant stride in the field of marketing.
