Conference PaperPDF Available

The effects of Gamification on engineering lab activities

Authors:

Abstract and Figures

The aim of this study was to explore the effects of gamification on engineering lab activities by providing empirical evidence of the effect of gamification on students working in an engineering lab. Although gamification has been applied in several contexts including business, marketing, corporate management, and online communities and social networks, little research has been conducted on the application of gamification to engineering lab activities, nor is there empirical evidence to support the effectiveness of gamification at motivating and engaging students. For this study, two types of websites were created to collect data from students who enrolled an undergraduate introduction to human factors course taught at The Pennsylvania State University in the fall of 2015 semester. The two types of websites were Gamification (GM) and Non-Gamification (NG). While the GM website included game elements such as a Badge System, Score, Avatar, Leaderboard, Level, and Feedback (Notification), the NG website was a traditional website without game elements. In these websites, students could create their own multiple-choice questions (MCQs) and answer questions authored by classmates. The results suggest that the gamification of engineering lab activities had a positive effect in terms of motivation, engagement, and performance, indicated by the higher number of students who joined the GM website, the number of answers submitted by the GM group, the number of distinct days of participation, and the score of exam for the GM group. Thus, we can conclude that a positive effect of gamification on student learning in engineering lab activities was ultimately found.
Content may be subject to copyright.
The Effects of Gamication on Engineering Lab
Activities
  




 The aim of this study was to explore the effects of
gamication on engineering lab activities by providing empirical
evidence of the effect of gamication on students working in an
engineering lab. Although gamication has been applied in
several contexts including business, marketing, corporate
management, and online communities and social networks, little
research has been conducted on the application of gamication to
engineering lab activities, nor is there empirical evidence to
support the effectiveness of gamication at motivating and
engaging students. For this study, two types of websites were
created to collect data from students who enrolled an
undergraduate introduction to human factors course taught at
The Pennsylvania State University in the fall of  semester.
The two types of websites were Gamication (GM) and Non
Gamication (NG). While the GM website included game
elements such as a Badge System, Score, Avatar, Leaderboard,
Level, and Feedback (Notication), the NG website was a
traditional website without game elements. In these websites,
students could create their own multiple-choice questions
(MCQs) and answer questions authored by classmates. The
results suggest that the gamication of engineering lab activities
had a positive effect in terms of motivation, engagement, and
performance, indicated by the higher number of students who
joined the GM website, the number of answers submitted by the
GM group, the number of distinct days of participation, and the
score of exam for the GM group. Thus, we can conclude that a
positive effect of gamication on student learning in engineering
lab activities was ultimately found.
 
 
        


        
      

        
          
        
       
       

        
     
 
 
       
      
      
       
       
        

      
   
       
      
       
 
 
    
          
       
      

    
          

      
      
        

 
         
      
       
     
 
      
          
      

        
    
  

    
      

 
         
      
       

     
       
    
  
      
         
 
      
        
    
      
     
    
          
    
        
       
       
        
        
   
    
         
         


 
         

         


        
      
 
           
 
         
   
       
        
 
 





 
     


 












  

 
 
 
 

 
 
 
    
           
       
       
     
           
           
       
     
    
        
   

         
      
         


          
          
       
     
      

         
        

        
        
 
      
        
     
 

 

 
      

      

  
   
       
        

         
          
       
      
  
          
 
  



 
   
    
 
 


  
          
  
          
        


  

        
   
    
         
      
        
           
      
        
      
           
         
          

           
   
        
    
       


 
 
       
      
  
 


  
      
  
      
      
  
      
      
  
    


      
  
      
       
 
       
      
  


 

 
  

 
 
       
          
         
         

         
        
        


       
 
  
      
          
       
        
        
         
           
         

          
      
        

       
    
      
  







 
 
 








  
 
 









   
 
  






  

 
 
 

 

  
         
    

   
         

   

       
  
    
      
          

       

         

        
    
     
      
  
         
       
         
   
          
        
           
  


  
        
       
         
        
          
       
    
       
        
        
       
  
    
        
            

     
           


      
       
  
       
         
         
         
     
       
         
          
       
        

 


          
       
      

       
        
       


         
     
      
  
         
      
        
        
 
       
       
    
 
      
       
 
           
  
        
  
    
       
     

        
         

         
        

       
  
       

        
        
  
     
       
      
 
    
        
   
        
       
   
       
         
   
         
      
  
        
    
    
           
      

          
    
          
        
 
            
  

           
      
         
      

 
   
         

           
       
  
           
        
       

... Gamification is also a popular method in the literature to increase students' engagement and competencies. In [12], the effects of gamification on engineering lab activities were discussed. The work showed that students who were assigned gamified activities invested more time and effort in their work than their peers [12]. ...
... In [12], the effects of gamification on engineering lab activities were discussed. The work showed that students who were assigned gamified activities invested more time and effort in their work than their peers [12]. The authors of [13] proposed a "Capture the Flag" style competition to employ gamification in teaching undergraduate computer security labs. ...
Conference Paper
Full-text available
Education systems have been forced to adapt due to the restrictions led by COVID-19. Engineering laboratory classes were arguably the most affected by the changes in the educational model due to their practical nature. The lack of hands-on experience during the online mode of teaching has left a gap in the students’ social, teamwork, and troubleshooting skills. This regression has put a strain on faculty members to allow for a smooth transition to bring students back on track. This paper introduces an educational model to assist with managing engineering lab sessions, serving both faculty and students. The proposed model includes self-managing labs through assigning roles to students and the introduction of gamified lab activities. This model aims to enhance students’ engagement, and therefore, improves students’ competencies and facilitates their attainment of necessary practical skills. The model is implemented on a group of students from various years of study. Students were surveyed about their experiences and perception of the implemented model. It was shown that the majority of students perceived an increase in both their soft skills and hard skills and overall had a more engaging lab experience.
... Gamification is also another modern pedagogical technique that substantially improves student motivation. The use of game techniques and mechanics in student learning situations undoubtedly enhances their interest in addition to reinforcing their cognitive development [4]. Students should be able to play in the practice. ...
... This questionnaire can be repeated a certain number of times, so that at the end he has an assessment grade. It is important to highlight that the idea of gamification is not to create a game, but to take advantage of its characteristics to train the student [4]. In this sense, we intend that the student improves and perfects the results obtained in the laboratory at home with the simulation. ...
... This research was conducted in the telecommunication and air navigation department study class XA and XB aviation polytechnic of Surabaya with 49 answer sheets. Through item analysis, you can observe the characteristics of the items and improve the test quality (Kim et al., 2016). According to (Lange et al., 1967), item revisions will enable us to identify too difficult or too easy items that cannot distinguish There is meaningless interference between students who study content and students who have no content, or the question has pointless interference. ...
Article
Full-text available
Improved multiple-choice questions (MCQs) item analysis is fundamental to be used for further tests. Besides increasing item analysis can also be used to removes items that are trapped in a test. This journal focuses on the quality of the questions on the test. It explores the relationship between the difficulty index (p-value) and the discrimination index (DI) and the efficiency of the distractor (DE). The research will be conducted by 49 6th semester students currently studying Diploma, especially in air navigation engineering in education at Aviation Polytechnic of Surabaya. Fifty multiple-choice questions will be given while a final exam for the transmission media and antenna courses. The value of validity using the Pearson correlation with a significance level of 5% and reliability using Cronbach's Alpha. We find that the difficulty index (p) is 59% with an SD value of 10%, while the DI value is 30 % with an SD value 10% and DE with a value of 25% (SD 22%) has item items with average difficulty and discriminatory power related to functional impairments that must be integrated into the test later to improve the quality evaluation.
... On the other hand, feedback from the instructors only helps in enhancing students' cognitive skills (Fleischmann & Ariel, 2016;Thongmak, 2018;Kim et al., 2016). Unlike chat, feedback is one-way communication in which the students are less exposed to interaction and therefore the collaborative skills are minimized. ...
... Gamified elements are often incorporated into preexisting teaching strategies, such as simulations and quizzes, to increase student engagement and enjoyment [16]. In the past 10 years, there has been increasing use of gamified interventions across postsecondary education, including humanities, health professions, engineering, physical science, and social science disciplines [20][21][22][23][24]. ...
Article
Full-text available
The use of gamified learning interventions is expanding in postsecondary education as a means to improve students' motivation and learning outcomes. Virtual laboratory simulations have been used in science education to supplement student learning, as well as increase engagement with course material. Due to COVID-19, many instructors sought to replace or supplement hands-on "wet-lab" work in an online environment. In this paper, we explored how the use of head-mounted display technology in two laboratory simulations impacts learner motivation and learning outcomes. We used a mixed-methods approach to analyze the experience of thirty-nine undergraduate participants, examining test scores pre- and post-simulation, qualitative feedback, and quantitative experience ratings. The head-mounted display technology was described as easy to use, with eye strain identified as a common occurrence. Participants had increased test scores following the laboratory simulations, with no significant difference between simulation groups. Very positive self-reported measures of motivation and learner engagement were documented. Ninety-one percent of participants agreed that virtual reality laboratory simulation would be a good supplement to regular teaching modalities. Overall, our results suggest that immersive virtual reality laboratory simulations experienced through head-mounted display technology can be used to enhance learning outcomes and increase learner motivation.
Article
Gamification has been used in education since the early 2010s, however, the empirical studies on the effectiveness of gamification have yielded inconsistent results. Without a clear understanding of how gamification works, and which gamification design elements have a higher potential to influence learning outcomes, gamification intervention may not achieve the desired results. This study aimed to examine the factors that contributed to the successful implementation of gamification in higher education, and to identify the design elements that had most influence on student learning outcomes. Data was collected from the empirical studies conducted between 2014 and 2023. Data analysis was conducted using logistic regression and Chi-Square tests. Two gamification design elements, Social Interaction and Leaderboards, were found to have significant influence on student learning outcomes. This study provided insights for college instructors and instructional designers in the design of gamification intervention in instruction. Implications for practice and future studies were presented.
Article
Full-text available
In engineering courses with a large number of students, fail and dropout rates are usually high even in courses that can be expected to be interesting to the students. Gamification tools have arisen as an interesting way to motivate the students for a real continuous assessment, increasing the student’s attendance and performance. In this paper, a gamification approach based on a Kahoot tool, Moodle activities, and commemorative badges is proposed within a manufacturing course. The designed activities let the students compete among themselves to get the maximum number of points, which will be converted into extra grades that are added to the final exam grade. The gamification experience has been proven to be highly positive according to students’ and instructors’ perceptions, and the average increase of pass rate and course attendance with respect to previous years have increased from 22% to 34% and from 38% to 66%, respectively.
Article
Defined as the utilization of game elements in nongame environments, gamification has been frequently used in education in recent years. The aim of the present study is to summarize the studies previously conducted on the use of gamification in education through a systematic literature review. When the studies conducted in 2000–2021 were examined, four main dimensions came to the fore: (i) the aim of gamification studies, (ii) the learning fields where gamification studies were carried out, (iii) the level of education at which gamification studies were carried out, and (iv) how gamification was integrated into the learning environment. The results showed that gamification is used for various educational purposes, at many learning levels in various environments, and in a wide variety of learning fields. In most of the studies, the positive effects of gamification and its potential to solve problems in education were reported.
Article
Full-text available
Gamification has drawn the attention of academics, practitioners and business professionals in domains as diverse as education, information studies, human-computer interaction, and health. As yet, the term remains mired in diverse meanings and contradictory uses, while the concept faces division on its academic worth, underdeveloped theoretical foundations, and a dearth of standardized guidelines for application. Despite widespread commentary on its merits and shortcomings, little empirical work has sought to validate gamification as a meaningful concept and provide evidence of its effectiveness as a tool for motivating and engaging users in non-entertainment contexts. Moreover, no work to date has surveyed gamification as a field of study from a human-computer studies perspective. In this paper, we present a systematic survey on the use of gamification in published theoretical reviews and research papers involving interactive systems and human participants. We outline current theoretical understandings of gamification and draw comparisons to related approaches, including alternate reality games (ARGs), games with a purpose (GWAPs), and gameful design. We present a multidisciplinary review of gamification in action, focusing on empirical findings related to purpose and context, design of systems, approaches and techniques, and user impact. Findings from the survey show that a standard conceptualization of gamification is emerging against a growing backdrop of empirical participants-based research. However, definitional subjectivity, diverse or unstated theoretical foundations, incongruities among empirical findings, and inadequate experimental design remain matters of concern. We discuss how gamification may to be more usefully presented as a subset of a larger effort to improve the user experience of interactive systems through gameful design. We end by suggesting points of departure for continued empirical investigations of gamified practice and its effects.
Article
PeerWise is a web-based system that supports the creation of student-generated test banks of multiple choice questions. Students contribute question stems and answers, provide explanations, answer questions contributed by other students, rate questions for difficulty and quality, and participate in on-line discussions of all these activities. In 2007, the system was used in four computing classes that varied in level, instructors, and student reward. We present results that show common patterns of response from students, and outline some initial investigations into the impact of the system on student performance. Our main findings are: external motivators are needed only for question generation; exam performance is correlated with participation in on-line discussions; and, despite student enthusiasm, drill-and-practice use does not contribute to exam success.
Conference Paper
Active learning has been shown to improve student learning outcomes while enabling students to be engaged in their learning process. One form of active learning that is growing in its application within engineering undergraduate classes is the use of game-based learning. This study utilized two class sections (control vs. experimental) to determine the impact that game-based learning could have on students' perceptions of the classroom environment and their engagement with class content. Utilizing the College and University Classroom Environment Inventory (CUCEI) and a selection of questions from the National Survey of Student Engagement (NSSE) the authors were able to assess whether game-based learning modified the way students viewed the Introduction to Chemical Product Design course. Preliminary results demonstrated that the game-based learning class rated the classroom environment higher on all seven dimensions. In particular, a statistically significant difference was achieved on the personalization dimension through use of a t-test and the non-parametric Mann Whitney test although this was no longer significant after accounting for multiple comparisons. In addition, students in the game-based learning class felt that they developed key professional skills such as oral communication, ability to work effectively with others and to solve complex or real world problems. These results are indicative that game-based learning is a pedagogy that can be applied within engineering and may lead to a more positive classroom environment and student experience.
Article
This paper explores the impacts of gamification on students' investigations in a reverse engineering activity. The activity, which occurs in the first month of a freshman design and communication cornerstone course, challenges students to develop an understanding of how design decisions are made and the trade-offs involved in realizing a work of engineering design. In the most recent iteration of the activity, we created a game whereby students were awarded achievement levels for (1) practicing safety, (2) developing an understanding of key design decisions (construed as Design for X [DfX]), and (3) making inferences for logical argumentation in discussion with instructors. Although the reverse engineering activity did not directly include significant rewards, we employed gamification to challenge students to achieve a broader set of tasks and to achieve these tasks in deeper and more nuanced ways. Our preliminary analysis of the gamification of the exercise investigates the teaching team experience, in particular the nature of their interactions with the students, the students' perception of the quality of the experience, and the students' results in the form of an oral presentation of their device teardown. This simple approach enhanced the students' collaboration, their ability to handle rebuttals and make solid arguments based on physical evidence, and their understanding of the significance of DfX.
Article
The way people have been learning and living is constantly evolving. Whereas, a couple of decades ago, society required a workforce dominated primarily by the ‘production-line’ paradigm, nowadays the balance has tipped towards the necessity of a work-force which is dynamic, innovative, creative, and able to deal with problems in the most efficient manner. These characteristics are most often inherent of ‘Gamers’ or that section of the work-force which society is harbouring. This chapter will explore some of the characteristics, which games are capable of extracting and extrapolate them to a learning continuum shifting from the individual to the more collaborative framework. Ultimately this chapter aims to show why a shift in the mentality needs to occur when it comes to education and learning, as we move forward in the same steps which games have successfully undertaken.
Book
Millions play Farmville, Scrabble, and countless other games, generating billions in sales each year. The careful and skillful construction of these games is built on decades of research into human motivation and psychology: A well-designed game goes right to the motivational heart of the human psyche. In For the Win, Kevin Werbach and Dan Hunter argue persuasively that game-makers need not be the only ones benefiting from game design. Werbach and Hunter, lawyers and World of Warcraft players, created the world's first course on gamification at the Wharton School. In their book, they reveal how game thinking--addressing problems like a game designer--can motivate employees and customers and create engaging experiences that can transform your business. For the Win reveals how a wide range of companies are successfully using game thinking. It also offers an explanation of when gamifying makes the most sense and a 6-step framework for using games for marketing, productivity enhancement, innovation, employee motivation, customer engagement, and more.
Article
This paper describes an experiment in which a single questionnaire was fielded in four different styles of presentation: Text Only, Decoratively Visual, Functionally Visual and Gamified. Respondents were randomly assigned to only one presentation version. To understand the effect of presentation style on survey experience and data quality, we compared response distributions, respondent behaviour (such as time to complete), and self-reports regarding the survey experience and level of engagement across the four experimental presentations. While the functionally visual and gamified treatments produced higher satisfaction scores from respondents, we found no real differences in respondent engagement measures. We also found few differences in response patterns.
Conference Paper
Badge-based achievement systems are being used increasingly to drive user participation and engagement across a variety of platforms and contexts. Despite positive anecdotal reports, there is currently little empirical evidence to support their efficacy in particular domains. With the recent rapid growth of tools for online learning, an interesting open question for educators is the extent to which badges can positively impact student participation. In this paper, we report on a large-scale (n > 1000) randomized, controlled experiment measuring the impact of incorporating a badge-based achievement system within an online learning tool. We discover a highly significant positive effect on the quantity of students' contributions, without a corresponding reduction in their quality, as well as on the period of time over which students engaged with the tool. Students enjoyed being able to earn badges, and indicated a strong preference for having them available in the user interface.