ArticlePDF Available

The Ethics of Artificial Intelligence and Robotization in Tourism and Hospitality - A Conceptual Framework and Research Agenda

Authors:

Abstract and Figures

The impacts that AI and robotics systems can and will have on our everyday lives are already making themselves manifest. However, there is a lack of research on the ethical impacts and means for amelioration regarding AI and robotics within tourism and hospitality. Given the importance of designing technologies that cross national boundaries, and given that the tourism and hospitality industry is fundamentally predicated on multicultural interactions, this is an area of research and application that requires particular attention. Specifically, tourism and hospitality have a range of context-unique stakeholders that need to be accounted for in the salient design of AI systems is to be achieved. This paper adopts a stakeholder approach to develop the conceptual framework to centralize human values in designing and deploying AI and robotics systems in tourism and hospitality. The conceptual framework includes several layers-'Human-human-AI' interaction level, direct and indirect stakeholders, and the macroenvironment. The ethical issues on each layer are outlined as well as some possible solutions to them. Additionally, the paper develops a research agenda on the topic.
Content may be subject to copyright.
Journal of Smart Tourism Vol. 1 No. 4 (2021) 9-18
2021 by Smart Tourism Research Center. All rights reserved
DOI: https://doi.org/10.52255/smarttourism.2021.1.4.3
*Corresponding author:
Stanislav Ivanov, Varna University of Management, Varna, Bulgaria
E-mail address: stanislav.ivanov@vumk.eu; info@zangador.institute
Received 18 October 2021; Received in revised form 20 December 2021; Accepted 22 December 2021
Conceptual Article
The Ethics of Artificial Intelligence and Robotization in Tourism and Hospitality
– A Conceptual Framework and Research Agenda
Stanislav Ivanova,b* and Steven Umbrelloc
a Varna University of Management, Varna, Bulgaria
b Zangador Research Institute, Varna, Bulgaria
c Department of Values, Technology, & Innovation, School of Technology, Policy & Management, Technical University Delft, Delft, The Netherlands
Abstract




  

    


Keywords

1. Introduction
       





         

         
         

          


       


      



 


      





          

       
       
     

      

       
        

       

 
       
        



          
      



Journal of Smart Tourism
      
Ivanov and Umbrello
Journal of Smart Tourism Vol. 1 No. 4 (2021) 9-18
10

  
a
b


         

  

   
 
         
  

       
          
       

      
       
     
     

         
        
        
  
       
       




         

         
       




         
      
 
 

  
          

  



2. Literature Review
2.1. AI and Robotics Ethics



AI
and Ethics  




          


           




Fig. 1. 
2.1.1 Privacy and Surveillance
      

           
          






2.1.2 Manipulation of Behavior
         


        

        
     

        
        
     

2.1.3 The Opacity of AI Systems



           
        
       
      

    
Ivanov and Umbrello
Journal of Smart Tourism Vol. 1 No. 4 (2021) 9-18
11
        
         
  


          


2.1.4 Autonomous Systems
      

       
       
       

         
         
        


 
       


  

        

2.1.5 Bias in Decision Systems
        
          


           

        
          

        
       


      


2.1.6 Human-Robot Interaction
 
      
         

       
         
       
        
       
       
       
       

         
       
       

2.1.7 Automation and Employment
       
         

 
   
       

per se
         


     

        

       






        
      

2.1.8 Other: Machine Ethics, Artificial Moral Agents, Singularity
   
        

        
         


        
          
  

       
        

         


        


      

        
       


2.2. AI and Robotics Ethics in Tourism and Hospitality
 
         
       
Ivanov and Umbrello
Journal of Smart Tourism Vol. 1 No. 4 (2021) 9-18
12



           

        
         

       
        
         

      


          
         
     


        
        


3. The Ethics of Artificial Intelligence and Robotization in
Tourism and Hospitality – A Conceptual Framework
       

        
      





        

          
          
  
         
         
       


     

Fig. 2.
3.1. Direct Stakeholders


        
        

       
Ivanov and Umbrello
Journal of Smart Tourism Vol. 1 No. 4 (2021) 9-18
13
 

 
 


         

     
      
        

Entirely human-delivered services

     
         

 AI in the back-of-house operations   
         



 AI in the front-of-house operations   
   
          

AI in both backfront-of-house operations

          
 
         


        
input
 
output
          


      algorithms   

       


        
        
 
        
     





3.1.1 Human Bias in Data Selection

         
        

  
 
         


          


3.1.2 Human Bias in Data Classification

        
        


    

       
 

3.1.3 Bias in Outputs
        
        

           
      
       
in situ






          
     
        


      
        

3.1.4 Technical and Contextual Biases

         
        
           




       



       Robots  
       
human-robot interaction

         

          

       
          


       
Ivanov and Umbrello
Journal of Smart Tourism Vol. 1 No. 4 (2021) 9-18
14


         
          
        
   
 
  
       


         


         
       
    privacy and surveillance 
       

 
   



      

    


             

        
      


        
        to
manipulate their behavior


  
 
         
        


       
         

substitution vs enhancement effect
        
       


        
         
        



         
 de facto       

  

     
          
   

          


 
         

usability

        
         

        
accessibility   whom
usability
  accessibility       
     

    


        

 Autonomy        


         
         
        
       

accessibility

 should       


        
        




          
       
 
          


       

       
       
          

3.2. Indirect Stakeholders
      
          
        
    

      

         
      

      
          

         
Ivanov and Umbrello
Journal of Smart Tourism Vol. 1 No. 4 (2021) 9-18
15

        

    respect for human autonomy
prevention of harm fairness  explicability  


     
      

        
        
          


 




       
          

 
  

 
 Henn na
Hotel         
          
       



           

        
 

        
        

 


       
          

        
         

         




        
        
        



 
per se     

       



       
          

        

3.3. Macroenvironment
       
  
        


 



 


        
 
       

        

        
       



      


        


         
  

4. Discussion and Conclusion
4.1 Implications

       

        
       for.  
     
 

       
    


          

 
 

   for      


         
      
       
          
   
      
Ivanov and Umbrello
Journal of Smart Tourism Vol. 1 No. 4 (2021) 9-18
16


    
       




         
           


 




         






       

       



        


        
         
        



        
  

 


4.2. Future Research Directions
      

      

     


       
        
        

4.2.1 Perceptions Towards the Ethical Issues
       


        

      
       
  

4.2.2 Perception Towards the Solutions to the Ethical Issues
         

 
        

      
       
     
          

4.2.3 Stakeholder Collaboration
 



 
 
          
         

4.2.4 Ethical AI and Robotization Outcomes
          

         
       

4.2.5 Artificial Moral Agents
       
        

 

        
        
         

        

Declaration of competing interests


Ivanov and Umbrello
Journal of Smart Tourism Vol. 1 No. 4 (2021) 9-18
17
ORCID iD
 
 
References
Sociometry
30

AI Magazine28

ROBONOMICS: The Journal of the Automated Economy2

Proceedings of the 29th AAAI Conference on Artificial Intelligence
     

 Our final invention: Artificial intelligence and the end of the
human era.
Paladyn,
Journal of Behavioral Robotics11

Minds and Machines30

The Service Industries Journal41
Superintelligence: Paths, dangers, strategies.

The Telegraph
      


      The second machine age: Work,
progress, and prosperity in a time of brilliant technologies.

        
 
Handbook of e-tourism

 Journal of Hospitality
and Tourism Technology10
         
International Journal of Social Robotics

 
Electronic Markets26
AI ethics.
          
Long Range Planning16
 Ethics and
Information Technology14
      Robot sex: Social and ethical
implications.

Journal of Macroeconomics49
    
   ROBONOMICS: The Journal of the Automated
Economy 1

    arXiv   


Journal of Evolutionary Economics23

 IEEE Technology
and Society Magazine40

     Science and Engineering Ethics
26
The technology trap: Capital, labor, and power in the age
of automation. 
       Value sensitive design: Shaping
technology with moral imagination
        ACM
Transactions on Information Systems14
    Rights for robots: Artificial intelligence, animal and
environmental law.
         
Annals of Tourism Research38
Robot rights
Ethics guidelines
for trustworthy AI. 
 

ISO 8373:2012(en)
Robots and robotic devices – Vocabulary

   
   
Information Technology and Tourism22
         
ROBONOMICS: The Journal of the Automated Economy,1
         
Technology in Society63
       Robots, artificial intelligence and
service automation in travel, tourism and hospitality.  

   
     
        
  Tourism Economics  

Justice and ethics in tourism  

       Tourism Review
75

        
Business Horizons 62

 AI
Ethics 
    The political economy of robots: Prospects for
prosperity and peace in the automated 21st century  



  
 European Journal of Tourism Research 25
        
     European Journal of
Information Systems
   
   The singularity is near. When humans transcend
biology. 
   Ethics for robots: How to design a moral algorithm

           
       
Journal of Hospitality Marketing  Management29


Artificial Intelligence175
Robot ethics: The ethical and
social implications of robotics.
         Robot ethics 2.0: From
autonomous cars to artificial intelligence.

       
    Journal of Retailing and
Consumer Services60
      The ethics of tourism: Critical and
applied perspectives
        Annals of
Tourism Research32
   The ethics of surveillance: An introduction. 

       
Futures,90
           
       
European Journal of Tourism Research20
          
          
Journal of Management Analytics
6

        
Proceedings of the 2020 International Conferences on Internet of Things
Ivanov and Umbrello
Journal of Smart Tourism Vol. 1 No. 4 (2021) 9-18
18
(iThings) and IEEE Green Computing and Communications (GreenCom)
and IEEE Cyber, Physical and Social Computing (CPSCom) and IEEE
Smart Data (SmartData) and IEEE Congress on Cybermatics
(Cybermatics)


Robots and robotics: principles, systems, and
industrial applications

  The Stanford Encyclopedia of Philosophy  
     



Robots, artificial intelligence and service
automation in travel, tourism and hospitality   

          
        
 European Journal of Tourism Research 26

Journal
of Smart Tourism1
          
      Journal of Global
Health 9
    Intersectional automations: robotics, AI,
algorithms, and Equity.

     European Journal of
Tourism Research 

       
Frontiers in Robotics and AI 8
 Artificial intelligence: A modern approach


           
Journal of Tourism Futures

 ROBONOMICS:
The Journal of the Automated Economy 2
  Forbes.

   
   
BBC
   
    Military robots and drones: A reference handbook

            
     IEEE Security
Privacy16
          
 ROBONOMICS: The Journal of the Automated Economy 2
           
Journal of
Hospitality and Tourism Insights2
Nudge: Improving decisions about health,
wealth and happiness
           
   International Journal of Contemporary
Hospitality Management30
            
       Annals of
Tourism Research 84
      
        
      Annals of Tourism
Research 81

Annals of Tourism Research 78
        
 HUMANA. MENTE Journal of Philosophical Studies 13

 
AI & SOCIETY
35

AI and Ethics1

 Information 12

        
    International Journal of Social
Robotics
Global code of ethics
for tourism.       


      Designing in
ethics
Autonomous vehicles. 


   ision-21. Interdisciplinary Science and
Engineering in the Era of Cyberspace: Proceedings of a symposium
sponsored by NASA Lewis Research Center and the Ohio Aerospace
Institute
         
ROBONOMICS: The Journal of the Automated Economy1

   
   ROBONOMICS: The Journal of the Automated
Economy,2
 Moral machines: Teaching robots right from
wrong.
ROBONOMICS:
The Journal of the Automated Economy1
           
Journal of Tourism Futures6
The age of surveillance capitalism. The fight for a human
future at the new frontier of power.
Author Biographies
Stanislav Ivanov       


         
European Journal of Tourism Research  
ROBONOMICS: The Journal of the Automated Economy
    
   
        Annals of
Tourism ResearchTourism Management, Technology in Society, 


Steven Umbrello        

          
      
        


... The problem in using AI applications focused on automating work and improving transactions is considered less acceptable in the tourism industry due to potential privacy issues causing negative psychological impressions as a result of reduced interpersonal interaction (Tussyadiah, 2020). Today, AI is used both by consumers and providers of tourism services (Tourism Organizations, DMOs, travel agencies, etc.) and everyone uses it to get the maximum benefit from new technologies (Ivanov & Umbrello, 2021). ...
... Grundner and Neuhofer (2021) assume that many tourist destinations would be operated by a combination of destination-operated and AI solutions, leading to a distracting experience environment and reduced authentic experiences. With that in mind, it is necessary to address the ethical issues adequately regarding AI usage in the tourism industry by involving relevant stakeholders in the development to decrease the resistance against them (Ivanov & Umbrello, 2021). The authors point out that it is necessary to pay attention both to direct and indirect stakeholders, referring to those who are under the direct and indirect influence of the AI development in the tourism industry, such as tourism-related organizations (travel agencies, tourism organizations, DMOs), the local population, media, financial institutions, and many others, as they can influence the resolution of ethical issues when using AI in the industry. ...
... AI is utilized in various ways in space activities. For example, it is used in autonomous rovers, assistants and robots, intelligent navigation systems, satellite data processing, mission design and operation, mission strategy, locating space debris, and data collection (Adetunji, 2021;Ivanov & Umbrello, 2021). Research on AI-assisted space tourism has suggested seven requirements for successful space tourism: spacecraft, propulsion, guidance systems, technology for health and safety, physics, communication networks, orbital management frameworks, as well as detection devices (Duan 2020;Ramesh et al., 2021;Russo & Lax, 2022). ...
Article
Full-text available
Space tourism is a growing industry sector that faces challenges of cost, risk, environmental impact, and sustainability. However, few studies address space tourism in an Asian culture, particularly in the context of artificial intelligence (AI), which is an increasingly significant topic both in the tourism sector and in society overall. To address the research gap, this work establishes an analytical framework which contrasts three varieties of space tourism using partial least squares, multi-group analysis, and fuzzy-set Qualitative Comparative Analysis. It surveyed 1,000 prospective space travelers from South Korean who are eager to take part in space tourism to examine AI's role in enhancing sustainable space tourism. Findings indicate that recognizing AI benefits are crucial for sustainable on-Earth, sub-orbital, and orbital space tourism, particularly the latter. The study offers both conceptual and applied knowledge to enhance the sustainability of space tourism.
... They pointed out that AI was a disruptor with transformative potential in marketing Additionally, future research can delve into ChatGPT's capabilities in helping (tourism/hospitality) companies develop their strategies in other functional areas beyond marketing, e.g. operations management, HRM, and finance. Finally, a critical future research path is the ethical issues concerning the implementation of AI. Ivanov and Umbrello (2021) emphasise that AI technologies present significant ethical concerns in tourism and hospitality, including privacy and surveillance, decision-making biases, and behaviour manipulation, among other considerations. With technological advances, moral issues are becoming increasingly important, especially the misuse of generative AI for spreading misinformation, false information about competitors and destinations, and online scams. ...
Article
Full-text available
This paper verifies the capacity of generative AI (ChatGPT in particular) to design a marketing strategy for a hotel by using the example of a 5-star property in the centre of Lisbon. The indicative solutions and reflexive tactics suggested by Dwivedi et al. (2023) were used to develop the prompts based on which ChatGPT designed the hotel's marketing strategy. The proposed approach incorporates the marketing mix elements, including digital marketing tips, the competitive set definition, a name for a marketing campaign, a logo, identification of an appropriate partner and suggested cross-selling actions. This is one of the first attempts to utilise generative AI to design a marketing strategy for a product/service. The findings of this research verify the previous assumption that ChatGPT can write it!
... However, relevant research in this area is limited. Among the few pertinent studies, Ivanov & Umbrello (2021) explored the use of artificial intelligence and robotic systems in tourism by developing a research agenda on the subject. Along similar lines, Chi et al. (2020) or Loureiro et al. (2020) conducted systematic reviews of the literature on artificial intelligence and proposed a future research agenda. ...
Article
Full-text available
Recent technological advances, particularly in biometrics, have significantly impacted the tourism industry. Amidst the COVID-19 pandemic, these technologies have grown rapidly, posing challenges and opportunities in utilizing the resulting data. This study aims to develop a research agenda concerning biometrics in tourism consumer behavior, detailing what biometric data entails and outlining its diverse applications. Through a bibliographic review of 422 recent papers, employing machine learning and artificial intelligence techniques, we extracted keywords, topics, and frequencies using the methodological approach of corpus linguistics and latent Dirichlet allocation algorithm. The results identified 26 topics, including “KPIs”,” Techniques”, “Personalization”, “Health”, and “Travel and transport”. Furthermore, we observed that the COVID-19 pandemic has dramatically impacted the tourism sector, with “Health” present in four categories. The practical implications of our study suggest that companies can find the issues that most concern the tourism consumer in the lines of research presented in the research agenda, paying particular attention to the lines developed in the research agenda involving “personalization”, "travel and transport" and "health".
Article
Full-text available
This paper examines ChatGPT's use of evaluative language and engagement strategies while addressing information-seeking queries. It assesses the chatbot's role as a virtual teaching assistant (VTA) across various educational settings. By employing Appraisal theory, the analysis contrasts responses generated by ChatGPT and those added by humans, focusing on the in-teractants' attitude, deployment of interpersonal metaphors and evaluations of entities, revealing their views on Australian cultural practice. Two datasets were analysed: the first sample (15,909 words) was retrieved from the subreddit r/AskAnAustralian and the second (10,696 words) was obtained by prompting ChatGPT with the same questions. The findings show that, while human experts mainly opt for subjective explicit formulations to express personal viewpoints, the chat-bot's preference goes out to incongruent 'it is'-constructions to share pre-programmed perspectives , which may reflect ideological bias. Even though ChatGPT displays promising socio-communicative capabilities (SCs), its lack of contextual awareness, required to function cross-culturally as a VTA, may lead to considerable ethical issues. The study's novel contribution lies in the in-depth investigation of how the chatbot's SCs and lexicogrammatical selections may impact its role as a VTA, highlighting the need to develop students' critical digital literacy skills while using AI learning tools.
Chapter
Management is an art of getting things done through and with the people in formally organized groups. It is an art of creating an environment in which people can perform and individuals and can co-operate towards attainment of group goals. Management Study HQ describes Management as a set of principles relating to the functions of planning, directing and controlling, and the application of these principles in harnessing physical, financial, human and informational resources efficiently and effectively to achieve organizational goals. A good management is the backbone of all successful organizations. And to assist business and non-business organizations in their quest for excellence, growth and contribution to the economy and society, Management Book Series covers research knowledge that exists in the world in various management sectors of business through peer review chapters. This book series helps company leaders and key decision-makers to have a clear, impartial, and data-driven perspective of how factors will impact the economy moving forward and to know what they should be doing in response.
Article
Full-text available
As pricing in hospitality and tourism evolves due to the opportunities presented by artificial intelligence (AI), so do the concerns that come with technological advancements. There is a fine line between what is possible, what is profitable, and what is ethical, sustainable and responsible in the use of AI for pricing. This viewpoint article draws attention to the dark side of pricing, and presents a framework towards sustainable pricing, against the backdrop of the current European Union legal framework. The framework includes ethical guidelines, self-regulation, self-protection and technological regulation, which should be considered as a whole.
Chapter
Artificial intelligence (AI) is reshaping the tourism industry, offering unprecedented opportunities for innovation. With a diverse range of applications including machine learning, natural language processing, and computer vision, AI is revolutionizing travelers’ experiences, operational optimization, and the trajectory of travel. Personalization is a key facet, with AI algorithms analysing user preferences, travel history, and online behavior to offer tailored recommendations that go beyond generic suggestions. Chatbots and virtual assistants, operational 24/7, elevate customer service by handling routine and complex inquiries, freeing human staff for more intricate interactions. Predictive maintenance systems, which employ AI algorithms, can help make the tourism sector safer with the continuous analyses of equipment data, sensor readings, and historical performance, preventing potential failures and enhancing reliability. As AI technologies advance, their integration into the tourism industry promises more personalized, efficient, safe, and enjoyable travel experiences, catering to individual preferences and needs. The transformation brought about by AI in tourism is both comprehensive and promising, shaping the future of travel.
Chapter
Full-text available
There is scarcity of studies that discuss AI and big data analytics in enhancing responsible tourism. Hence, the present chapter fills this void in scholarly works regarding the AI and big data analytics as it relates to responsible travel behavior. The objective of this chapter is to investigate the growing role of AI and big data in the context of responsible tourism practices, prospects and challenges in India. Furthermore, the chapter offers comprehensive analysis of the ramifications of AI and big data on responsible travel behavior. The study's novelty resides in its examination of AI and big data within the context of responsible tourism, an area that has been relatively neglected in the current body of literature.
Thesis
امروزه تکنولوژی با سرعتی سرسامآور در حال پیشرفت است. انقلاب فناوری، از گذشته تا کنون، موجب بروز تحولاتی برجسته در گردشگری و میهمان نوازی شده است. یکی از این فناوری ها، هوش مصنوعی است که در ابتدا به عنوان یک مفهوم نظری بلندپروازانه در علوم کامپیوتر مطرح شد؛ اما اکنون به عنوان یکی از مهم ترین نوآوری های دوران معاصر، در بر گیرنده گستره وسیعی از ابزارها و کارکردهای مختلف در تمام ابعاد زندگی بشری است. گردشگری نیز به عنوان صنعتی با آثار اقتصادی قابل توجه، از این قاعده مستثنی نیست. با وجود پذیرش و به کار گیری هوش مصنوعی در صنعت گردشگری برای پیش بینی تقاضا و کمک به گردشگران در انتخاب مقاصد و محصولات دلخواه خود، انتظار می رود در آینده سامانه های کنونی همراه با سایر ابزارهای هوش مصنوعی نقشی قابل توجه تر در گردشگری ایفا کند. بنابراین در این پژوهش تلاش شده است تا با به کار گیری تکنیک های متن کاوی کاربردهای در حال ظهور هوش مصنوعی در صنعت گردشگری شناسایی شود. در این مطالعه از روش شناسی علم داده استفاده شده است. در ابتدا مقالات پژوهشی مرتبط با هوش مصنوعی و گردشگری که در اسکوپوس و وب او ساینس، تا انتهای مارس ۲۰۲۳ نمایه شدهاند، جمع آوری شد و سپس با استفاده از رویکرد تخصیص پنهان دیریکله مورد متن کاوی قرار گرفت. بر اساس نتایج حاصل شده ۴ موضوع کلی کاربردهای در حال ظهور هوش مصنوعی در صنعت گردشگری شناسایی شد. اولین موضوع به کاربرد ربات ها و چتبات ها در گردشگری اشاره دارد. موضوع دوم بر کاربرد سامانه های هوشمند تحلیلگر و تسهیل گر در این صنعت تمرکز دارد. سومین موضوع بر کاربرد سیستم های توصیه گر در گردشگری متمرکز است و چهارمین موضوع کاربرد سامانه های پیش بینی در این صنعت را در بر می گیرد.
Article
Full-text available
In the high competition of the hospitality and service industry, hotels are in the process of intensely managing their employees’ behaviour and emotions, and this can have a detrimental impact on frontline employees’ work attitudes, job performance, and behaviour within the organization. In Thailand, there are still pressing questions regarding these issues. The objectives of this study were to examine the relationships among emotional labour, burnout, job satisfaction, turnover intention, and organizational commitment, and to compare the moderating roles of the employee’s age and manager emotional intelligence affecting emotional labour concerning the job satisfaction and burnout of hotel frontline employees in Thailand. A total of 509 subjects were investigated. With the structural equation modelling (SEM) and multiple group analysis technique used in this study, the positive and negative significant effects of emotional labour concerning job and organizational outcomes, and the moderating roles of age and manager emotional intelligence, were determined. The managerial implications from the results of the study can have beneficial outcomes for the hospitality and service industry, particularly regarding the human resource management process in terms of dealing and custom treat with employees’ emotional labour.
Article
Full-text available
This study investigates factors influencing the customers’ decision to use self-service kiosks in quick service restaurants. A model incorporating Technology Acceptance Model and Satisfaction Model was developed to examine the relationships among trust, self-efficacy, perceived ease of use, perceived usefulness, perceived enjoyment, perceived value, satisfaction and behavioural intention toward using these kiosks. The moderating impact of age, gender and past self-service kiosks experience was also examined. An online survey that measured customer perceptions and evaluations of self-service kiosks in McDonald’s garnered 415 responses. Data were analysed using structural equation modelling and multiple regression analyses. Recommendations address the importance of clear, accessible information about kiosk operation; visible security measures; and enhanced features such as menu item nutrient profiles and promotions. These findings and recommendations can be used to promote self-service kiosk usage, thereby addressing the COVID-19 induced prohibitions against direct service in restaurants.
Article
Full-text available
This paper seeks to answer the question of ‘whether automation and/or authenticity should be a priority in service industries’. Furthermore, it develops a framework explaining the decision process of authentic vs automated services for the service industries. The framework includes three stages (evaluating critical factors, determining the pros and cons of each service design, and final decision of service type). It starts with assessing critical factors such as service industry type, service provider type, consumers’ profiles, expectations, and desires, the task type (the suitability of tasks with automation/authenticity), types of provided products or services, types of available automation technologies, and the resources of service providers (e.g., financial, physical, human). In the final stage of the proposed framework, service providers can be ready to decide the service type (fully automated, a certain degree of automation/authenticity, fully authentic) that best fit them. Since no study in this context is found in the extant literature, this paper will contribute to the literature in terms of playing a guidance role for service industry practitioners and can be a reference that opens a scholarly debate on the subject.
Article
Full-text available
Organisations and companies need practical tools and guidelines to kick-off the implementation of Trustworthy Artificial Intelligence (TAI) systems. AI development companies are still in the beginning of this process or have not even started yet. The findings of this article address to decrease the entry level barrier for AI ethics implementation by introducing the Trustworthy Artificial Intelligence Implementation (TAII) Framework. The outcome is comparatively unique given that it considers a meta perspective of implementing TAI within organisations. As such, this research aims to fill a literature gap for management guidance to tackle trustworthy AI implementation while considering ethical dependencies within the company. The TAII Framework takes a holistic approach to identify the systemic relationships of ethics for the company ecosystem and considers corporate values, business models, and common good aspects like the Sustainable Development Goals and the Universal Declaration of Human Rights. The TAII Framework creates guidance to initiate the implementation of AI ethics in organisations without requiring a deep background in philosophy and considers the social impacts outside of a software and data engineering setting. Depending on the legal regulation or area of application, the TAII Framework can be adapted and used with different regulations and ethical principles.
Article
Full-text available
This paper reviews the economic literature about the effects of the digital revolution on the labour market, and provides a non-technical introduction to the labour economics of automation. It conceptualizes the digital revolution and describes how recent technological trends, such as robotics, industry 4.0, artificial intelligence and the platform economy, affect specific occupations. It reviews the main economic theories and the empirical evidence of how automation affects labour demand, the occupational structure and the work task composition of occupations. It discusses the consequences of this occupational change for labour market outcomes such as wages, inequality, job quality and unemployment. The paper concludes with a discussion of the main avenues for further research.
Article
Full-text available
As firms are moving towards data-driven decision making, they are facing an emerging problem, namely, algorithmic bias. Accordingly, algorithmic systems can yield socially-biased outcomes, thereby compounding inequalities in the workplace and in society. This paper reviews, summarises, and synthesises the current literature related to algorithmic bias and makes recommendations for future information systems research. Our literature analysis shows that most studies have conceptually discussed the ethical, legal, and design implications of algorithmic bias, whereas only a limited number have empirically examined them. Moreover, the mechanisms through which technology-driven biases translate into decisions and behaviours have been largely overlooked. Based on the reviewed papers and drawing on theories such as the stimulus-organism-response theory and organisational justice theory, we identify and explicate eight important theoretical concepts and develop a research model depicting the relations between those concepts. The model proposes that algorithmic bias can affect fairness perceptions and technology-related behaviours such as machine-generated recommendation acceptance, algorithm appreciation, and system adoption. The model also proposes that contextual dimensions (i.e., individual, task, technology, organisational, and environmental) can influence the perceptual and behavioural manifestations of algorithmic bias. These propositions highlight the significant gap in the literature and provide a roadmap for future studies.
Article
Full-text available
Operating at a large scale and impacting large groups of people, automated systems can make consequential and sometimes contestable decisions. Automated decisions can impact a range of phenomena, from credit scores to insurance payouts to health evaluations. These forms of automation can become problematic when they place certain groups or people at a systematic disadvantage. These are cases of discrimination—which is legally defined as the unfair or unequal treatment of an individual (or group) based on certain protected characteristics (also known as protected attributes) such as income, education, gender, or ethnicity. When the unfair treatment is caused by automated decisions, usually taken by intelligent agents or other AI-based systems, the topic of digital discrimination arises. Digital discrimination is prevalent in a diverse range of fields, such as in risk assessment systems for policing and credit scores [1] , [2] .
Article
Full-text available
Autonomous weapons systems (AWS), sometimes referred to as “killer robots”, are receiving ever more attention, both in public discourse as well as by scholars and policymakers. Much of this interest is connected to emerging ethical and legal problems linked to increasing autonomy in weapons systems, but there is a general underappreciation for the ways in which existing law might impact on these new technologies. In this paper, we argue that as AWS become more sophisticated and increasingly more capable than flesh-and-blood soldiers, it will increasingly be the case that such soldiers are “in the power” of those AWS which fight against them. This implies that such soldiers ought to be considered hors de combat, and not targeted. In arguing for this point, we draw out a broader conclusion regarding hors de combat status, namely that it must be viewed contextually, with close reference to the capabilities of combatants on both sides of any discreet engagement. Given this point, and the fact that AWS may come in many shapes and sizes, and can be made for many different missions ,we argue that each particular AWS will likely need its own standard for when enemy soldiers are deemed hors de combat. We conclude by examining how these nuanced views of hors de combat status might impact on meaningful human control of AWS.
Article
Full-text available
One of the primary, if not most critical, difficulties in the design and implementation of autonomous systems is the black-boxed nature of the decision-making structures and logical pathways. How human values are embodied and actualised in situ may ultimately prove to be harmful if not outright recalcitrant. For this reason, the values of stakeholders become of particular significance given the risks posed by opaque structures of intelligent agents. This paper explores how decision matrix algorithms, via the belief-desire-intention model for autonomous vehicles, can be designed to minimize the risks of opaque architectures. Primarily through an explicit orientation towards designing for the values of explainability and verifiability. In doing so, this research adopts the Value Sensitive Design (VSD) approach as a principled framework for the incorporation of such values within design. VSD is recognized as a potential starting point that offers a systematic way for engineering teams to formally incorporate existing technical solutions within ethical design, while simultaneously remaining pliable to emerging issues and needs. It is concluded that the VSD methodology offers at least a strong enough foundation from which designers can begin to anticipate design needs and formulate salient design flows that can be adapted to the changing ethical landscapes required for utilisation in autonomous vehicles.
Book
This book provides an insightful introduction to the most important field of military innovation for the 21st century—robotic and drone weaponry. For centuries, warring nations have sought to lower the risk to highly vulnerable humans on the battlefield, typically by providing protective armor, making soldiers' positions more difficult to detect, or by striking from locations safe from retaliation. Autonomous weaponry has now reached the point where robotic systems can perform some key tasks that previously required direct human involvement. Military Robots and Drones: A Reference Handbook introduces the lay person to a highly specialized topic, providing the foundation necessary for further study in this field. Appropriate for high school and college-level students, as well as general readers with an interest in the topic, the author explains the many military applications of robotics as well as current limitations and disadvantages. The book also provides a general history of robotic warfare; examines key individuals, agencies, documents, and models; discusses controversies within the field of robotic and drone warfare, such as ethical considerations; and explains how increased reliance on robotics has affected the structure and strategy of the military.