Content uploaded by Felix Carros
Author content
All content in this area was uploaded by Felix Carros on Oct 17, 2023
Content may be subject to copyright.
Content uploaded by Felix Carros
Author content
All content in this area was uploaded by Felix Carros on Oct 10, 2023
Content may be subject to copyright.
Felix Carros, Sabine Jockisch, Mehrbod Manavi, Volker Wulf (2023): Fears about Social Robots in
Nursing. 9th International Conference on Infrastructures in Healthcare, DOI:
10.48340/ihc2023_pd020
Fears about Social Robots in Nursing
Felix Carros1,3, Sabine Jockisch2, Mehrbod Manavi1, Volker Wulf1,3
1University of Siegen, 2Franziskaner-Hof Attendorn, 3Fraunhofer FIT
{felix.carros, mehrbod.manavi, volker.wulf}@uni-siegen.de;
sabine.jockisch@franziskaner-hof.de
Abstract. As the nursing sector’s shortcomings remain unchanged, social robots are
becoming increasingly relevant. While real-life encounters are uncommon, the media and
fiction continue to impact people’s perceptions of robots. Capabilities and shortcomings
are frequently exaggerated, producing a vision of automated technology that will replace
human labor. This article focuses on the topic of worries associated with robot use. Most
stakeholders are concerned about disenfranchisement and data protection. They create
uncertainties about how the introduction of robots will affect people’s lives and work
situations. This article compiles the concerns of various parties and advocates for the
transparent and participatory development of robots in nursing.
Introduction
Social robots are increasingly becoming relevant in the care sector. Many
research projects have been carried out in care homes (Aarskog et al. (2019);
Paluch and Müller (2022)) and in rehabilitation (Langer and Levy-Tzedek (2021);
Feingold-Polak and Levy-Tzedek (2021)) with different robots they could show
that the usage of such systems can be beneficial. The topic receives a lot of
attention, to our knowledge for two reasons, for one the situation in nursing
homes in Europe is not becoming better but worse, there is a lack of people
willing to work under the given conditions in nursing, and at the same time a
growing number of people in need of care. Robots are seen as one possible
solution to the workforce's shortcomings. Second, there is a movement towards a
higher degree of digital applications in nursing, but they are difficult to explain as
code cannot easily be explained in the media. Robots are often used as examples
2
of how the nursing sector increasingly uses digital assistance, even if they are not
as common as other digital artifacts such as tablets. In the media, it is often
portrayed as if the use of robots in nursing homes is on the verge of a significant
breakthrough. Rarely are the limitations of such a system pointed out adequately.
This leads to worries and fears among many actors in nursing homes about how
this could change their lives and work.
Context
The presented fears in this publication are not the result of one particular study,
they are a combined collection of previous work (see Carros et al. (2020);
Unbehaun et al. (2019); Carros et al. (2022a,b, 2023d)). Experiences gained while
working with robots in nursing homes for many years. The collections of fears
that we present here have been written, weighted, and evaluated by an
interdisciplinary team of authors who are practitioners and researchers. Our
research is grounded in practice based research (Schmidt (2018); Ogonowski et
al. (2018); Krüger et al. (2022)) and participatory design (Wagner (2018); Krüger
et al. (2022); Weber et al. (2023)). For seven years (2017-2023) we have been
using robots in nursing homes. We tested several robots and developed the
capabilities of the robots with a design case study methodology Wulf et al. (2011,
2015); Kotthaus et al. (2023). In the first years we focused on the robot Pepper in
nursing homes (Carros et al. (2020)) we later expanded this work to other robots
such as AIBO (Helm et al. (2022)), Android robots (Carros et al. (2022d); Hille et
al. (2023)) and worked together with other national and international research
projects that worked with robots in nursing settings (Carros et al. (2022c); Chang
et al. (2022)) and expanded our work to other disciplines like ethics Störzinger et
al. (2020); Haberland et al. (2022). We have done hundreds of interviews, spent
years with the robot in nursing homes, included citizens in our research (Carros et
al. (2022e)) and are writing this study with an interdisciplinary team of
practitioners and researchers.
Fears about Social Robots in Nursing Care
Over the years we have seen many positive reactions and emotions toward robots
and their application in the field. However, there are also more critical voices. The
topic of fears toward robotic systems in care is not completely new and we
already addressed parts of it in previous work (Carros (2019); Habscheid et al.
(2018)), others also did research on it, but with a quantitative approach while we
use qualitative data (Coco et al. (2018)). However, after several years we see a
need for an update to these, as the technology developed, and our experience has
3
grown. We predominantly focus on fears expressed by people working in the
field.
Fears of Residents
During discussions and interviews with residents of nursing home facilities and
the people caring for them, four recurring fears emerged:
Cost-Saving Measures: Robots could be used to replace humans to make care
homes more profitable instead of using them to assist human workers to enhance
the quality of care.
Monitoring of Residents: It is unclear what happens with the data that the robot
is recording. Bad actors might try to get access to this data.
Inhuman Interaction: Daily interactions become increasingly inhuman and are
mostly done by robots. Human workers minimize contact with the residents and
leave conversations and rehabilitation to the robots.
Loneliness: The replacement of human workers with robots could lead to less
human contact.
Three of the four fears are about care being dehumanized by the use of humanoid
robots. This clearly shows the importance of people and human warmth for the
residents and that this cannot be replaced.
Fears of People Working in Nursing
A somewhat different picture of fears emerged among care workers compared to
residents, but with a similar message at the core:
Work Replacement: The usage of robots could be intended as replacements for
human workers, similar to the situation in some industries where robots take over
the work of humans. Instead of being used to increase the quality of work.
Structuring Work: Robots are not as flexible as humans are, their abilities limit
their flexibility, and they can often not read a room and act accordingly or go
outside and search for someone who got lost. There is a fear that the structure that
a robot needs to work properly is going to influence the work flexibility of care
4
workers. They could be forced to amend to the needs of robots in order to work
together, limiting the flexibility of the workers and effectively creating a hierarchy
where workers have to cater to the needs of the robot.
Acceptance because of Resignation: Residents can feel helpless because they
need help for their daily life due to their help condition. There is a fear that they
accept the robot and its demands because they do not know what else to do or
because they feel too weak to say no.
Manipulation by Mimicking Human Behavior: The imitation of human
behavior that is sometimes shown in conversations by the robot when saying
things like "I’m also feeling good" or "Should we do sport together?" is
manipulating the capabilities of the robot. The robot does not feel and does not do
sport. By mimicking this, the robot gives the perception to do and feel these
things. This is done to create some kind of connectedness to the human interaction
partner, but this connection is not real and to some degree manipulation.
Being Responsible for Malicious Systems: Residents are using robots because
care workers say that it is safe to use them. Care workers lend trust to the robot. If
the robot is using the data to manipulate the residents, if it uses the data for
malicious practices, then there is a certain responsibility of care workers, because
they convinced the residents to use them. Without the care workers, there would
be no introduction of robots in care homes.
Monitoring of Nurses: Robots have cameras, microphones, and many other
sensors. These constantly collect data for the robot to work. They are needed for
the robot system, but they can also be used for other purposes. Management could
try to gain access to this data to control care workers. Another possibility is that
an algorithm is tracking the work of care workers and creating monitoring reports.
Wrongful Monitoring: If a robot creates monitoring reports about how long
workers need for specific work steps and where they are doing these. There is a
danger that this monitoring is naive and not aware of the complex work. If a care
worker takes longer with one task (e.g., bathing) it is possible that it is not because
the worker is slow but because the resident requires psychological assistance and
is having a breakdown while bathing, resulting in a longer conversation while
bathing.
Medical Profiles: Sound recordings and videos might be able to create medical
information. Cameras could detect if a person has problems with their back by
doing gait analysis. While this is a useful tool, this information could be
maliciously used against the workers and be transmitted to management or third
parties.
Psychological Profiles: Speech recognition and speech interactions could be used
to generate psychological profiles of the care workers. These profiles could be
given to management or be used by the robots to manipulate the care workers in
doing work that is favorable for the management or the robot.
5
The fears expressed here focus on disenfranchisement and data protection.
Incapacitation of one’s competence to manage one’s work and to be able to do
this independently without supervision and feedback to the home’s management.
A gloomy picture of robots is drawn here, which seems like an extended arm of
the management.
Fears of Relatives
Fears also arise among relatives of nursing home residents:
Changing Conversation Patterns: Conversations with robots are designed in
order to be pleasant and avoid negative emotions. This bears the risk that the
conversation patterns of residents change, as the robot will always simulate
interest, even if the conversation is repetitive. The robot will also not react to
aggressive or negative comments towards it. This could lead to a situation where
residents get used to talking to a robot and unlearn human conversation patterns.
Data Security: Data recorded by the robot, such as camera images or audio
recordings, could fall into the wrong hands. These data could be used against the
interest of the residents.
Human Replacement: Robots should not be the only interaction partner for
residents. It is important that humans take care of the residents.
The concerns are similar to the ones that residents and nurses expressed. Relatives
act mostly as advocates for the residents and have fewer personal concerns.
Discussion
The fears of the various players have similarities at their core. Topics such as data
protection and the disenfranchisement of human decision-makers are prevalent.
This contrasts with the image that is painted through fiction and media, where
robots are frequently depicted as powerful machines with various powers that
overshadow humans. While fiction is often an inspiration for technology
development Krings et al. (2023), it does not easily translate to the same results.
Often missing from these is an examination of the tasks of people working in the
field. Working with people in need of care is a complex profession that requires
specific training and certain talents, such as emphatic intelligence (Teófilo et al.
6
(2019); Digby et al. (2016)) and domain specific knowledge. Abilities that are
often underdeveloped in robotic systems (Pepito et al. (2020)).
We believe that it is important to know the fears of the different groups during
development and to respond to them appropriately. Participatory design of
software might be an answer to it, as well as long-term research, as other
researchers also point out (e.g., Tuisku et al. (2019); de Graaf et al. (2019)),
opinions about robots often change to a more realistic view that sees robots as
recreational instead of a replacement. Developers need to closely work with the
people affected by the technology, otherwise, the developed robots risk staying
unused. We further see a need to explain technology, its abilities, and its limits.
People working in the field do not have the time to understand each technical
detail, and there is a need for easy explanations, otherwise, there is a risk of not
being used because of not fully understanding the device. Lastly, we want to
address the topic of manipulation. Robots simulate emotions and do not feel.
Residents respond to the simulated emotions of the robot with real feelings. This
is a one-sided emotion exchange that is simulated by a robot displaying behaviors
that look like human emotions. There needs to be some degree of transparency,
reminding residents that the emotions of the robots are not real ones.
Limitations
In our studies and practical experience, the robot was utilized to activate residents
with recreational activities rather than functions that attempted to replace care
workers. If other activities, such as medicine decision-making, are delegated to
robots, people’s perceptions of them may shift. We also generally worked with
friendly-looking robots; anxieties may differ with other robots (for example, if the
robot is tall and muscular). Finally, our findings are not representative. Our results
are based on experiences in a few nursing homes and nursing institutions.
Acknowledgments
All those engaged deserve our gratitude. The knowledge of this publication was
created in a collaborative effort with many different actors. We are deeply
thankful for the given opportunity.
The presented work has partly received funding from the BMWK under grant
agreement no. 01MF22009A.
7
References
Aarskog, N. K., I. Hunskår, and F. Bruvik (2019): ‘Animal-Assisted interventions with dogs and
robotic animals for residents with dementia in nursing homes: a systematic review’. Physical &
Occupational therapy in geriatrics, vol. 37, no. 2, pp. 77–93.
Carros, F. (2019): ‘Roboter in der Pflege, ein Schreckgespenst?’. Mensch und Computer 2019-
Workshopband.
Carros, F., B. Bürvenich, R. Browne, Y. Matsumoto, G. Trovato, M. Manavi, K. Homma, T.
Ogawa, R. Wieching, and V. Wulf (2022d): ‘Not that Uncanny After All? An Ethnographic
Study on Android Robots Perception of Older Adults in Germany and Japan’. In: International
Conference on Social Robotics, (pp. 574-586). Cham: Springer Nature Switzerland.
Carros, F., H. Eilers, J. Langendorf, M. Gözler, R. Wieching, and J. Lüssem (2022a): ‘Roboter als
intelligente Assistenten in Betreuung und Pflege–Grenzen und Perspektiven im Praxiseinsatz’.
In: Künstliche Intelligenz im Gesundheitswesen: Entwicklungen, Beispiele und Perspektiven.
Springer, pp. 793–819.
Carros, F., J. Langendorf, D. Randall, R. Wieching, and V. Wulf (2022e): ‘Citizen Participation in
Social Robotics Research’. In: Meaningful Futures with Robots—Designing a New
Coexistence. Chapman and Hall/CRC, pp. 205–216.
Carros, F., J. Meurer, D. Löffler, D. Unbehaun, S. Matthies, I. Koch, R. Wieching, D. Randall, M.
Hassenzahl, and V. Wulf (2020): ‘Exploring Human-Robot Interaction with the Elderly:
Results from a Ten-Week Case Study in a Care Home’. In: Proceedings of the 2020 CHI
Conference on Human Factors in Computing Systems. New York, NY, USA, p. 1–12,
Association for Computing Machinery.
Carros, F., I. Schwaninger, A. Preussner, D. Randall, R. Wieching, G. Fitzpatrick, and V. Wulf
(2022b): ‘Care workers making use of robots: Results of a three-month study on human-robot
interaction within a care home’. In: Proceedings of the 2022 CHI Conference on Human
Factors in Computing Systems. pp. 1–15.
Carros, F., T. Störzinger, A. Wierling, A. Preussner, and P. Tolmie (2022c): ‘Ethical, Legal
Participatory Concerns in the Development of Human-Robot Interaction’. i-com, vol. 21, no. 2,
pp. 299–309.
Chang, Y.-H., F. Carros, M. Manavi, and M. Rathmann (2022): ‘How do Roboticists Imagine a
Robotised Future? A Case Study on a Japanese HRI Research Project’.
Coco, K., M. Kangasniemi, and T. Rantanen (2018): ‘Care personnel’s attitudes and fears toward
care robots in elderly care: a comparison of data from the care personnel in Finland and Japan’.
Journal of Nursing Scholarship, vol. 50, no. 6, pp. 634–644.
de Graaf, M. M., S. Ben Allouch, and J. A. Van Dijk (2019): ‘Why would I use this in my home?
A model of domestic social robot acceptance’. Human–Computer Interaction, vol. 34, no. 2,
pp. 115–173.
Digby, R., A. Williams, and S. Lee (2016): ‘Nurse empathy and the care of people with dementia’.
Australian Journal of Advanced Nursing, The, vol. 34, no. 1, pp. 52–59.
Feingold-Polak, R. and S. Levy-Tzedek (2021): ‘Personalized Human Robot Interaction in the
Unique Context of Rehabilitation’. In: Adjunct Proceedings of the 29th ACM Conference on
User Modeling, Adaptation and Personalization. New York, NY, USA, p. 126–127,
Association for Computing Machinery.
8
Haberland, B., K. Wendland, J. Loh, F. Carros, A. Wierling, and A. Preussner (2022): ‘Falling in
Love with a Machine—What Happens if the Only Affection a Person Gets is from Machines?’.
In: Meaningful Futures with Robots. Chapman and Hall/CRC, pp. 87–96.
Habscheid, S., C. Hrncal, J. Lüssem, R. Wieching, F. Carros, and V. Wulf (2018): ‘Robotics and
Emotions’. Nicole Shea & Emmanuel Kattan (Hg.), Europe now. Special Feature» Anxiety
Culture «. Council for European Studies at Columbia University, no. 19.
Helm, M., F. Carros, J. Schädler, and V. Wulf (2022): ‘Zoomorphic Robots and People with
Disabilities’. In: Proceedings of Mensch Und Computer 2022. New York, NY, USA, p. 431–
436, Association for Computing Machinery.
Hille, N., B. Bürvenich, F. Carros, M. Manavi, R. Wieching, Y. Matsumoto, and V. Wulf (2023):
‘The Effects of Android Robots Displaying Emotion on Humans: Interactions between Older
Adults and Android Robots’. arXiv preprint arXiv:2303.13624.
Kotthaus, C., N. Vitt, M. Krüger, V. Pipek, and V. Wulf (2023): ‘Negotiating Priorities on the
Shopfloor: A Design Case Study of Maintainers’ Practices’. Computer Supported Cooperative
Work (CSCW), vol. 32, no. 1, pp. 141–210.
Krings, K., N. S. Bohn, N. A. L. Hille, and T. Ludwig (2023): ‘“What If Everyone is Able to
Program?” – Exploring the Role of Software Development in Science Fiction’. In: Proceedings
of the 2023 CHI Conference on Human Factors in Computing Systems. New York, NY, USA,
Association for Computing Machinery.
Krüger, M., F. Carros, M. Ahmadi, D. d. C. Leal, M. Brandt, and V. Wulf (2022): ‘Understanding
Forestry Practices to Support Climate Adaption’. In: Adjunct Proceedings of the 2022 Nordic
Human-Computer Interaction Conference. New York, NY, USA, Association for Computing
Machinery.
Krüger, M., M. Gerbracht, N. Vitt, M. Kudic, M. Ahmadi, A. Boden, F. Offergeld, M. Stein, C.
Kotthaus, D. Unbehaun, et al. (2022): ‘Travelling Artefacts: Lessons Learned from
Interventions in a Regional Innovation Ecosystem’. In: Proceedings of 20th European
Conference on Computer-Supported Cooperative Work.
Langer, A. and S. Levy-Tzedek (2021): ‘Emerging Roles for Social Robots in Rehabilitation:
Current Directions’. J. Hum.-Robot Interact., vol. 10, no. 4.
Ogonowski, C., T. Jakobi, J. Hess, et al. (2018): ‘PRAXLABS: A Sustainable Framework for
User-Centered Information and Communication Technology Development-Cultivating
Research Experiences from Living Labs in the Home’. In: Wulf, Pipek et al.(Eds.): Socio-
Informatics: A Practice-Based Perspective on the Design and Use of IT Artifacts. Oxford
University Press, pp. 319–360.
Paluch, R. and C. Müller (2022): ‘" That’s Something for Children" An Ethnographic Study of
Attitudes and Practices of Care Attendants and Nursing Home Residents Towards Robotic
Pets’. Proceedings of the ACM on Human-Computer Interaction, vol. 6, no. GROUP, pp. 1–35.
Pepito, J. A., H. Ito, F. Betriana, T. Tanioka, and R. C. Locsin (2020): ‘Intelligent humanoid
robots expressing artificial humanlike empathy in nursing situations’. Nursing Philosophy, vol.
21, no. 4, pp. e12318.
Schmidt, K. (2018): ‘Practice and technology: on the conceptual foundations of practice-centered
computing’. In: Socio-informatics: A Practice-based Perspective on the Design and Use of IT
Artifacts. Oxford University Press, pp. 47–103.
9
Störzinger, T., F. Carros, A. Wierling, C. Misselhorn, and R. Wieching (2020): ‘Categorizing
Social Robots with Respect to Dimensions Relevant to Ethical, Social and Legal Implications’.
i-com, vol. 19, no. 1, pp. 47–57.
Teófilo, T. J. S., R. F. S. Veras, V. A. Silva, N. M. Cunha, J. d. S. Oliveira, and S. C. Vasconcelos
(2019): ‘Empathy in the nurse–patient relationship in geriatric care: An integrative review’.
Nursing ethics, vol. 26, no. 6, pp. 1585–1600.
Tuisku, O., S. Pekkarinen, L. Hennala, and H. Melkas (2019): ‘“Robots do not replace a nurse
with a beating heart” the publicity around a robotic innovation in elderly care’. Information
Technology & People, vol. 32, no. 1, pp. 47–67.
Unbehaun, D., K. Aal, F. Carros, R. Wieching, and V. Wulf (2019): ‘Creative and cognitive
activities in social assistive robots and older adults: Results from an exploratory field study
with Pepper’.
Wagner, I. (2018): ‘Critical reflections on participation in design’. In: Socio-Informatics. Oxford
University Press.
Weber, P., F. Mahmood, M. Ahmadi, V. von Jan, T. Ludwig, and R. Wieching (2023): ‘Fridolin:
participatory design and evaluation of a nutrition chatbot for older adults’. i-com, vol. 22, no. 1,
pp. 33–51.
Wulf, V., C. Müller, V. Pipek, D. Randall, M. Rohde, and G. Stevens (2015): Practice-Based
Computing: Empirically Grounded Conceptualizations Derived from Design Case Studies, pp.
111–150. London: Springer London.
Wulf, V., M. Rohde, V. Pipek, and G. Stevens (2011): ‘Engaging with practices: design case
studies as a research framework in CSCW’. In: Proceedings of the ACM 2011 conference on
Computer supported cooperative work. pp. 505–512.