Andrés Monroy-Hernández's research while affiliated with Princeton University and other places

What is this page?


This page lists the scientific contributions of an author, who either does not have a ResearchGate profile, or has not yet added these contributions to their profile.

It was automatically created by ResearchGate to create a record of this author's body of work. We create such pages to advance our goal of creating and maintaining the most comprehensive scientific repository possible. In doing so, we process publicly available (personal) data relating to the author as a member of the scientific community.

If you're a ResearchGate member, you can follow this page to keep up with this author's work.

If you are this author, and you don't want us to display this page anymore, please let us know.

Publications (41)


The Future of Conferences Is Unconferences: Exploring a Decentralized Network of Regional Meetups
  • Article

August 2023

·

25 Reads

interactions

Soya Park

·

Eun-Jeong Kang

·

·

[...]

·

Andrés Monroy-Hernández

This forum is dedicated to exploring the notion of meaningfulness in design processes, taking the perspectives of community groups, nongovernmental organizations, and those who are marginalized in society as starting points. Authors will reflect conceptually and methodologically on practical engagements. --- Rosanna Bellini and Angelika Strohmayer, Editors

Share

Figure 1: Based on Mayer et al.'s trust model [30], we separate trust from trustworthiness perceptions that precede it, and two trust-related behaviors that proceed from it: (1) AI adoption, which corresponds to risk taking in relationship in the model, and (2) AI output acceptance, which corresponds to outcomes evaluation in the model. In this work, we describe both general trustworthiness perceptions and trust attitudes, and instance-specific trust-related behaviors. See Sec. 2.1 for further discussion. This figure is replicated from Mayer et al.'s work [30].
Figure 2: Our study application Merlin [44] is a popular AI-based bird identification mobile phone app. Users upload photos on the Photo ID feature (left) or audio recordings on the Sound ID feature (right), with optional location and season data, and get a list of bird(s) that best match the input. See Sec. 3.1 for more details about the app.
Factors that influenced our study participants' trust in AI. See Sec. 4.5 for a discussion.
Humans, AI, and Context: Understanding End-Users' Trust in a Real-World Computer Vision Application
  • Preprint
  • File available

May 2023

·

150 Reads

Trust is an important factor in people's interactions with AI systems. However, there is a lack of empirical studies examining how real end-users trust or distrust the AI system they interact with. Most research investigates one aspect of trust in lab settings with hypothetical end-users. In this paper, we provide a holistic and nuanced understanding of trust in AI through a qualitative case study of a real-world computer vision application. We report findings from interviews with 20 end-users of a popular, AI-based bird identification app where we inquired about their trust in the app from many angles. We find participants perceived the app as trustworthy and trusted it, but selectively accepted app outputs after engaging in verification behaviors, and decided against app adoption in certain high-stakes scenarios. We also find domain knowledge and context are important factors for trust-related assessment and decision-making. We discuss the implications of our findings and provide recommendations for future research on trust in AI.

Download





Social App Accessibility for Deaf Signers

October 2020

·

32 Reads

·

36 Citations

Proceedings of the ACM on Human-Computer Interaction

Social media platforms support the sharing of written text, video, and audio. All of these formats may be inaccessible to people who are deaf or hard of hearing (DHH), particularly those who primarily communicate via sign language, people who we call Deaf signers. We study how Deaf signers engage with social platforms, focusing on how they share content and the barriers they face. We employ a mixed-methods approach involving seven in-depth interviews and a survey of a larger population (n = 60). We find that Deaf signers share the most in written English, despite their desire to share in sign language. We further identify key areas of difficulty in consuming content (e.g., lack of captions for spoken content in videos) and producing content (e.g., captioning signed videos, signing into a phone camera) on social media platforms. Our results both provide novel insights into social media use by Deaf signers and reinforce prior findings on DHH communication more generally, while revealing potential ways to make social media platforms more accessible to Deaf signers.


Fig. 1. Interviewees' reported usage of media types/platforms.
Fig. 2. The percentage of respondents who reported sharing with different types of media formats in three settings: 1) a public feed meant for sharing broadly (e.g., a Facebook feed) in dark purple, 2) a small group of DHH individuals (light purple), and 3) a small group of hearing individuals (white). Respondents selected from a list.
summarizes their hearing status.
Social App Accessibility for Deaf Signers

August 2020

·

411 Reads

Social media platforms support the sharing of written text, video, and audio. All of these formats may be inaccessible to people who are deaf or hard of hearing (DHH), particularly those who primarily communicate via sign language, people who we call Deaf signers. We study how Deaf signers engage with social platforms, focusing on how they share content and the barriers they face. We employ a mixed-methods approach involving seven in-depth interviews and a survey of a larger population (n = 60). We find that Deaf signers share the most in written English, despite their desire to share in sign language. We further identify key areas of difficulty in consuming content (e.g., lack of captions for spoken content in videos) and producing content (e.g., captioning signed videos, signing into a phone camera) on social media platforms. Our results both provide novel insights into social media use by Deaf signers and reinforce prior findings on DHH communication more generally, while revealing potential ways to make social media platforms more accessible to Deaf signers.


Figure 3. -A photograph of the panel session, L-R Jennison Asuncion, Jerry Robinson,and Jess Harvie.
Future research directions for accessible social media

July 2020

·

1,118 Reads

·

11 Citations

ACM SIGACCESS Accessibility and Computing

Social media platforms are deeply ingrained in society, and they offer many different spaces for people to engage with others. Unfortunately, accessibility barriers prevent people with disabilities from fully participating in these spaces. Social media users commonly post inaccessible media, including videos without captions (which are important for people who are Deaf or Hard of Hearing) and images without alternative text (descriptions read aloud by screen readers for people who are blind). Users with motor impairments must find workarounds to deal with the complex user interfaces of these platforms, and users with cognitive disabilities may face barriers to composing and sharing information. We invited accessibility researchers, industry practitioners, and end-users with disabilities to come together at the Computer-Supported Cooperative Work conference (CSCW 2019) to discuss challenges and solutions for improving social media accessibility. Over the course of a day that included two panels and breakout sessions, the workshop attendees outlined four critical future research directions to progress on the path to accessible social media: tooling to support disabled people authoring content, developing more accessible formats/tools for new forms of interaction (e.g, Augmented and Mixed Reality), using communities to distribute accessibility labor, and ensuring machine learning systems are built on representative datasets for disability use-cases.


Patron or Poison?: Industry Funding of HCI Research

November 2019

·

21 Reads

·

10 Citations

For over 20 years, the academic human-computer interaction (HCI) and computer supported collaborative work (CSCW) communities have conducted research on user-facing hardware, software, and social media platforms dominated by a few key firms. Even as the contributions made by these scholars have shaped the development of these technologies, so too does industry funding play a key role in convening and supporting our community. This panel brings together HCI researchers for a reflective conversation on industry funding support for HCI.


Citations (29)


... Their application showed an increase in the sense of belonging and peer connectedness amongst students. Knoll et al. [62] developed a co-located escape room in an AR environment and tested it with four pairs of young adults. From a qualitative analysis of semi-structured interviews, they showed that the participants felt socially connected to their partners through the experience. ...

Reference:

An Iterative Participatory Design Approach to Develop Collaborative Augmented Reality Activities for Older Adults in Long-Term Care Facilities
ARctic Escape: Promoting Social Connection, Teamwork, and Collaboration Using a Co-Located Augmented Reality Escape Room
  • Citing Conference Paper
  • April 2023

... To uncover transparency-related harms, mitigation strategies, and needs of rideshare workers, we conducted in-person interviews with (N=9) Uber and Lyft drivers in the Northeast United States. Drawing on recent methods in human-centered explainable AI [32,60,101], we developed an annotation-based activity. This activity involved workers annotating screenshots of app UIs during interviews, providing insights into worker-generated design improvements based on their real interactions with the platform apps they work for. ...

"Help Me Help the AI": Understanding How Explainability Can Support Human-AI Interaction
  • Citing Conference Paper
  • April 2023

... Ngai et al. (2020)explained that using features on social media can beautify the appearance of all messages created, thereby generating engagement in the form of likes and comment if SMI can use it correctly. Mack et al. (2020)also explained that basically, currently the technology for automatically creating CC is being continuously developed so that deaf people can automatically get CC in every content on social media. Various features on social media that have been developed currently are considered capable of supporting the delivery of information in an inclusive manner. ...

Social App Accessibility for Deaf Signers
  • Citing Article
  • October 2020

Proceedings of the ACM on Human-Computer Interaction

... All participants responded to the question and 70 participants (60.34%) indicated yes. Responses for this were categories as follows: Computer Science (52), Engineering & Math (12), and Other (14). ...

Future research directions for accessible social media

ACM SIGACCESS Accessibility and Computing

... While the importance of industry involvement in AI research has been recognized in academic works (Gil & Selman, 2019), and potential challenges associated with increased industry funding and participation have been noted (Abdalla & Abdalla, 2021;Group et al., 2019), there has been limited systematic assessment on whether the specific characteristics of companies, such as their commercial orientation, impose undue limitations or have unforeseen impacts on AI research (Littman, 2021). The question remains whether action needs to be taken by academia, industry, or policymakers to ensure a balance between academia and industry. ...

Patron or Poison?: Industry Funding of HCI Research
  • Citing Conference Paper
  • November 2019

... Finally, the structure of social media platforms and how people use them has generally created access issues for screen reader users [13,15,37,51]. For example, Twitter became less accessible when the platform allowed images to be posted [37], and more recent work studied the extent of this issue where very few users include embedded image descriptions for screen readers to access [13]. ...

Addressing the Accessibility of Social Media

... Particularly relevant in this stream of research are recent research-throughdesign contributions using ambiguous -rather than clear -data representations to stimulate multiple, open-ended, heterogeneous, and unexpected interpretations of data, beyond utility and rationality [11,35]. For instance, Animo [19], Hint Shirt [13], and Ripple [12] explore biosignals (such as heart rate and skin conductance) displayed in ambiguous visualizations as social cues for interpersonal relationships. These systems show the value of ambiguity as a conversation trigger that can encourage reflection and self-expression, enhance engagement and enable social connection. ...

Animo: Sharing Biosignals on a Smartwatch for Lightweight Social Connection
  • Citing Article
  • March 2019

Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies

... The POV camera glasses used were hands-free, head-mounted devices that can capture immersive and personal views of the environment and individual perspectives (Bipat et al. 2019). The recordings offered an opportunity to observe and empathize with the informants about what they were actually seeing or hearing during the field trip (Skinner & Gormley, 2016). ...

Analyzing the Use of Camera Glasses in the Wild
  • Citing Preprint
  • February 2019

... We searched for articles on group formation published in the CSCW conference. Since CSCW switched format from publishing conference proceedings to a journal in 2017, we searched in the CSCW proceedings from 1990 to 2017 and the Proceedings of the ACM on Human-Computer Interaction (PACMHCI) from 2017 to 2018 [52]. We first performed several searches to assess the volume of potentially relevant studies according to the eligibility criteria. ...

Editor's Note/Chairs' Welcome
  • Citing Article
  • December 2017

Proceedings of the ACM on Human-Computer Interaction

... Soylent [11] showed that splitting tasks into the ndx-verify stages can improve the quality and accuracy of crowd workers' results. Multi-stage crowdsourcing workows have also been designed to improve the tone of emails [53], to provide critiques to designers [33], and to improve the learning experience of existing how-to videos with step-by-step annotations [27]. These applications have demonstrated that crowd workows can yield results comparable to those of experts. ...

CrowdTone: Crowd-powered tone feedback and improvement system for emails
  • Citing Article
  • January 2017