Figure 1 - uploaded by Michael Shilman
Content may be subject to copyright.
Wizard of Oz test setup. (a) A designer observing a user interacting with a pen-based user interface. (b) Another designer operating the interface behind the scenes with SketchWizard.
Source publication
SketchWizard allows designers to create Wizard of Oz prototypes of pen-based user interfaces in the early stages of design. In the past, designers have been inhibited from participating in the design of pen-based interfaces because of the inadequacy of paper prototypes and the difficulty of developing functional prototypes. In SketchWizard, de- sig...
Context in source publication
Context 1
... Wizard of Oz prototype is an incomplete system that a designer can simulate "behind a curtain" (usually by taking the place of a recognizer) while observing the reactions of real end users (see Figure 1). Existing tools make it possible for designers with no programming skill to build Wizard of Oz prototypes of speech [15], location-enhanced [20,22], augmented-reality [8], and desktop [27] applications. ...
Similar publications
This paper describes the design and development of an adaptive multiplayer digital card game targeted to the aging population. The game is based on the popular Poker card game "Five Card Draw" and contains a self-adaptive mechanism for rendering its user interface (UI) according to individual user requirements. The game also embeds social interacti...
Citations
... The EMPATHIC WOZ Platform. Several researchers have worked on WOZ tools before (e.g., [5,9,13,16,19,32,38]), but only few of those tools are openly available for implementation and adaption. One such tool is the WebWOZ Wizard of Oz Prototyping Platform [29] 16 , which has already been employed by a number of previous projects (e.g., vAssist [30], Roberta Ironside [15]). ...
The goal of active aging is to promote changes in the elderly community so as to maintain an active, independent and socially-engaged lifestyle. Technological advancements currently provide the necessary tools to foster and monitor such processes. This paper reports on mid-term achievements of the European H2020 EMPATHIC project, which aims to research, innovate, explore and validate new interaction paradigms and platforms for future generations of personalized virtual coaches to assist the elderly and their carers to reach the active aging goal, in the vicinity of their home. The project focuses on evidence-based, user-validated research and integration of intelligent technology, and context sensing methods through automatic voice, eye and facial analysis, integrated with visual and spoken dialogue system capabilities. In this paper, we describe the current status of the system, with a special emphasis on its components and their integration, the creation of a Wizard of Oz platform, and findings gained from user interaction studies conducted throughout the first 18 months of the project.
... Building on existing UX practice, designers may consider approaches such as constructing personas with varying quantitative data [53]. Wizard of Oz (WoZ) testing is also effective for evaluating early-stage prototypes [8,18,48], and a number of data-dependent systems implement digitally scaffolded 'wizards' for testing prototypes during design [15,29,38,42]. For instance, Suede implements electronically supported WoZ testing techniques that generate chat messages using test data [38]. ...
When prototyping AI experiences (AIX), interface designers seek useful and usable ways to support end-user tasks through AI capabilities. However, AI poses challenges to design due to its dynamic behavior in response to training data, end-user data, and feedback. Designers must consider AI's uncertainties and offer adaptations such as explainability, error recovery, and automation vs. human task control. Unfortunately, current prototyping tools assume a black-box view of AI, forcing designers to work with separate tools to explore machine learning models, understand model performance, and align interface choices with model behavior. This introduces friction to rapid and iterative prototyping. We propose Model-Informed Prototyping (MIP), a workflow for AIX design that combines model exploration with UI prototyping tasks. Our system, ProtoAI, allows designers to directly incorporate model outputs into interface designs, evaluate design choices across different inputs, and iteratively revise designs by analyzing model breakdowns. We demonstrate how ProtoAI can readily operationalize human-AI design guidelines. Our user study finds that designers can effectively engage in MIP to create and evaluate AI-powered interfaces during AIX design
... • Assess AUX: It concerns an AUX evaluation over the prototyped artifact. This stage can be done with various tools, e.g., low-fidelity prototypes [56,57], or techniques such as The Wizard of Oz [58,59]. Nevertheless, the important thing is to stimulate the creativity of participants, so that we can obtain their idealizations and expectations. ...
Today, social networks are crucial commodities that allow people to share different contents and opinions. In addition to participation, the information shared within social networks makes them attractive, but success is also accompanied by a positive User eXperience (UX). Social networks must offer useful and well-designed user-tools, i.e., sets of widgets that allow interaction among users. To satisfy this requirement, Episodic User eXperience (EUX) yields reactions of users after having interacted with an artifact. Anticipated User eXperience (AUX) grants the designers the capacity to recollect users’ aspirations, assumptions, and needs in the initial development phase of an artifact. In this work, we collect UX perceived in both periods to contrast user expectations and experiences offered on social networks, in order to find elements that could improve the design of user-tools. We arrange a test where participants (N=20) designed prototypes on paper to solve tasks and then did the same tasks on online social networks. Both stages are assessed with the help of AttrakDiff, and then we analyze the results through t-tests. The results we obtained suggest that users are inclined towards pragmatic aspects of their user-tools expectations.
... Note that we limit our discussion to the areas stated above, and will not go into detail about the many related fields such as wireframe augmentation e.g. DENIM [5] or SketchWizard [20]. ...
... In designing our study we have been influenced by similar research [6,23,20,22,5,4] to include particular metrics to aid future comparison. However, we found no other approaches which was directly comparable. ...
An early stage of developing user-facing applications is creating a wireframe to layout the interface. Once a wireframe has been created it is given to a developer to implement in code. Developing boiler plate user interface code is time consuming work but still requires an experienced developer. In this dissertation we present two approaches which automates this process, one using classical computer vision techniques, and another using a novel application of deep semantic segmentation networks. We release a dataset of websites which can be used to train and evaluate these approaches. Further, we have designed a novel evaluation framework which allows empirical evaluation by creating synthetic sketches. Our evaluation illustrates that our deep learning approach outperforms our classical computer vision approach and we conclude that deep learning is the most promising direction for future research.
... The EMPATHIC WOZ Platform. Several researchers have worked on WOZ tools before (e.g., [5,9,13,16,19,32,38]), but only few of those tools are openly available for implementation and adaption. One such tool is the WebWOZ Wizard of Oz Prototyping Platform [29] 16 , which has already been employed by a number of previous projects (e.g., vAssist [30], Roberta Ironside [15]). ...
The goal of active aging is to promote changes in the elderly community so as to maintain an active, independent and socially-engaged lifestyle. Technological advancements currently provide the necessary tools to foster and monitor such processes. This paper reports on mid-term achievements of the European H2020 EMPATHIC project, which aims to research, innovate, explore and validate new interaction paradigms and platforms for future generations of personalized virtual coaches to assist the elderly and their carers to reach the active aging goal, in the vicinity of their home. The project focuses on evidence-based, user-validated research and integration of intelligent technology, and context sensing methods through automatic voice, eye and facial analysis, integrated with visual and spoken dialogue system capabilities. In this paper, we describe the current status of the system, with a special emphasis on its components and their integration, the creation of a Wizard of Oz platform, and findings gained from user interaction studies conducted throughout the first 18 months of the project.
... Other researchers have proposed tools that explicitly support the Wizard of Oz (WOz) technique. Some examples include WozARd for prototyping location-aware mobile augmented reality [1], SketchWizard for pen-based interfaces [15], and Suede for speech-based interfaces [25]. Apparition [27] helps designers prototype web-based systems in real time by crowdsourcing part of the wizard's trickery. ...
Video prototypes help capture and communicate interaction with paper prototypes in the early stages of design. However, designers sometimes find it tedious to create stop-motion videos for continuous interactions and to re-shoot clips as the design evolves. We introduce Montage, a proof-of-concept implementation of a computer-assisted process for video prototyping. Montage lets designers progressively augment video prototypes with digital sketches, facilitating the creation, reuse and exploration of dynamic interactions. Montage uses chroma keying to decouple the prototyped interface from its context of use, letting designers reuse or change them independently. We describe how Montage enhances video prototyping by combining video with digital animated sketches, encourages the exploration of different contexts of use, and supports prototyping of different interaction styles.
... In contrast, SketchExpress records manual demonstration and lets crowd workers remix it to refine the behaviors. This Wizard-of-Oz approach has been shown effective in making the design process accessible to a broader population [220,221], but has been used on static UI sketches rather than interactive components. An adaptation of the Wizard-of-Oz approach where human operators manipulate paper prototypes to show interactive components has been traditionally used to demonstrate the dynamic behaviors of prototypes [222]. ...
Creating an artifact - such as writing a book, developing software, or performing a piece of music - is often limited to those with domain-specific experience or training. As a consequence, effectively involving non-expert end users in such creative processes is challenging. This work explores how computational systems can facilitate collaboration, communication, and participation in the context of involving users in the process of creating artifacts while mitigating the challenges inherent to such processes. In particular, the interactive systems presented in this work support live collaborative creation, in which artifact users collaboratively participate in the artifact creation process with creators in real time. In the systems that I have created, I explored liveness, the extent to which the process of creating artifacts and the state of the artifacts are immediately and continuously perceptible, for applications such as programming, writing, music performance, and UI design. Liveness helps preserve natural expressivity, supports real-time communication, and facilitates participation in the creative process. Live collaboration is beneficial for users and creators alike: making the process of creation visible encourages users to engage in the process and better understand the final artifact. Additionally, creators can receive immediate feedback in a continuous, closed loop with users. Through these interactive systems, non-expert participants help create such artifacts as GUI prototypes, software, and musical performances. This dissertation explores three topics: (1) the challenges inherent to collaborative creation in live settings, and computational tools that address them; (2) methods for reducing the barriers of entry to live collaboration; and (3) approaches to preserving liveness in the creative process, affording creators more expressivity in making artifacts and affording users access to information traditionally only available in real-time processes. In this work, I showed that enabling collaborative, expressive, and live interactions in computational systems allow the broader population to take part in various creative practices.
... In contrast, SketchExpress records manual demonstration and lets crowd workers remix it to refine the behaviors. This Wizard-of-Oz approach has been shown effective in making the design process accessible to a broader population [9,26], but has been used on static UI sketches rather than interactive components. An adaptation of the Wizard-of-Oz approach where human operators manipulate paper prototypes to show interactive components has been traditionally used to demonstrate the dynamic behaviors of prototypes [11]. ...
Low-fidelity prototyping at the early stages of user interface (UI) design can help designers and system builders quickly explore their ideas. However, interactive behaviors in such prototypes are often replaced by textual descriptions because it usually takes even professionals hours or days to create animated interactive elements due to the complexity of creating them. In this paper, we introduce SketchExpress, a crowd-powered prototyping tool that enables crowd workers to create reusable interactive behaviors easily and accurately. With the system, a requester-designers or end-users-describes aloud how an interface should behave and crowd workers make the sketched prototype interactive within minutes using a demonstrate-remix-replay approach. These behaviors are manually demonstrated, refined using remix functions, and then can be replayed later. The recorded behaviors persist for future reuse to help users communicate with the animated prototype. We conducted a study with crowd workers recruited from Mechanical Turk, which demonstrated that workers could create animations using SketchExpress in 2.9 minutes on average with 27% gain in the quality of animations compared to the baseline condition of manual demonstration.
... These methods utilize existing materials to quickly create low-fidelity prototypes of interactive systems for rapid and effective expression and evaluation of ideas. The usefulness of these techniques has widely been studied in the fields of humancomputer interaction [9,16,19,32,36] and product design [8,26,30]. But, additional consideration is needed to apply these methods to automotive interior interaction design. ...
Technological advances and socioeconomic disruptions such as self-driving cars, car-sharing services and artificial intelligence assistance may fundamentally alter interactions inside the future car. However, existing design tools and processes geared toward static physical authoring are ill-equipped for such interaction design. We propose a new design workflow that combines experience prototyping methods typically used by the user interface and product design communities with 3D sketching and haptic helper techniques to help automotive designers ideate, prototype, experience and evaluate multi-sensory interactions in a collaborative manner. Using our workflow, designers use 3D sketching to quickly and expressively author 3D shape and motion ideas in space; augment them with tactile and other sensory feedback through physical proxies and other available gadgets; and immediately enact and immersively experience them to progressively explore and develop them.
... SketchWizard supports early prototyping of user interfaces incorporating pen-based interaction. (Davis, Saponas, Shilman & Landay 2007) SUEDE (Klemmer, Sinha, Chen, Landay, Aboobaker & Wang 2000) is a tool for prototyping speech interfaces. All (simulated) system output needs to be added to the prototype on beforehand. ...
... Beautified user sketches as in SketchWizard by Davis, Saponas, Shilman and Landay (2007). ...
The Wizard-of-Oz method has been around for decades, allowing researchers and practitioners to conduct prototyping without programming. The extensive literature review in the field reported here, however, revealed that the re-usable tools supporting the method do not seem to last more than a few years. Generic systems started to appear around the turn of the millennium, but very few are still in use. New systems are designed nevertheless. The systems and issues presented here should be of interest to people in the field of prototyping interaction design.
This review was inspired by the authors’ ongoing re-development of their own Wizard-of-Oz tool, the Ozlab, into a system based on web technology. The report takes stock of some key features of Ozlab as well as reviews and contrasts other re-usable Wizard-of-Oz tools with the ambition to list every generic tool.
The introductory chapter compares and contrasts prototyping in general with Wizard-of-Oz prototyping and provides an historical overview of Wizard of Oz in the development of digital interactive systems, spanning the years 1971-2013. Chapter 2 briefly describes the operation of Ozlab, and Chapter 3 presents the literature review of generic WOz tools. Chapter 4 discusses how interaction is supported by WOz tools and Chapter 5 how platform dependency affects the longevity of generic tools, while Chapter 6 points to the limitations in the Wizard-of-Oz method itself from several perspectives. Chapter 7, finally, presents concluding remarks including a list of points for future methodological analysis and development.
