Figure 5 - uploaded by Paul Holleis
Content may be subject to copyright.
Source publication
As projector units become smaller, brighter and more energy conserving, they are bound to become an integral part of many mobile phone models in the future. We lay out and discuss the design space of interactions and applications enabled by such devices. Moreover, we focus on the implications of hardware design, discuss possible interaction concept...
Citations
... Serrano et al. [54] explored the combination of an AR HMD within a distributed display environment. Rukzio and Holleis explored a design space that spans a mobile phone and a public projector [53]. Our work builds on previous explorations in context sharing by exploring the asymmetric duality provided by an AR HMD and SAR display and how the user fts within it. ...
Current wearable AR devices create an isolated experience with a limited field of view, vergence-accommodation conflicts, and difficulty communicating the virtual environment to observers. To address these issues and enable new ways to visualize, manipulate, and share virtual content, we introduce Augmented Augmented Reality (AAR) by combining a wearable AR display with a wearable spatial augmented reality projector. To explore this idea, a system is constructed to combine a head-mounted actuated pico projector with a Hololens AR headset. Projector calibration uses a modified structure from motion pipeline to reconstruct the geometric structure of the pan-tilt actuator axes and offsets. A toolkit encapsulates a set of high-level functionality to manage content placement relative to each augmented display and the physical environment. Demonstrations showcase ways to utilize the projected and head-mounted displays together, such as expanding field of view, distributing content across depth surfaces, and enabling bystander collaboration.
... Recently, projectors are used to augment virtual contents onto a real surface by projection mapping method called spatial augmented reality (3) (14) . Recent investigations removed the limitation of spatial augmented reality and allowed the user movement using a portable projector attached on a mobile phone (5) (8) (15) (16) . ...
In this paper we propose a feature-based alignment method for visualizing geographical content on a movable paper map using non-calibrated projector-camera pair. In order to project correctly aligned geographical content on a movable paper map, we detect two kinds of features: printed features and projected features on a paper map. First, we print landmark points as map features on the paper map for registration purpose. We then project landmark points onto the paper map. We then detect these printed and projected features simultaneously. The transformation from the projector coordinate system to the image coordinate system is estimated using the feature correspondences. This transformation is used to warp the geographical content before the corrected projection. In succeeding frames, the features are tracked in order to update the transformation. We evaluated our method against the motion of the paper map, the camera and the projector with average projection error of 9.5 pixels.
The rapid evolution of technology has changed the way in which we can interact with interactive systems. New physical workspaces have appeared such as Multi-Device Environments (MDE). These scenarios implicitly support Distributed User Interfaces allow us to distribute user interfaces on different devices. In this way, we take advantages of distributed human innate cognition. However, interactions with pixels on these GUI screens are inconsistent with our interactions with the rest of the physical environment in which we live. In this paper, we propose two different interaction techniques based on Tangible User Interfaces (designed with NFC technology). Then, we discuss the strengths and weaknesses of interaction techniques in distributed systems settings.
In contrast with design flaws that occur in user interfaces, design flaws in physical spaces have a much higher cost and impact. Software is in fact fairly easy to change and update in contrast with legacy physical constructions where updating their physical appearance is often not an option. We present the Feedforward Torch, a mobile projection system that targets the augmentation of legacy hardware with feedforward information. Feedforward explains users what the results of their action will be, and can thus be seen as the opposite of feedback. A first user study suggests that providing feedforward in these environments could improve their usability.
In the transition from a device-oriented paradigm toward a more task-oriented paradigm with increased interoperability, people are struggling with inappropriate user interfaces, competing standards, technical incompatibilities, and other difficulties. The current handles for users to explore, make, and break connections between devices seem to disappear in overly complex menu structures displayed on small screens. This paper tackles the problem of establishing connections between devices in a smart home environment, by introducing an interaction model that we call semantic connections. Two prototypes are demonstrated that introduce both a tangible and an augmented reality approach toward exploring, making, and breaking connections. In the augmented reality approach, connections between real-world objects are visualized by displaying visible lines and icons from a mobile device containing a pico projector. In the tangible approach, objects in the environment are tagged and can be scanned and interacted with, to explore connection possibilities, and manipulate the connections. We discuss the technical implementation of a pilot study setup used to evaluate both our interaction approaches. We conclude the paper with the results of a user study that shows how the interaction approaches influence the mental models users construct after interacting with our setup.
We present our concept of an indoor assistance and naviga-tion system for pedestrians that leverages projector phones. Digitally enhanced guides have many advantages over tra-ditional paper-based indoor guides, most of all that they can be aware of their current context and display dynamic in-formation. That is why particularly shopping malls recently started deploying indoor assistance applications for mobile phones, which also include support for navigation. Moreo-ver, as we show in the paper, projected interfaces offer ad-ditional distinct advantages over static guides and even tra-ditional or augmented reality mobile applications. We de-scribe five concepts for a shopping mall indoor assistance system based on projector phones, comprising support for shop selection, precise way finding, "virtual fitting" of clothes, and context-aware and ambient advertisements. We then apply the concepts to a typical shopping scenario, where users wear the phone at their belt and constantly pro-ject the interface in front of them. Expected benefits of our system are that people ought to find their way quicker and easier, being less distracted from their usual shopping expe-rience. Finally, we discuss the technical feasibility of our envisioned implementation and research questions.
Nowadays mobile phones are used for a wide range of applications in peoples every day life. Customizable with a variety of
applications these mobile phones are becoming the swiss army knife of the generation. With the increase in processing power
and memory the only bottleneck left is the small display size and resolution. To keep these devices mobile the size of the
screen is restricted and even though the resolution of such displays is increasing, there is a limit to information presentable
on the display. One way to overcome these drawbacks is the integration of a projection unit into the mobile phone. Modern
projectors have been miniaturized to the size of mobile phones and can be operated using batteries. These projectors are called
pico projectors. The next step is to integrate such a projector directly into a mobile phone. These devices are also called
projector phones. Up to now several different prototypes both from research and industry exist. First commercial projector
phones are available on the mass market [1]. Such phones have the capabilities to overcome the problems that arise when exploring
large-scale information on the small display of a present-day mobile phone. With these devices one can explore information
like maps or web pages without the need for zooming or panning [2] but up to now the available devices are only projecting
a mirror image of the devices display or images and videos. Considering the anticipated widespread availability of phones
with integrated cameras and projectors in the future, comparably little research has been conducted so far to investigate
the potential of such a mobile unit.
