Figure 7 - uploaded by Stefanie Zollmann
Content may be subject to copyright.
Transitions between Visualization Levels with a Magic Lens. The magic lens area provides a detailed view on a scaffold used to built the wall.
Source publication
In this paper we present an approach for visualizing time-oriented data of dynamic scenes in an on-site AR view. Visualizations of time-oriented data have special challenges compared to the visualization of arbitrary virtual objects. Usually, the 4D data occludes a large part of the real scene. Additionally, the data sets from different points in t...
Context in source publication
Context 1
... lens A magic lens is an interface technique which al- lows to present the information inside the lens in a different style than the information outside [4]. We adapt this concept in such a way that the area inside the magic lens shows virtual representation from a former point in time while the area outside shows the ab- stract progress information as well as the real world environment (Figure 7). ...
Citations
... Researchers used the perceptual representation of sitVis to present data in virtual and augmented reality [22,52]. sitVis commonly used for Spatiotemporal data [46,55], multidimensional data [37,59], and streaming data [48,49,51], to enhance data understanding. ...
... One compelling application for the TimeDistributed Layer lies in reconstructing dynamic augmented reality (AR) views, incorporating time-oriented data. Leveraging the overlapping four-dimensional (4D) representations at different time viewpoints can effectively address occlusion issues in the real scene, resulting in improved and comprehensive visualizations [76,77]. Moreover, the TimeDistributed Layer shows promise in determining camera motion and pose for feature tracking in AR applications, enabling incremental motion estimates at various points in the time series [78,79]. ...
In recent years, integrating structured light with deep learning has gained considerable attention in three-dimensional (3D) shape reconstruction due to its high precision and suitability for dynamic applications. While previous techniques primarily focus on processing in the spatial domain, this paper proposes a novel time-distributed approach for temporal structured-light 3D shape reconstruction using deep learning. The proposed approach utilizes an autoencoder network and time-distributed wrapper to convert multiple temporal fringe patterns into their corresponding numerators and denominators of the arctangent functions. Fringe projection profilometry (FPP), a well-known temporal structured-light technique, is employed to prepare high-quality ground truth and depict the 3D reconstruction process. Our experimental findings show that the time-distributed 3D reconstruction technique achieves comparable outcomes with the dual-frequency dataset (p = 0.014) and higher accuracy than the triple-frequency dataset (p = 1.029 × 10-9), according to non-parametric statistical tests. Moreover, the proposed approach's straightforward implementation of a single training network for multiple converters makes it more practical for scientific research and industrial applications.
... Our work seeks to fill this gap by providing an overview of the design of situated visualization based on a literature search combined with our experiences in AR designs. (E) morph [49]; (F) lens [123]; (G) label [101]; (H) mirror [95]; (I) proxy [54]; (J) panel [35]. For a description of these examples, see Section 3. ...
... For example, color could be used to overlay a heatmap or to simply highlight the referent. Decals have been used to show aggregated stay durations of physical movements in a room [62], highlight which piano keys make a chord [7], construction progress of buildings [123], and isolines on terrain [107]. A decal serves a similar purpose as a set of glyphs placed on a surface, but it does so in a dense manner, assigning a data value to every covered point on the surface. ...
... A common pattern uses a lens of finite extent which can be grabbed and manipulated by the observer [60], so clutter is avoided by spatiotemporal multiplexing: The lens covers different spatial areas at different times. Figure 2F shows a lens indicating internal construction data on the side of a physical building [123]. ...
Situated visualization has become an increasingly popular research area in the visualization community, fueled by advancements in augmented reality (AR) technology and immersive analytics. Visualizing data in spatial proximity to their physical referents affords new design opportunities and considerations not present in traditional visualization, which researchers are now beginning to explore. However, the AR research community has an extensive history of designing graphics that are displayed in highly physical contexts. In this work, we leverage the richness of AR research and apply it to situated visualization. We derive design patterns which summarize common approaches of visualizing data in situ. The design patterns are based on a survey of 293 papers published in the AR and visualization communities, as well as our own expertise. We discuss design dimensions that help to describe both our patterns and previous work in the literature. This discussion is accompanied by several guidelines which explain how to apply the patterns given the constraints imposed by the real world. We conclude by discussing future research directions that will help establish a complete understanding of the design of situated visualization, including the role of interactivity, tasks, and workflows.
... 4D imaging has drawn increased attention in medical imaging for improvement of diagnostic process and residents training (Markl et al., 2012;Canè et al., 2018;Gilbert et al., 2018;McAllister et al., 2018). AR and VR include the 4D concept (Zollmann et al., 2012). It has been shown that they could act as an efficient way to improve the learners' level of anatomy knowledge (Moro et al., 2017b;Kugelmann et al., 2018;Zhao et al., 2020). ...
Increasing number of medical students and limited availability of cadavers have led to a reduction in anatomy teaching through human cadaveric dissection. These changes triggered the emergence of innovative teaching and learning strategies in order to maximize students learning of anatomy. An alternative approach to traditional dissection was presented in an effort to improve content delivery and student satisfaction. The objective of this study is to acquire three‐dimensional (3D) anatomical data using structured‐light surface scanning to create a dynamic four‐dimensional (4D) dissection tool of four regions: neck, male inguinal and femoral areas, female perineum, and brachial plexus. At each dissection step, identified anatomical structures were scanned using a 3D surface scanner (Artec Spider™). Resulting 3D color meshes were overlaid to create a 4D (3D+time) environment. An educational interface was created for neck dissection. Its implementation in the visualization platform allowed 4D virtual dissection by navigating from surface to deep layers and vice versa. A group of 28 second‐year medical students and 17 first‐year surgery residents completed a satisfaction survey. A majority of medical students (96.4%) and 100% of surgery residents said that they would recommend this tool to their colleagues. According to surgery residents, the main elements of this virtual tool were the realistic high‐quality of 3D acquisitions and possibility to focus on each anatomical structure. As for medical students, major elements were the interactivity and entertainment aspect, precision, and accuracy of anatomical structures. This approach proves that innovative solutions to anatomy education can be found to help to maintain critical content and student satisfaction in anatomy curriculum.
... Later, D4AR was updated to the HD4AR system (Bae et al., 2013), enabling the application of available camera-equipped mobile devices. In 2014, bottomed on the D4AR system, manual occlusion management, and "X-ray" metaphors (Zollmann et al., 2012;Karsch et al. (2014) combined a set of AR tools to build a valuable platform, ConstructAide, to monitor project progress. ConstructAide combined unordered photo collections and 3D models to obtain construction progress. ...
... Real-time monitoring has become a hot topic for AR construction. Zollmann et al. (2012) developed an application using overview and detail techniques to visualize real-time dynamic data for construction sites with AR. Behzadan and Kamat (2011) furthered the ARVISCOPE-ROVER system's study to visualize 3D AR animations of active engineering operations. ...
The 4th industrial revolution started in 2016 and referred to a new phase in the industrial revolution. One of the most significant technological evolvements during the 4th industrial revolution is Augmented Reality (AR) technology. AR superimposes interactional virtual objects/images to real environments. Because of the interaction and see-through characteristics, AR is better applied to engineering than Virtual Reality (VR). The application of AR in civil infrastructure can avoid artificial mistakes, improve efficiency, and saves budget. This article reviews AR applications in civil infrastructure, focusing on research studies in the latest five years (2016–2020) and their milestone developments. More than half of the AR research and implementation studies have focused on the construction domain in the last five years. Researchers deploy AR technologies in on-site construction to assist in discrepancy checking, collaborative communication, and safety checking. AR also uses building information models (BIMs) to produce detailed 3D structural information for visualization. Additionally, AR has been studied for structural health monitoring (SHM), routine and damage detection, energy performance assessment, crack inspection, excavation, and underground utility maintenance. Finally, AR has also been applied for architecture design, city plan, and disaster prediction as an essential part of smart city service. This article discusses the challenges of AR implementation in civil infrastructure and recommends future applications.
... We can employ situated or embedded geospatial visualization using AR in many ways. For example, the visualization of air-quality measures displayed as floating spheres at the location where they were collected (White & Feiner, 2009), electricity pipes and other underground infrastructure displayed in virtual excavation trenches (Mathiesen et al., 2012;Schall et al., 2009), building management information displayed on the outside walls of a building (Zollmann et al., 2012), and the overlay of semitransparent polygons and contour lines on real-world terrain (Veas et al., 2013). ...
Augmented reality (AR) enables the creation of immersive situated visualizations. These visualizations blend with the real world so that the user perceives the virtual objects as physically present. We propose two novel immersive situated visualizations for geospatial quantitative point data that link AR bar graphics in the real environment with a virtual AR chart or map. The Egocentric Bar Chart combines virtual bars placed in a real landscape with a virtual 360° bar chart arranged around the user. The Circular Map with Bars combines bars in a real landscape with a 360° virtual map showing bar graphics. These visualizations are designed for inspecting the location and attributes of individual points, as well as understanding the spatial and non-spatial patterns of a set of points. We conducted a study with 12 participants to evaluate reading accuracy and efficiency of the two visualizations, with a view from a skyscraper at the center of the Melbourne metropolitan area. To better control confounding factors, the study used a virtual environment instead of an AR setup. We found that the two suggested visualizations performed better than bars placed in a landscape, and received positive feedback from study participants. The Egocentric Bar Chart visualization was most accurate when estimating and comparing values, and we identified promising improvements for the Circular Map with Bars visualization. Our results demonstrate the potential of AR technology for the communication of geospatial point data with immersive situated bar graphics in an outdoor environment.
... Domain: Visual coherence, depth perception, clutter reduction, exploration, attention direction Example Techniques: Visual coherence [30], [39], [40], [41], [42], [43], [44], [45], [46], [47], [48], [32], [49], [31], [50], [51], [52], [53], [54], [55], [33], [56], [57], Supporting depth perception: [58], [59], [60], [61], [62], [63], [64], [65], [35], [66], [67], [68], [69], [70], Reducing information clutter [71], [72], [73], [74], [75], [76], [77], [66], [78], [79], [80], [81], Exploration [82], [37], [83], [84], [38], [85], [86], [87], [88], [89], [90], [91] Attention direction [92], [93], [94], [95], [96]. ...
... Occluded: [58], [59], [61], [64], [65], [66], [67], [68], [82], [72], [74], [76], [77], [66], [47], [32], [49], [31], [50], [51], [52], [33], [56] Partially occluded: [30], [39], [41], [42], [43], [45], [46], Visible: [92], [93], [94], [95], [96], [60], [62], [63], [35], [69], [70], [37], [83], [38], [85], [86], [87], [90], [91], [71], [73], [75], [78], [79], [80], [81], [40], [48], [53], [54], [55], [57]. ...
... Domain: none, physical, virtual Example Techniques: None: [65], [82], [72], [76], [77], [66], [92], [94], [95], [96], [37], [83], [38], [85], [86], [87], [91], [71], [73], [75], [78], [79], [80], [81], [40], [48], [53], [54], [55], [57] Physical: [47], [32], [49], [31], [50], [51], [52], [33], [56], [30], [39], [41], [42], [43], [45], [46], [90] Virtual: [58], [59], [61], [64], [66], [67], [68], [74], [84], [88], [89], [93], [60], [62], [63], [35], [69], [99], [70] ...
In recent years, the development of Augmented Reality (AR) frameworks made AR application development widely accessible to developers without AR expert background. With this development, new application fields for AR are on the rise. This comes with an increased need for visualization techniques that are suitable for a wide range of application areas. It becomes more important for a wider audience to gain a better understanding of existing AR visualization techniques. Within this work we provide a taxonomy of existing works on visualization techniques in AR. The taxonomy aims to give researchers and developers without an in-depth background in Augmented Reality the information to successively apply visualization techniques in Augmented Reality environments. We also describe required components and methods and analyze common patterns.
... Other works on construction site visualization techniques include manual occlusion management [Zollmann et al. 2010] and "x-ray" metaphors [Zollmann et al. 2012]. While these methods are intended for augmented reality / head-mounted displays, our work improves on these techniques by automatically estimating occlusions and allowing for more control in the visualization process. ...
We describe a set of tools for analyzing, visualizing, and assessing architectural/construction progress with unordered photo collections and 3D building models. With our interface, a user guides the registration of the model in one of the images, and our system automatically computes the alignment for the rest of the photos using a novel Structure-from-Motion (SfM) technique; images with nearby viewpoints are also brought into alignment with each other. After aligning the photo(s) and model(s), our system allows a user, such as a project manager or facility owner, to explore the construction site seamlessly in time, monitor the progress of construction, assess errors and deviations, and create photorealistic architectural visualizations. These interactions are facilitated by automatic reasoning performed by our system: static and dynamic occlusions are removed automatically, rendering information is collected, and semantic selection tools help guide user input. We also demonstrate that our user-assisted SfM method outperforms existing techniques on both real-world construction data and established multi-view datasets.
... Situated Analytics, which supports visual analytical reasoning by aligning abstract data with real physical environment, has largely improved on-site visual analytics and decision-making [ElSayed et al. 2015]. Situated Analytics is demonstrated to be bene cial in diverse areas including environmental monitoring [Veas et al. 2013], navigation [Bell et al. 2002], construction [Zollmann et al. 2012] and agriculture [Engelke et al. 2016]. Low-cost mobile platforms including mobile phones and tablets are leveraged as the main platform in these works, considering their capability of serving as both the input sensor and output display to dynamically adapt to the real scene variation [Chandler et al. 2015;Kalkofen et al. 2011a]. ...
... However, current mobile situated analytical systems such as [El-Sayed et al. 2016;Engelke et al. 2016;Grasset et al. 2012;Kalkofen et al. 2011b;Zollmann et al. 2012] could only support simple tasks such as data retrieval. Sophisticated visualization systems, which are capable of supporting complex visual analytical tasks such as clustering, evolution and comparison, are only designed for desktop and notebook users. ...
... Some recent works incline to divide the visualization system into multiple views. For instance, Interactive 4D [Zollmann et al. 2012] helps end users retrieve as-planned and as-built data within the context of the real building from three different level-of-detail views. MelissAR [Engelke et al. 2016] includes several linked views to assist bee-keepers in understanding on-site bee behaviours with a tablet. ...
Situated Analytics has become popular and important with the resurge of Augmented Reality techniques and the prevalence of mobile platforms. However, existing Situated Analytics could only assist in simple visual analytical tasks such as data retrieval, and most visualization systems capable of aiding complex Visual Analytics are only designed for desktops. Thus, there remain lots of open questions about how to adapt desktop visualization systems to mobile platforms. In this paper, we conduct a study to discuss challenges and trade-offs during the process of adapting an existing desktop system to a mobile platform. With a specific example of interest, egoSlider [Wu et al. 2016], a four-view dynamic ego-centric network visualization system is tailored to adapt the iPhone platform. We study how different view management techniques and interactions influence the effectiveness of presenting multi-scale visualizations including Scatterplot and Storyline visualizations. Simultaneously, a novel Main view+Thumbnails interface layout is devised to support smooth linking between multiple views on mobile platforms. We assess the effectiveness of our system through expert interviews with four experts in data visualization.
... The crime-related information is then presented using overview and detail techniques. Overview techniques allow the inspection of multiple objects and multiple points in time, whereas a detailed view presents information about a selected object at a selected point in time [11]. Overview and detail visualizations distribute the data either temporally or spatially over two or more views [12]. ...
Finding good and relevant information in crime news is one of the most challenging tasks faced by users. An increase in the amount of information from news media has caused difficulties for users in obtaining relevant information. Hence, visualization is one of the important aspects to enhance user’s understanding when browsing or searching for news. Crime news requires a proper approach to visualize a variety of important information such as suspect, victim, location, time and evidence. Visual navigation is more interactive than linear. This has motivated us to develop a prototype called Crime News Visualization (CNV), which
mplements a timeline and tree viewer to assist users when browsing crime news chronologically. The prototype follows several phases of development starting with design concept, implementation and evaluation. News corpus used in this study is from the Bernama Library & Infolink Service (BLIS) resource, with a sample of 247 crime news documents from year 1997 to 2012. A user experiment was conducted with 20 undergraduate students from the Faculty of Social Science and Humanities, Universiti Kebangsaan Malaysia in order to evaluate the acceptance and perception of interactive browsing of crime news using news portal (baseline) and CNV (experimental). Findings revealed that more than 90% of the respondents indicated that the use of timeline
visualization and tree viewer was helpful and had potential to improve the way users browse for crime news content.
