InSpectr: Multi‐Modal Exploration,Visualization, and Analysis of Spectral Data

This paper addresses the increasing demand in industry for methods to analyze and visualize multimodal data involving a spectral modality. Two data modalities are used: high‐resolution X‐ray computed tomography (XCT) for structural characterization and low‐resolution X‐ray fluorescence (XRF) spectral data for elemental decomposition. We present InSpectr, an integrated tool for the interactive exploration and visual analysis of multimodal, multiscalar data. The tool has been designed around a set of tasks identified by domain experts in the fields of XCT and XRF. It supports registered single scalar and spectral datasets optionally coupled with element maps and reference spectra. InSpectr is instantiating various linked views for the integration of spatial and non‐spatial information to provide insight into an industrial component's structural and material composition: views with volume renderings of composite and individual 3D element maps visualize global material composition; transfer functions defined directly on the spectral data and overlaid pie‐chart glyphs show elemental composition in 2D slice‐views; a representative aggregated spectrum and spectra density histograms are introduced to provide a global overview in the spectral view. Spectral magic lenses, spectrum probing and elemental composition probing of points using a pie‐chart view and a periodic table view aid the local material composition analysis. Two datasets are investigated to outline the usefulness of the presented techniques: a 3D virtually created phantom with a brass metal alloy and a real‐world 2D water phantom with insertions of gold, barium, and gadolinium. Additionally a detailed user evaluation of the results is provided.     

Cytosplore: Interactive Immune Cell Phenotyping for Large Single‐Cell Datasets

To understand how the immune system works, one needs to have a clear picture of its cellular compositon and the cells' corresponding properties and functionality. Mass cytometry is a novel technique to determine the properties of single‐cells with unprecedented detail. This amount of detail allows for much finer differentiation but also comes at the cost of more complex analysis. In this work, we present Cytosplore, implementing an interactive workflow to analyze mass cytometry data in an integrated system, providing multiple linked views, showing different levels of detail and enabling the rapid definition of known and unknown cell types. Cytosplore handles millions of cells, each represented as a high‐dimensional data point, facilitates hypothesis generation and confirmation, and provides a significant speed up of the current workflow. We show the effectiveness of Cytosplore in a case study evaluation.     

STAR: Visual Computing in Materials Science

Visual computing has become highly attractive for boosting research endeavors in the materials science domain. Using visual computing, a multitude of different phenomena may now be studied, at various scales, dimensions, or using different modalities. This was simply impossible before. Visual computing techniques provide novel insights in order to understand complex material systems of interest, which is demonstrated by strongly rising number of new approaches, publishing new techniques for materials analysis and simulation. Outlining the proximity of materials science and visual computing, this state of the art report focuses on the intersection of both domains in order to guide research endeavors in this field. We provide a systematic survey on the close interrelations of both fields as well as how they profit from each other. Analyzing the existing body of literature, we review the domain of visual computing supported materials science, starting with the definition of materials science as well as material systems for which visual computing is frequently used. Major tasks for visual computing, visual analysis and visualization in materials sciences are identified, as well as simulation and testing techniques, which are providing the data for the respective analyses. We reviewed the input data characteristics and the direct and derived outputs, the visualization techniques and visual metaphors used, as well as the interactions and analysis workflows employed. All our findings are finally integrated in a cumulative matrix, giving insights about the different interrelations of both domains. We conclude our report with the identification of open high level and low level challenges for future research.     

A randomized algorithm for natural object colorization

Natural objects often contain vivid color distribution with wide variety of colors. Conventional colorization techniques, on the other hand, produce colors that are relatively flat with little color variation. In this paper, we introduce a randomized algorithm which considers not only the value of target color but also the distribution of target color. In essence, our algorithm paints a color distribution to a region which synthesizes color distribution of a natural object. Our approach models the correlation between intensity and color in HSV color space in terms of H – S, H – V and S – V joint histogram. During the colorization process, we randomly swap and reassign color of a pixel to minimize a cost function that measures color consistency to its neighborhood and intensity‐to‐color correlation captured in the joint histogram. We tested our algorithm extensively on many natural objects and our user study confirms that our results are more vivid and natural compared to results from previous techniques.     

Structure Aware Visual Cryptography

Visual cryptography is an encryption technique that hides a secret image by distributing it between some shared images made up of seemingly random black‐and‐white pixels. Extended visual cryptography (EVC) goes further in that the shared images instead represent meaningful binary pictures. The original approach to EVC suffered from low contrast, so later papers considered how to improve the visual quality of the results by enhancing contrast of the shared images. This work further improves the appearance of the shared images by preserving edge structures within them using a framework of dithering followed by a detail recovery operation. We are also careful to suppress noise in smooth areas.     

AutoStyle: Automatic Style Transfer from Image Collections to Users' Images

Stylizing photos, to give them an antique or artistic look, has become popular in recent years. The available stylization filters, however, are usually created manually by artists, resulting in a narrow set of choices. Moreover, it can be difficult for the user to select a desired filter, since the filters’ names often do not convey their functions. We investigate an approach to photo filtering in which the user provides one or more keywords, and the desired style is defined by the set of images returned by searching the web for those keywords. Our method clusters the returned images, allows the user to select a cluster, then stylizes the user's photos by transferring vignetting, color, and local contrast from that cluster. This approach vastly expands the range of available styles, and gives each filter a meaningful name by default. We demonstrate that our method is able to robustly transfer a wide range of styles from image collections to users’ photos.     

Illustrative Visualization of Mesoscale Ocean Eddies

Feature‐based time‐varying volume visualization is combined with illustrative visualization to tell the story of how mesoscale ocean eddies form in the Gulf Stream and transport heat and nutrients across the ocean basin. The internal structure of these three‐dimensional eddies and the kinematics with which they move are critical to a full understanding of ocean eddies. In this work, we apply a feature‐based method to track instances of ocean eddies through the time steps of a high‐resolution multi‐decadal regional ocean model and generate a series of eddy paths which reflect the life cycle of individual eddy instances. Based on the computed metadata, several important geometric and physical properties of eddy are computed. Illustrative visualization techniques, including visual effectiveness enhancement, focus+context, and smart visibility, are combined with the extracted volume features to explore eddy characteristics at different levels. An evaluation by domain experts indicates that combining our feature‐based techniques with illustrative visualization techniques provides an insight into the role eddies play in ocean circulation. The domain experts expressed a preference for our methods over existing tools.     

Visualizing the Impact of Geographical Variations on Multivariate Clustering

Traditional multivariate clustering approaches are common in many geovisualization applications. These algorithms are used to define geodemographic profiles, ecosystems and various other land use patterns that are based on multivariate measures. Cluster labels are then projected onto a choropleth map to enable analysts to explore spatial dependencies and heterogeneity within the multivariate attributes. However, local variations in the data and choices of clustering parameters can greatly impact the resultant visualization. In this work, we develop a visual analytics framework for exploring and comparing the impact of geographical variations for multivariate clustering. Our framework employs a variety of graphical configurations and summary statistics to explore the spatial extents of clustering. It also allows users to discover patterns that can be concealed by traditional global clustering via several interactive visualization techniques including a novel drag & drop clustering difference view. We demonstrate the applicability of our framework over a demographics dataset containing quick facts about counties in the continental United States and demonstrate the need for analytical tools that can enable users to explore and compare clustering results over varying geographical features and scales.     

Visual Analysis of Governing Topological Structures in Excitable Network Dynamics

To understand how topology shapes the dynamics in excitable networks is one of the fundamental problems in network science when applied to computational systems biology and neuroscience. Recent advances in the field discovered the influential role of two macroscopic topological structures, namely hubs and modules. We propose a visual analytics approach that allows for a systematic exploration of the role of those macroscopic topological structures on the dynamics in excitable networks. Dynamical patterns are discovered using the dynamical features of excitation ratio and co‐activation. Our approach is based on the interactive analysis of the correlation of topological and dynamical features using coordinated views. We designed suitable visual encodings for both the topological and the dynamical features. A degree map and an adjacency matrix visualization allow for the interaction with hubs and modules, respectively. A barycentric‐coordinates layout and a multi‐dimensional scaling approach allow for the analysis of excitation ratio and co‐activation, respectively. We demonstrate how the interplay of the visual encodings allows us to quickly reconstruct recent findings in the field within an interactive analysis and even discovered new patterns. We apply our approach to network models of commonly investigated topologies as well as to the structural networks representing the connectomes of different species. We evaluate our approach with domain experts in terms of its intuitiveness, expressiveness, and usefulness.     

Generalized As‐Similar‐As‐Possible Warping with Applications in Digital Photography

Discrete conformal mappings of planar triangle meshes, also known as the As‐Similar‐As‐Possible (ASAP) mapping, involve the minimization of a quadratic energy function, thus are very easy to generate and are popular in image warping scenarios. We generalize this classical mapping to the case of quad meshes, taking into account the mapping of the interior of the quad, and analyze in detail the most common case ‐ the unit grid mesh. We show that the generalization, when combined with barycentric coordinate mappings between the source and target polygons, spawns an entire family of new mappings governed by quadratic energy functions, which allow to control quite precisely various effects of the mapping. This approach is quite general and applies also to arbitrary planar polygon meshes. As an application of generalized ASAP mappings of the unit grid mesh, we demonstrate how they can be used to warp digital photographs to achieve a variety of effects. One such effect is modifying the perspective of the camera that took a given photograph (without moving the camera). A related, but more challenging, effect is re‐photography ‐ warping a contemporary photograph in order to reproduce the camera view present in a vintage photograph of the same scene ‐ taken many years before with a different camera from a different viewpoint. We apply the generalized ASAP mapping to these images, discretized to a unit grid. Using a quad mesh (as opposed to a triangle mesh) permits biasing towards affine maps of the unit squares. This allows the introduction of an As‐Affine‐As‐Possible (AAAP) mapping for a good approximation of the homographies present in these warps, achieving quite accurate results. We demonstrate the advantages of the AAAP mapping on a variety of synthetic and real‐world examples.     

User‐Assisted Video Stabilization

We present a user‐assisted video stabilization algorithm that is able to stabilize challenging videos when state‐of‐the‐art automatic algorithms fail to generate a satisfactory result. Current methods do not give the user any control over the look of the final result. Users either have to accept the stabilized result as is, or discard it should the stabilization fail to generate a smooth output. Our system introduces two new modes of interaction that allow the user to improve the unsatisfactory stabilized video. First, we cluster tracks and visualize them on the warped video. The user ensures that appropriate tracks are selected by clicking on track clusters to include or exclude them. Second, the user can directly specify how regions in the output video should look by drawing quadrilaterals to select and deform parts of the frame. These user‐provided deformations reduce undesirable distortions in the video. Our algorithm then computes a stabilized video using the user‐selected tracks, while respecting the user‐modified regions. The process of interactively removing user‐identified artifacts can sometimes introduce new ones, though in most cases there is a net improvement. We demonstrate the effectiveness of our system with a variety of challenging hand held videos.     

Clever Support: Efficient Support Structure Generation for Digital Fabrication

We introduce an optimization framework for the reduction of support structures required by 3D printers based on Fused Deposition Modeling (FDM) technology. The printers need to connect overhangs with the lower parts of the object or the ground in order to print them. Since the support material needs to be printed first and discarded later, optimizing its volume can lead to material and printing time savings. We present a novel, geometry‐based approach that minimizes the support material while providing sufficient support. Using our approach, the input 3D model is first oriented into a position with minimal area that requires support. Then the points in this area that require support are detected. For these points the supporting structure is progressively built while attempting to minimize the overall length of the support structure. The resulting structure has a tree‐like shape that effectively supports the overhangs. We have tested our algorithm on the MakerBot® Replicator? 2 printer and we compared our solution to the embedded software solution in this printer and to Autodesk® Meshmixer? software. Our solution reduced printing time by an average of 29.4% (ranging from 13.9% to 49.5%) and the amount of material by 40.5% (ranging from 24.5% to 68.1%).     

Semi‐Automatic Editing of Graphs with Customized Layouts

Usually visualization is applied to gain insight into data. Yet consuming the data in form of visual representation is not always enough. Instead, users need to edit the data, preferably through the same means used to visualize them. In this work, we present a semi‐automatic approach to visual editing of graphs. The key idea is to use an interactive EditLens that defines where an edit operation affects an already customized and established graph layout. Locally optimal node positions within the lens and edge routes to connected nodes are calculated according to different criteria. This spares the user much manual work, but still provides sufficient freedom to accommodate application‐dependent layout constraints. Our approach utilizes the advantages of multi‐touch gestures, and is also compatible with classic mouse and keyboard interaction. Preliminary user tests have been conducted with researchers from bio‐informatics who need to manually maintain a slowly, but constantly growing molecular network. As the user feedback indicates, our solution significantly improves the editing procedure applied so far.     

Evaluating 2D Flow Visualization Using Eye Tracking

Flow visualization is recognized as an essential tool for many scientific research fields and different visualization approaches are proposed. Several studies are also conducted to evaluate their effectiveness but these studies rarely examine the performance from the perspective of visual perception. In this paper, we aim at exploring how users’ visual perception is influenced by different 2D flow visualization methods. An eye tracker is used to analyze users’ visual behaviors when they perform the free viewing, advection prediction, flow feature detection, and flow feature identification tasks on the flow field images generated by different visualizations methods. We evaluate the illustration capability of five representative visualization algorithms. Our results show that the eye‐tracking‐based evaluation provides more insights to quantitatively analyze the effectiveness of these visualization methods.     

GEMSe: Visualization‐Guided Exploration of Multi‐channel Segmentation Algorithms

We present GEMSe, an interactive tool for exploring and analyzing the parameter space of multi‐channel segmentation algorithms. Our targeted user group are domain experts who are not necessarily segmentation specialists. GEMSe allows the exploration of the space of possible parameter combinations for a segmentation framework and its ensemble of results. Users start with sampling the parameter space and computing the corresponding segmentations. A hierarchically clustered image tree provides an overview of variations in the resulting space of label images. Details are provided through exemplary images from the selected cluster and histograms visualizing the parameters and the derived output in the selected cluster. The correlation between parameters and derived output as well as the effect of parameter changes can be explored through interactive filtering and scatter plots. We evaluate the usefulness of GEMSe through expert reviews and case studies based on three different kinds of datasets: A synthetic dataset emulating the combination of 3D X‐ray computed tomography with data from K‐Edge spectroscopy, a three‐channel scan of a rock crystal acquired by a Talbot‐Lau grating interferometer X‐ray computed tomography device, as well as a hyperspectral image.     

Radiometric Transfer: Example‐based Radiometric Linearization of Photographs

We present an example‐based approach for radiometrically linearizing photographs that takes as input a radiometrically linear exemplar image and a target regular uncalibrated image of the same scene, possibly from a different viewpoint and/or under different lighting. The output of our method is a radiometrically linearized version of the target image. Modeling the change in appearance of a small image patch seen from a different viewpoint and/or under different lighting as a linear 1D subspace, allows us to recast radiometric transfer in a form similar to classic radiometric calibration from exposure stacks. The resulting radiometric transfer method is lightweight and easy to implement. We demonstrate the accuracy and validity of our method on a variety of scenes.     

Visualizing Probabilistic Multi‐Phase Fluid Simulation Data using a Sampling Approach

Eulerian Method of Moment (MoM) solvers are gaining popularity for multi‐phase CFD simulation involving bubbles or droplets in process engineering. Because the actual positions of bubbles are uncertain, the spatial distribution of bubbles is described by scalar fields of moments, which can be interpreted as probability density functions. Visualizing these simulation results and comparing them to physical experiments is challenging, because neither the shape nor the distribution of bubbles described by the moments lend themselves to visual interpretation. In this work, we describe a visualization approach that provides explicit instances of the bubble distribution and produces bubble geometry based on local flow properties. To facilitate animation, the instancing of the bubble distribution provides coherence over time by advancing bubbles between time steps and updating the distribution. Our approach provides an intuitive visualization and enables direct visual comparison of simulation results to physical experiments.