Using linked volumes to model object collisions, deformation,cutting, carving, and joining

In volume graphics, objects are represented by arrays or clusters of sampled 3D data. A volumetric object representation is necessary in computer modeling whenever interior structure affects an object's behavior or appearance. However, existing volumetric representations are not sufficient for modeling the behaviors expected in applications such as surgical simulation, where interactions between both rigid and deformable objects and the cutting, tearing, and repairing of soft tissues must be modeled in real time. Three-dimensional voxel arrays lack the sense of connectivity needed for complex object deformation, while finite element models and mass-spring systems require substantially reduced geometric resolution for interactivity and they can not be easily cut or carved interactively. This paper discusses a linked volume representation that enables physically realistic modeling of object interactions such as: collision detection, collision response, 3D object deformation, and interactive object modification by carving, cutting, tearing, and joining. The paper presents a set of algorithms that allow interactive manipulation of linked volumes that have more than an order of magnitude more elements and considerably more flexibility than existing methods. Implementation details, results from timing tests, and measurements of material behavior are presented     

Enabling design and interactive selection of haptic modes

The ever increasing size and complexity of volumetric data in a wide range of disciplines makes it useful to augment volume visualization tools with alternative modalities. Studies have shown that introducing haptics can significantly increase both exploration speed and precision. It is also capable of conveying material properties of data and thus has great potential to improve user performance in volume data exploration. In this paper we describe how recent advances in volume haptics can be used to build haptic modes—building blocks for haptic schemes. These modes have been used as base components of a toolkit allowing for more efficient development of haptic prototypes and applications. This toolkit allows interactive construction, configuration and fine-tuning of both visual and haptic representations of the data. The technology is also used in a pilot study to determine the most important issues and aspects in haptic volume data interaction and exploration, and how the use of haptic modes can facilitate the implementation of effective haptic schemes.     

Interactive Volume Rendering with Dynamic Ambient Occlusion and Color Bleeding

We propose a method for rendering volumetric data sets at interactive frame rates while supporting dynamic ambient occlusion as well as an approximation to color bleeding. In contrast to ambient occlusion approaches for polygonal data, techniques for volumetric data sets have to face additional challenges, since by changing rendering parameters, such as the transfer function or the thresholding, the structure of the data set and thus the light interactions may vary drastically. Therefore, during a preprocessing step which is independent of the rendering parameters we capture light interactions for all combinations of structures extractable from a volumetric data set. In order to compute the light interactions between the different structures, we combine this preprocessed information during rendering based on the rendering parameters defined interactively by the user. Thus our method supports interactive exploration of a volumetric data set but still gives the user control over the most important rendering parameters. For instance, if the user alters the transfer function to extract different structures from a volumetric data set the light interactions between the extracted structures are captured in the rendering while still allowing interactive frame rates. Compared to known local illumination models for volume rendering our method does not introduce any substantial rendering overhead and can be integrated easily into existing volume rendering applications. In this paper we will explain our approach, discuss the implications for interactive volume rendering and present the achieved results.     

A model for volume lighting and modeling

Direct volume rendering is a commonly used technique in visualization applications. Many of these applications require sophisticated shading models to capture subtle lighting effects and characteristics of volumetric data and materials. For many volumes, homogeneous regions pose problems for typical gradient-based surface shading. Many common objects and natural phenomena exhibit visual quality that cannot be captured using simple lighting models or cannot be solved at interactive rates using more sophisticated methods. We present a simple yet effective interactive shading model which captures volumetric light attenuation effects that incorporates volumetric shadows, an approximation to phase functions, an approximation to forward scattering, and chromatic attenuation that provides the subtle appearance of translucency. We also present a technique for volume displacement or perturbation that allows realistic interactive modeling of high frequency detail for both real and synthetic volumetric data.     

"智能剪刀"在体数据切割中的应用

在二维图像分割中，“智能剪刀”是一种非常用的交互方法。     

Relation-aware volume exploration pipeline

Volume exploration is an important issue in scientific visualization. Research on volume exploration has been focused on revealing hidden structures in volumetric data. While the information of individual structures or features is useful in practice, spatial relations between structures are also important in many applications and can provide further insights into the data. In this paper, we systematically study the extraction, representation, exploration, and visualization of spatial relations in volumetric data and propose a novel relation-aware visualization pipeline for volume exploration. In our pipeline, various relations in the volume are first defined and measured using region connection calculus (RCC) and then represented using a graph interface called relation graph. With RCC and the relation graph, relation query and interactive exploration can be conducted in a comprehensive and intuitive way. The visualization process is further assisted with relation-revealing viewpoint selection and color and opacity enhancement. We also introduce a quality assessment scheme which evaluates the perception of spatial relations in the rendered images. Experiments on various datasets demonstrate the practical use of our system in exploratory visualization.     

Interactive display of isosurfaces with global illumination

In many applications, volumetric data sets are examined by displaying isosurfaces, surfaces where the data, or some function of the data, takes on a given value. Interactive applications typically use local lighting models to render such surfaces. This work introduces a method to precompute or lazily compute global illumination to improve interactive isosurface renderings. The precompiled illumination resides in a separate volume and includes direct light, shadows, and intersections. Using this volume, interactive globally illuminated renderings of isosurfaces become feasible while still allowing dynamic manipulation of lighting, viewpoint and isovalue.     

Gradient field based inhomogeneous volumetric mesh deformation for maxillofacial surgery simulation

This paper presents a novel inhomogeneous volumetric mesh deformation approach by gradient field manipulation, and uses it for maxillofacial surgery simulation. The study is inspired by the state-of-the-art surface deformation techniques based on differential representations. Working in the volumetric domain instead of on only the surface can preserve the volumetric details much better, avoid local self-intersections, and achieve better deformation propagation because of the internal mesh connections. By integrating the mesh cell material stiffness parameter into our new discrete volumetric Laplacian operator, it is very convenient to incorporate inhomogeneous materials into the deformation framework. In addition, the system matrix for solving the volumetric harmonic field to handle the local transformation problem is the same used for Poisson reconstruction equation, thus it requires solving essentially only one global linear system. The system is easy to use, and can accept explicit rotational constraints, or only translational constraints to drive the deformation. One typical maxillofacial surgery case was simulated by the new methodology with inhomogeneous material estimated directly from CT data, and compared to the commonly used finite element method (FEM) approach. The results demonstrated that the deformation methodology achieved good accuracy, as well as interactive performance. Therefore, the usage of our volumetric mesh deformation approach is relevant and suitable for daily clinical practice.     

Efficient Volumetric PolyCube‐Map Construction

PolyCubes provide compact representations for closed complex shapes and are essential to many computer graphics applications. Existing automatic PolyCube construction methods usually suffer from poor quality or time‐consuming computation. In this paper, we provide a highly efficient method to compute volumetric PolyCube‐maps. Given an input tetrahedral mesh, we utilize two novel normal‐driven volumetric deformation schemes and a polycube‐allowable mesh segmentation to drive the input to a volumetric PolyCube structure. Our method can robustly generate foldover‐free and low‐distortion PolyCube‐maps in practice, and provide a flexible control on the number of corners of Polycubes. Compared with state‐of‐the‐art methods, our method is at least one order of magnitude faster and has better mapping qualities. We demonstrate the efficiency and efficacy of our method in PolyCube construction and all‐hexahedral meshing on various complex models.     

Direct volume manipulation for visualizing intraoperative liver resection process

This paper introduces a new design and application for direct volume manipulation for visualizing the intraoperative liver resection process. So far, interactive volume deformation and resection have been independently handled due to the difficulty of representing elastic behavior of volumetric objects. Our framework models global shape editing and discontinuous local deformation by merging proxy geometry encoding and displacement mapping. A local-frame-based elastic model is presented to allow stable editing of the liver shape including bending and twisting while preserving the volume. Several tests using clinical CT data have confirmed the developed software and interface can represent the intraoperative state of liver and produce local views of reference vascular structures, which provides a “road map of vessels” that are key features when approaching occluded tumors during surgery.     

RETRACTED ARTICLE: Texture-guided volumetric deformation and visualization using 3D moving least squares

Examining and manipulating the large volumetric data attract great interest for various applications. For such purpose, we first extend the 2D moving least squares (MLS) technique into 3D, and propose a texture-guided deformation technique for creating visualization styles through interactive manipulations of volumetric models using 3D MLS. Our framework includes focus+context (F+C) visualization for simultaneously showing the entire model after magnification, and the cut-away or illustrative visualization for providing a better understanding of anatomical and biological structures. Both visualization styles are widely applied in the graphics areas. We present a mechanism for defining features using high-dimensional texture information, and design an interface for visualizing, selecting and extracting features/objects of interest. Methods of the interactive or automatic generation of 3D control points are proposed for the flexible and plausible deformation. We describe a GPU-based implementation to achieve real-time performance of the deformation techniques and the manipulation operators. Different from physical deformation models, our framework is goal-oriented and user-guided. We demonstrate the robustness and efficiency of our framework using various volumetric datasets.     

Feature-preserving volume data reduction and focus+context visualization

The growing sizes of volumetric data sets pose a great challenge for interactive visualization. In this paper, we present a feature-preserving data reduction and focus+context visualization method based on transfer function driven, continuous voxel repositioning and resampling techniques. Rendering reduced data can enhance interactivity. Focus+context visualization can show details of selected features in context on display devices with limited resolution. Our method utilizes the input transfer function to assign importance values to regularly partitioned regions of the volume data. According to user interaction, it can then magnify regions corresponding to the features of interest while compressing the rest by deforming the 3D mesh. The level of data reduction achieved is significant enough to improve overall efficiency. By using continuous deformation, our method avoids the need to smooth the transition between low and high-resolution regions as often required by multiresolution methods. Furthermore, it is particularly attractive for focus+context visualization of multiple features. We demonstrate the effectiveness and efficiency of our method with several volume data sets from medical applications and scientific simulations.     

Boundary‐Aware Extinction Mapping

We introduce Boundary‐Aware Extinction Maps for interactive rendering of massive heterogeneous volumetric datasets. Our approach is based on the projection of the extinction along light rays into a boundary‐aware function space, focusing on the most relevant sections of the light paths. This technique also provides an alternative representation of the set of participating media, allowing scattering simulation methods to be applied on arbitrary volume representations. Combined with a simple out‐of‐core rendering framework, Boundary‐Aware Extinction Maps are valuable tools for interactive applications as well as production previsualization and rendering.     

Freeform Shape Representations for Efficient Geometry Processing

The most important concepts for the handling and storage of freeform shapes in geometry processing applications are parametric representations and volumetric representations. Both have their specific advantages and drawbacks. While the algebraic complexity of volumetric representations is independent from the shape complexity, the domain of a parametric representation usually has to have the same structure as the surface itself (which sometimes makes it necessary to update the domain when the surface is modified). On the other hand, the topology of a parametrically defined surface can be controlled explicitly while in a volumetric representation, the surface topology can change accidentally during deformation. A volumetric representation reduces distance queries or inside/outside tests to mere function evaluations but the geodesic neighborhood relation between surface points is difficult to resolve. As a consequence, it seems promising to combine parametric and volumetric representations to effectively exploit both advantages. In this talk, a number of projects are presented and discussed in which such a combination leads to efficient and numerically stable algorithms for the solution of various geometry processing tasks. Applications include global error control for mesh decimation and smoothing, topology control for level‐set surfaces, and shape modeling with unstructured point clouds.     

A Survey of Volumetric Illumination Techniques for Interactive Volume Rendering

Interactive volume rendering in its standard formulation has become an increasingly important tool in many application domains. In recent years several advanced volumetric illumination techniques to be used in interactive scenarios have been proposed. These techniques claim to have perceptual benefits as well as being capable of producing more realistic volume rendered images. Naturally, they cover a wide spectrum of illumination effects, including varying shading and scattering effects. In this survey, we review and classify the existing techniques for advanced volumetric illumination. The classification will be conducted based on their technical realization, their performance behaviour as well as their perceptual capabilities. Based on the limitations revealed in this review, we will define future challenges in the area of interactive advanced volumetric illumination.     

Interactive transfer function design based on editing direct volume rendered images

Direct volume rendered images (DVRIs) have been widely used to reveal structures in volumetric data. However, DVRIs generated by many volume visualization techniques can only partially satisfy users' demands. In this paper, we propose a framework for editing DVRIs, which can also be used for interactive transfer function (TF) design. Our approach allows users to fuse multiple features in distinct DVRIs into a comprehensive one, to blend two DVRIs, and/or to delete features in a DVRI. We further present how these editing operations can generate smooth animations for focus + context visualization. Experimental results on some real volumetric data demonstrate the effectiveness of our method.     

A Directional Occlusion Shading Model for Interactive Direct Volume Rendering

Volumetric rendering is widely used to examine 3D scalar fields from CT/MRI scanners and numerical simulation datasets. One key aspect of volumetric rendering is the ability to provide perceptual cues to aid in understanding structure contained in the data. While shading models that reproduce natural lighting conditions have been shown to better convey depth information and spatial relationships, they traditionally require considerable (pre)computation. In this paper, a shading model for interactive direct volume rendering is proposed that provides perceptual cues similar to those of ambient occlusion, for both solid and transparent surface-like features. An image space occlusion factor is derived from the radiative transport equation based on a specialized phase function. The method does not rely on any precomputation and thus allows for interactive explorations of volumetric data sets via on-the-fly editing of the shading model parameters or (multi-dimensional) transfer functions while modifications to the volume via clipping planes are incorporated into the resulting occlusion-based shading.     

Extinction-based shading and illumination in GPU volume ray-casting

Direct volume rendering has become a popular method for visualizing volumetric datasets. Even though computers are continually getting faster, it remains a challenge to incorporate sophisticated illumination models into direct volume rendering while maintaining interactive frame rates. In this paper, we present a novel approach for advanced illumination in direct volume rendering based on GPU ray-casting. Our approach features directional soft shadows taking scattering into account, ambient occlusion and color bleeding effects while achieving very competitive frame rates. In particular, multiple dynamic lights and interactive transfer function changes are fully supported. Commonly, direct volume rendering is based on a very simplified discrete version of the original volume rendering integral, including the development of the original exponential extinction into a-blending. In contrast to a-blending forming a product when sampling along a ray, the original exponential extinction coefficient is an integral and its discretization a Riemann sum. The fact that it is a sum can cleverly be exploited to implement volume lighting effects, i.e. soft directional shadows, ambient occlusion and color bleeding. We will show how this can be achieved and how it can be implemented on the GPU.     

Sparse GPU Voxelization of Yarn‐Level Cloth

Most popular methods in cloth rendering rely on volumetric data in order to model complex optical phenomena such as sub‐surface scattering. These approaches are able to produce very realistic illumination results, but their volumetric representations are costly to compute and render, forfeiting any interactive feedback. In this paper, we introduce a method based on the Graphics Processing Unit (GPU) for voxelization and visualization, suitable for both interactive and offline rendering. Recent features in the OpenGL model, like the ability to dynamically address arbitrary buffers and allocate bindless textures, are combined into our pipeline to interactively voxelize millions of polygons into a set of large three‐dimensional (3D) textures (>10⁹ elements), generating a volume with sub‐voxel accuracy, which is suitable even for high‐density woven cloth such as linen.     

An approach to integrating shape and biomedical attributes in vascular models

Computational models have been used widely in tissue engineering research and have proven to be powerful tools for bio-mechanical analysis (i.e., blood flow, growth models, drug delivery, etc). This paper focuses on developing higher-fidelity models for vascular structures and blood vessels that integrate computational shape representations with biomedical properties and features. Previous work in computer-aided vascular modeling comes from two communities. For those in biomedical imaging, the goal of past research has been to develop image understanding techniques for the interpretation of x-ray, magnetic resonance imaging (MRI), or other radiological data. These representations are predominantly discrete shape models that are not tied to physiological properties. The other corpus of existing work comes from those interested in developing physiological models for vascular growth and behavior based on bio-medical attributes. These models usually either have a highly simplified shape representation, or lack one entirely. Further, neither of these representations are suitable for the kind of interactive modeling required by tissue engineering applications.This paper aims to bridge these two approaches and develop a set of mathematical tools and algorithms for feature-based representation and computer-aided modeling of vascular trees for use in computer-aided tissue engineering applications. The paper offers a multi-scale representation based on swept volumes and a feature-based representation that can attribute the geometric representation with information about blood flow, pressure, and other biomedical properties. The paper shows how the resulting representation can be used as part of an overall approach for designing and visualizing vascular scaffolds. As a real-world example, we show how this computational model can be used to develop a tissue scaffold for liver tissue engineering. Such scaffolds may prove useful in a number of biomedical applications, including the growth of replacement tissue grafts and in vitro study of the pharmacological affects of new drugs on tissue cultures.