Three-dimensional surface reconstruction from multistatic SAR images

This paper discusses reconstruction of three-dimensional surfaces from multiple bistatic synthetic aperture radar (SAR) images. Techniques for surface reconstruction from multiple monostatic SAR images already exist, including interferometric processing and stereo SAR. We generalize these methods to obtain algorithms for bistatic interferometric SAR and bistatic stereo SAR. We also propose a framework for predicting the performance of our multistatic stereo SAR algorithm, and, from this framework, we suggest a metric for use in planning strategic deployment of multistatic assets.     

基于27邻域网格的医疗图像三维重建

为实现医疗图像三维重建中的网格简化,提出一种基于27邻域网格建立三角形网格拓扑的新方法。首先利用移动立方体(MC)算法从一组计算机层析(CT)图像序列中提取三维重建体数据,将二维图像转化为由一组三角形面片组成的三维模型网;然后利用27邻域网格算法对此三角形网进行空间扫描,构建出三维模型的网格拓扑;最后利用二次误差测度(QEM)算法对所得三维模型拓扑进行简化,实现医疗图像三维模型动态可视化操作。通过使用Visual C++软件平台和OPENGL库对医疗图像进行三维重建,重建效果表明,本文方法的计算效率要优于传统的循环迭代方法;与传统的建立网格拓扑方法相比,本文方法具有算法简单、速度快、运算复杂度与数据量呈线性增长的优点。     

Automated 3-D reconstruction of the surface of live early-stage amphibian embryos

Although three-dimensional (3-D) reconstructions of the surfaces of live embyos are vital to understanding embryo development, morphogenetic tissue movements and other factors have prevented the automation of this task. Here, we report an integrated set of software algorithms that overcome these challenges, making it possible to completely automate the reconstruction of embryo surfaces and other textured surfaces from multiview images. The process involves: 1) building accurate point correspondences using a robust deformable template block matching algorithm; 2) removing outliers using fundamental matrix calculations in conjunction with a RANSAC algorithm; 3) generating 3-D point clouds using a bundle adjustment algorithm that includes camera position and distortion corrections; 4) meshing the point clouds into triangulated surfaces using a Tight Cocone algorithm that produces water tight models; 5) refining surfaces using midpoint insertion and Laplacian smoothing algorithms; and 6) repeating these steps until a measure of convergence G, the rms difference between successive reconstructions, is below a specified threshold. Reconstructions were made of 2.2-mm diameter, neurulation-stage axolotl (amphibian) embryos using 44 multiview images collected with a robotic microscope. A typical final model (sixth iteration) contained 3787 points and 7562 triangles and had an error measure of G = 5.9 microm.     

Fast progressive reconstruction of images using the DCT

Fast progressive reconstruction (FPR) of images based on discrete Fourier transform (DFT) and Walsh-Hadamard transform (WHT) has been developed by Takikawa [3]. This technique is now extended to the discrete cosine transform (DCT). The quality of reconstructed images during the intermediate stages based on these transforms is analyzed. This comparison is both subjective and objective. The feasibility of the DCT in this FPR scheme is discussed.This paper is based on part of the research carried out by M. Miran toward his M.Sc. Thesis at the University of Texas at Arlington. It was also presented at the Fifth European Signal Processing Conference, Barcelona, September 18–21, 1990.     

Three-dimensional reconstruction using homocentric spherical spatiotemporal image analysis

This paper presents a new algorithm for reconstructing a scene of three-dimensional structures from an image sequence. Three-dimensional reconstruction using an image sequence, called the spatiotemporal image method, is robust against image noises. But in this method, camera motion is limited to only one direction translation. Our algorithm makes allowances for camera rotation in spatiotemporal image analysis. With this technique, the whole spatiotemporal image is transformed to spherical projection and three-dimensional structures are determined robustly using the Hough transformation. We call the technique Homocentric Spherical Spatiotemporal Image (HSSI) analysis. With HSSI, it is possible to distinguish objects with a rotating camera from a longer baseline and to measure them with much greater accuracy than previously possible. This algorithm is demonstrated through simulations and experiments with real images from a translating and rotating camera, and the three-dimensional structures in a static scene are reconstructed.     

Three-dimensional surface reconstruction using optical flow formedical imaging

The recovery of a three-dimensional (3-D) model from a sequence of two-dimensional (2-D) images is very useful in medical image analysis. Image sequences obtained from the relative motion between the object and the camera or the scanner contain more 3-D information than a single image. Methods to visualize the computed tomograms can be divided into two approaches: the surface rendering approach and the volume rendering approach. In this paper, a new surface rendering method using optical flow is proposed. Optical flow is the apparent motion in the image plane produced by the projection of real 3-D motion onto the 2-D image. The 3-D motion of an object can be recovered from the optical-flow field using additional constraints. By extracting the surface information from 3-D motion, it is possible to obtain an accurate 3-D model of the object. Both synthetic and real image sequences have been used to illustrate the feasibility of the proposed method. The experimental results suggest that the proposed method is suitable for the reconstruction of 3-D models from ultrasound medical images as well as other computed tomograms     

Three-dimensional tumor perfusion reconstruction using fractal interpolation functions

It has been shown that the perfusion of blood in tumor tissue can be approximated using the relative perfusion index determined from dynamic contrast-enhanced magnetic resonance imaging (DE-MRI) of the tumor blood pool. Also, it was concluded in a previous report that the blood perfusion in a two-dimensional (2-D) tumor vessel network has a fractal structure and that the evolution of the perfusion front can be characterized using invasion percolation. In this paper, the three-dimensional (3-D) tumor perfusion is reconstructed from the 2-D slices using the method of fractal interpolation functions (FIF), i.e., the piecewise self-affine fractal interpolation model (PSAFIM) and the piecewise hidden variable fractal interpolation model (PHVFIM). The fractal models are compared to classical interpolation techniques (linear, spline, polynomial) by means of determining the 2-D fractal dimension of the reconstructed slices. Using FIFs instead of classical interpolation techniques better conserves the fractal-like structure of the perfusion data. Among the two FIF methods, PHVFIM conserves the 3-D fractality better due to the cross correlation that exists between the data in the 2-D slices and the data along the reconstructed direction. The 3-D structures resulting from PHVFIM have a fractal dimension within 3%-5% of the one reported in literature for 3-D percolation. It is, thus, concluded that the reconstructed 3-D perfusion has a percolation-like scaling. As the perfusion term from bio-heat equation is possibly better described by reconstruction via fractal interpolation, a more suitable computation of the temperature field induced during hyperthermia treatments is expected.     

Three-dimensional display rendering acceleration using occlusion camera reference images

Volumetric three-dimensional (3-D) displays allow the user to explore a 3-D scene free of joysticks, keyboards, goggles, or trackers. For non-trivial scenes, computing and transferring a 3-D image to the display takes hundreds of seconds, which is a serious bottleneck for many applications. We propose to represent the 3-D scene with an occlusion camera reference image (OCRI). The OCRI is a compact scene representation that stores only and all scene samples that are visible from a viewing volume centered at a reference viewpoint. The OCRI enables computing and transferring the 3-D image an order of magnitude faster than when the entire scene is processed. The OCRI approach can be readily applied to several volumetric display technologies; we have tested the OCRI approach with good results on a volumetric display that creates a 3-D image by projecting 2-D scene slices onto a rotating screen.     

Three-dimensional image reconstruction by digital tomo-synthesis using inverse filtering

Conventional X-ray tomosynthesis with film can provide a sagittal slice image with a single scan. This technique has the advantage of enabling reconstruction of a sagittal slice which is difficult to obtain from the X-ray CT system. However, only an image on the focal plane is obtained by a single scan. Furthermore, the image is degraded by superimpositions of the structures outside of the focal plane. A new three-dimensional image reconstruction method is proposed. This method utilizes a three-dimensional convolution process with an inverse filter function which is derived analytically by the point spread function of the projection and backprojection geometry. A digital tomosynthesis system has also been constructed for the purpose of evaluating the proposed method. This system was used in phantom experiments and clinical evaluations, and it was confirmed that the proposed method was able to reconstruct a better three-dimensional image with less artifacts from outside of the focused slice.     

Three-dimensional rotation of mouse embryos

Research and clinical applications, such as microinjection and polar-body biopsy involve 3-D rotation of mammalian oocytes/embryos. In these cell manipulation tasks, the polar body of an embryo/oocyte must be made visible and properly oriented under optical microscopy. Cell rotation in conventional manual operation by skilled professionals is based on trial and error, such as through repeated vacuum aspiration and release. The randomness of this manual procedure, its poor reproducibility, and inconsistency across operators entail a systematic technique for automated, noninvasive, 3-D rotational control of single cells. This paper reports a system that tracks the polar body of mouse embryos in real time and controls multiple motion control devices to conduct automated 3-D rotational control of mouse embryos. Experimental results demonstrated the system's capability for polar-body orientation with a high success rate of 90%, an accuracy of 1.9 °, and an average speed of 22.8 s/cell (versus averagely 40 s/cell in manual operation).     

Three-dimensional reconstruction of transillumination tomographic images of human breast phantoms by red and infrared lasers

A laser transillumination tomographic system, using red and near infrared lasers, to obtain cross-sectional images of human breast phantoms and human hand is proposed. The scanning assembly is consisting of upward, downward, rotational and pitch movements. The phantoms, made of paraffin wax, agar gel, and milk placed in a glass model, are embedded with abnormalities like blood, water, solid objects, and tissues. By illuminating the phantoms at various heights by either red or infrared laser the projection data are collected. Based on 64 projections the tomogram of each section is constructed. By volume visualization procedure applied to the tomograms the objects of varying composition embedded within the phantoms are detected and their size, shape, and location depth are determined. The cross-sectional image of a human hand obtained by this procedure further shows the possibility of application of this technique for imaging of organs.     

Bayesian reconstruction of functional images using anatomical information as priors

Proposes a Bayesian method whereby maximum a posteriori (MAP) estimates of functional (PET and SPECT) images may be reconstructed with the aid of prior information derived from registered anatomical MR images of the same slice. The prior information consists of significant anatomical boundaries that are likely to correspond to discontinuities in an otherwise spatially smooth radionuclide distribution. The authors' algorithm, like others proposed recently, seeks smooth solutions with occasional discontinuities; the contribution here is the inclusion of a coupling term that influences the creation of discontinuities in the vicinity of the significant anatomical boundaries. Simulations on anatomically derived mathematical phantoms are presented. Although computationally intense in its current implication, the reconstructions are improved (ROI-RMS error) relative to filtered backprojection and EM-ML reconstructions. The simulations show that the inclusion of position-dependent anatomical prior Information leads to further improvement relative to Bayesian reconstructions without the anatomical prior. The algorithm exhibits a certain degree of robustness with respect to errors in the location of anatomical boundaries.     

Three-dimensional attenuation map reconstruction using geometrical models and free-form deformations

We address the issue of using deformable models to reconstruct an unknown attenuation map of the torso from a set of transmission scans. We assume the three-dimensional (3-D) distribution of attenuation coefficients to be piecewise uniform. We represent the unknown distribution by a set of closed surfaces defining regions having the same attenuating properties. The methods of reconstruction published so far tend to directly deform the surfaces, the parameters being the surface elements. Rather than deforming the surfaces, we explore the possibility of deforming the space in which the geometrical primitives are contained. We focus on the use of free-form deformations (FFD's) to describe the continuous transformation of space used to match a set of transmission measurements. We illustrate this approach by reconstructing realistically simulated transmission scans of the torso with various noise levels and compare the results to standard reconstruction methods.     

Efficient reconstruction of compressively sensed images and videos using non-iterative method

Compressed sensing is widely applied for compression and reconstruction of images and videos by projecting the pixel values to smaller dimensional measurements. These measurements are reconstructed at the receiver using various reconstruction procedures. Greedy algorithms are often used for such recovery. These solve the least squares problem to find the best match with minimum error. This is a time consuming and complex process, giving rise to a trade-off between reconstruction performance and algorithmic performance. This work proposes a non-iterative method, viz., non-iterative pseudo inverse based recovery algorithm (NIPIRA), for reconstruction of compressively sensed images and videos with small complexity and time consumption, provided the reconstruction quality is maintained. NIPIRA gives a minimum PSNR of 32 dB for very few measurements (M/N = 0.3125) and accuracy of above 97%. There is more than 92% of decrease in elapsed time compared with other iterative algorithms. NIPIRA is tested for its performance with respect to many other objective measures as well. The complexity of NIPIRA is s times less than existing recovery algorithms.     

Attenuation compensation of cone beam SPECT images using maximum likelihood reconstruction

Attenuation compensation for cone beam single-photon emission computed tomography (SPECT) imaging is performed by cone beam maximum likelihood reconstruction with attenuation included in the transition matrix. Since the transition matrix is too large to be stored in conventional computers, the E-M maximum likelihood estimator is implemented with a ray-tracing algorithm, efficiently recalculating each matrix element as needed. The method was applied and tested in both uniform and nonuniform density phantoms. Test projections sets were obtained from Monte Carlo simulations and experiments using a commercially available cone beam collimator. For representative regions of interest. reconstruction of a uniform sphere is accurate to within 3% throughout, in comparison to a reference image simulated and reconstructed without attenuation. High- and low-activity regions in a uniform density are reconstructed accurately, except that low-activity regions in a more active background have a small error. This error is explainable by the nonnegativity constraints of the E-M estimator and the image statistical noise     

Three-dimensional blind deconvolution of SPECT images

Thanks to its ability to yield functionally rather than anatomically-based information, the three-dimensional (3-D) SPECT imagery technique has become a great help in the diagnostic of cerebrovascular diseases. Nevertheless, due to the imaging process, the 3-D single photon emission computed tomography (SPECT) images are very blurred and, consequently, their interpretation by the clinician is often difficult and subjective. In order to improve the resolution of these 3-D images and then to facilitate their interpretation, we propose herein to extend a recent image blind deconvolution technique (called the nonnegativity support constraint-recursive inverse filtering deconvolution method) in order to improve both the spatial and the interslice resolution of SPECT volumes. This technique requires a preliminary step in order to find the support of the object to be restored. In this paper, we propose to solve this problem with an unsupervised 3-D Markovian segmentation technique. This method has been successfully tested on numerous real and simulated brain SPECT volumes, yielding very promising restoration results.     

Expectation maximization reconstruction of positron emissiontomography images using anatomical magnetic resonance information

Using statistical methods the reconstruction of positron emission tomography (PET) images can be improved by high-resolution anatomical information obtained from magnetic resonance (MR) images. The authors implemented two approaches that utilize MR data for PET reconstruction. The anatomical MR information is modeled as a priori distribution of the PET image and combined with the distribution of the measured PET data to generate the a posteriori function from which the expectation maximization (EM)-type algorithm with a maximum a posteriori (MAP) estimator is derived. One algorithm (Markov-GEM) uses a Gibbs function to model interactions between neighboring pixels within the anatomical regions. The other (Gauss-EM) applies a Gauss function with the same mean for all pixels in a given anatomical region. A basic assumption of these methods is that the radioactivity is homogeneously distributed inside anatomical regions. Simulated and phantom data are investigated under the following aspects: count density, object size, missing anatomical information, and misregistration of the anatomical information. Compared with the maximum likelihood-expectation maximization (ML-EM) algorithm the results of both algorithms show a large reduction of noise with a better delineation of borders. Of the two algorithms tested, the Gauss-EM method is superior in noise reduction (up to 50%). Regarding incorrect a priori information the Gauss-EM algorithm is very sensitive, whereas the Markov-GEM algorithm proved to be stable with a small change of recovery coefficients between 0.5 and 3%     

Automated standardization of images of Drosophila embryos

Modeling expression patterns of Drosophila, in space and time, plays a critical role to understand the development of multicellular organisms. In confocal microscopy, to produce precise quantitative data it is frequently necessary to process and analyze large amounts of digital images. Automatic preprocessing is a crucial step in this scenario, essential to standardize significant features such as orientation, size, position, direction, lighting condition and texture of embryo images. Even though a lot of efforts have been made, a robust embryo standardization strategy is still needed. In this paper, we propose the method Embrystandar. It is designed to remove background artifacts and standardize the direction and orientation of a Drosophila embryo through a sequence of automatic operations. To test its potential for large-scale image processing, Embrystandar was applied in different databases. It showed to be robust and precise, reaching more than 90% success rate.     

Three-dimensional myocardial strain reconstruction from tagged MRI using a cylindrical B-spline model

In this paper, we present a new method for reconstructing three-dimensional (3-D) left ventricular myocardial strain from tagged magnetic resonance (MR) image data with a 3-D B-spline deformation model. The B-spline model is based on a cylindrical coordinate system that more closely fits the morphology of the myocardium than previously proposed Cartesian B-spline models and does not require explicit regularization. Our reconstruction method first fits a spatial coordinate B-spline displacement field to the tag line data. This displacement field maps each tag line point in the deformed myocardium back to its reference position (end-diastole). The spatial coordinate displacement field is then converted to material coordinates with another B-spline fit. Finally, strain is computed by analytically differentiating the material coordinate B-spline displacement field with respect to space. We tested our method with strains reconstructed from an analytically defined mathematical left ventricular deformation model and ten human imaging studies. Our results demonstrate that a quadratic cylindrical B-spline with a fixed number of control points can accurately fit a physiologically realistic range of deformations. The average 3-D reconstruction computation time is 20 seconds per time frame on a 450 MHz Sun Ultra80 workstation.