Three-dimensional reconstruction from serial section images by computer graphics

A method is described that allows a three-dimensional object to be reconstructed from micrographs of serial sections by means of computer graphics. The reconstructed object, which can be rotated three-dimensionally, is displayed on a colour visual display unit, and the object is shaded in order to provide an illusion of a three-dimensional structure. Moreover, the technique makes it possible to observe an inner structure as seen through an outer one.     

稀疏点云的曲面重构

为研究曲面重构中的一类特殊数据,针对稀疏点云提出了一种高效、简单、实用的曲面重构方法。首先分析稀疏点云自身特点,按特征进行预处理与分块。然后依次拟合曲线,通过参数化优化与调整,得到适合造型的曲线,并且引入迭代、渐进的思想来弥补部分数据的缺失。最后利用两种典型重构方法分别对不同分块数据进行曲面重构。实例表明,该方法解决了稀疏点云的曲面重构过程中由于点云信息量少造成的重构困难。     

稀疏点云的曲面重构

为研究曲面重构中的一类特殊数据,针对稀疏点云提出了一种高效、简单、实用的曲面重构方法。首先分析稀疏点云自身特点,按特征进行预处理与分块。然后依次拟合曲线,通过参数化优化与调整,得到适合造型的曲线,并且引入迭代、渐进的思想来弥补部分数据的缺失。最后利用两种典型重构方法分别对不同分块数据进行曲面重构。实例表明,该方法解决了稀疏点云的曲面重构过程中由于点云信息量少造成的重构困难。     

Complete 3D surface reconstruction from unstructured point cloud

In this study, a complete 3D surface reconstruction method is proposed based on the concept that the vertices of surface model can be completely matched to the unstructured point cloud. In order to generate the initial mesh model from the point cloud, the mesh subdivision of bounding box and shrink-wrapping algorithm are introduced. The control mesh model for well representing the topology of point cloud is derived from the initial mesh model by using the mesh simplification technique based on the original QEM algorithm, and the parametric surface model for approximately representing the geometry of point cloud is derived by applying the local subdivision surface fitting scheme on the control mesh model. And, to reconstruct the complete matching surface model, the insertion of isolated points on the parametric surface model and the mesh optimization are carried out. Especially, the fast 3D surface reconstruction is realized by introducing the voxel-based nearest-point search algorithm, and the simulation results reveal the availability of the proposed surface reconstruction method.     

Inspection of weld shape based on the shape from shading

The weld bead shape is crucial for weld quality. Automatic inspection on the 3D shape of a weld bead is achieved by recording the image of the weld bead with an optical sensing method and then calculating the 3D shape parameters with a shape-from-shading technology based on a single image in the computer-vision domain. The paper first introduces a method of shape from shading based on a single image and puts forward its implementation. It then presents the improved measures of the original algorithm according to the defects of the computed results and finds accuracy compared with the former method by a synthetic image. Finally, the improved algorithm is applied to the surface height reconstruction of weld bead successfully .     

A fast triangulation algorithm for 3D reconstruction from planar contours

Aiming at the reconstruction of medical images, a fast triangulation algorithm from planar contours (FTA) is proposed in this paper. In FTA, the judgment of the similarity of counters is carried out at first. Then a traditional global optimisation method is applied to triangulating dissimilar counters. A simple local optimisation method is also applied on areas enveloped by line sections of similar counters. Through theoretical analysis and experience, the visual effect of FTA becomes approximately similar to traditional global optimisation methods and its calculating speed is much improved simultaneously. FTA was also applied to a stereo tactical radiation therapy planning system for a gamma knife (SRTPS) developed by the authors.     

蒙皮理论在汽车覆盖件曲面重建中的应用

基于常规建模方法在汽车覆盖件曲面逆向造型中由数据点云很难构造出合适的A级曲面问题。文章在结合国内外学者得出的算法基础上,结合神经网络的优化提出了一种新的曲面造型方法,即NURBS曲面算法蒙皮造型方法。并在CFD仿真分析软件STAR-CCM中对整个车身进行外流场的数值模拟,通过对常规造型和蒙皮造型的数值模拟计算结果进行对比知:后者比前者在阻力系数上降低4.21%;升力系数降低1.69%;俯仰系数降低0.09%。该数据表明蒙皮造型方法能有效降低整车风阻确实提高了整车的动力性和其适用性。     

Shape reconstruction, shape manipulation, and direct generation of input data from point clouds for rapid prototyping

Shape reconstruction from point clouds has received considerable attention in recent years on account of its ability to directly integrate reverse engineering with rapid prototyping. The primary objective of this study is to develop an integrated system that enables one to generate input data for rapid prototyping by constructing complete shape models from point clouds obtained with various measuring devices, including laser scanners, digitizers, and coordinate-measuring machines. We first present a novel approach to reconstructing a shape from point clouds based on implicit surface interpolation combined with domain decomposition. We then propose various related algorithms for generating input data for rapid prototyping, ranging from shape manipulation to complete solid generation. The validity of this new technique is demonstrated for a variety of point clouds with differing degrees of complexity.     

Three-dimensional volume reconstruction of extracellular matrix proteins in uveal melanoma from fluorescent confocal laser scanning microscope images

The distribution of looping patterns of laminin in uveal melanomas and other tumours has been associated with adverse outcome. Moreover, these patterns are generated by highly invasive tumour cells through the process of vasculogenic mimicry and are not therefore blood vessels. Nevertheless, these extravascular matrix patterns conduct plasma. The three‐dimensional (3D) configuration of these laminin‐rich patterns compared with blood vessels has been the subject of speculation and intensive investigation. We have developed a method for the 3D reconstruction of volume for these extravascular matrix proteins from serial paraffin sections cut at 4 µm thicknesses and stained with a fluorescently labelled antibody to laminin ( Maniotis et al., 2002 ). Each section was examined via confocal laser‐scanning focal microscopy (CLSM) and 13 images were recorded in the Z‐dimension for each slide. The input CLSM imagery is composed of a set of 3D subvolumes (stacks of 2D images) acquired at multiple confocal depths, from a sequence of consecutive slides. Steps for automated reconstruction included (1) unsupervised methods for selecting an image frame from a subvolume based on entropy and contrast criteria, (2) a fully automated registration technique for image alignment and (3) an improved histogram equalization method that compensates for spatially varying image intensities in CLSM imagery due to photo‐bleaching. We compared image alignment accuracy of a fully automated method with registration accuracy achieved by human subjects using a manual method. Automated 3D volume reconstruction was found to provide significant improvement in accuracy, consistency of results and performance time for CLSM images acquired from serial paraffin sections.     

Three-dimensional computer reconstruction of large tissue volumes based on composing series of high-resolution confocal images by GlueMRC and LinkMRC software

Computer-based visualization of large tissue volumes with high resolution based on composing series of high-resolution confocal images is presented. GlueMRC and LinkMRC programs are introduced, implementing composition of overlapping series of optical sections captured by a confocal microscope, registration and subsequent composition of successive confocal stacks. Both programs are using an interactive approach in combination with automatic algorithms for image registration. Further, the method for obtaining surface renderings of microscopical structure under study is described. For this purpose, structure contours visible in the sections are interactively digitized using a Colon plug-in module running in Ellipse environment. Then the coordinates of the contours are processed by special modules in the graphic programming environment IRIS Explorer and the structure surface is rendered. The method is shown on the 3-D reconstruction of the capillary bed of human placental villi and chick embryonic gut and its vascular bed.     

Reconstruction from stereo and multiple tilt electron microscope images of thick sections of embedded biological specimens using computer graphic methods

The extraction and display of 3-D information using modern computer graphic equipment in the electron microscope is presented. Thick specimens were imaged at 400 kV. Modelling of vectors and the tilting of surfaces is discussed as is the accuracy of reconstructions.     

Evaluating the role of particle distribution and shape in two-body abrasion by statistical simulation

Previous work suggests that particle shape—specifically, its variation with particle size—is unlikely to be the dominant cause of the particle size effect (PSE) encountered in abrasion. In theory, the statistically similar nature of particle geometry implies that wear rate in two-body abrasion should be independent of particle size when all other conditions are unchanged and boundary effects are negligible. In practice, however, the severity of wear can be influenced substantially by the cumulative effect of relatively small variations of each governing factor. This paper deals with numerous issues related to the shape of abrasive particles and surfaces, with the view of understanding how shape contributes to wear and the manifestation of the PSE. It has been discovered, for example, that among the various solids of revolution used in the past to model the asperities of particles, the most representative possesses a power-law generatrix. Particle shape alone, however, constitutes a modest part in determining the properties of abrasive tools, such as grinding wheels and abrasive coated paper. Consequently, the density and distribution of the particles on the surface must also be given due consideration. To this end a statistical simulation of two-body abrasion has been developed. The effects of varying asperity shape and distribution on wear rate are clearly demonstrated and compared to results obtained from two-body experiments.     

Three-dimensional morphometry in scanning electron microscopy: a technique for accurate dimensional and angular measurements of microstructures using stereopaired digitized images and digital image analysis

A method for accurate dimensional and angular measurements of microstructures analysed in the scanning electron microscope is described. The method considers central and parallel projections and involves (a) digital image acquisition of stereopaired images from the scanning electron microscope's photodisplay, (b) generation of 3D-image representations, (c) setting of measuring points in the digitized stereopaired images, (d) computation of exact space coordinates ( x / y / z ) from the corresponding point coordinates ( x _L/ y _L; x _R/ y _R), (e) determination of distances and angles between consecutive corresponding points using vector equations, and (f) transfer of computed data into spreadsheets of the data analysis software using dynamic data exchange with simultaneous graphical display of the frequency distribution of variables.
Measurements performed on specimens with known dimensions (grid with 10 μm wide square meshes, polystyrene beads with 0.33 μm diameter) and angles (synthetic crystals of K(Al,Cr)[SO₄], CuSO₄.5H₂O and NaCl) revealed a high accuracy in dimensional as well as angular measurements (total error 1 ± 0.5%).
In Monte Carlo experiments the overall error was found to depend strongly on the size of the measured structure relative to the size of the measurement field (field width).     

Three-dimensional reconstruction of cells from serial sections and whole-cell mounts using multilevel contouring of stereo micrographs

A comprehensive computer-graphics-based system (STERECON) is described for tracing and digitizing contours from individual or stereopair electron micrographs. The contours are drawn in parallel planes within the micrographs. Provision is also made for tracing and digitizing in full three-dimensional (3-D) coordinates in any direction along linear structures such as cytoskeletal elements. The stereopair micrographs are viewed in combination with the contours being traced on a graphics terminal monitor. This is done either by projecting original electron micrograph (EM) negatives onto a screen and optically combining these images with contour lines being drawn on the monitor, or by first digitizing the images and displaying them directly on the monitor along with the contour lines. Prior image digitization allows computer enhancement of the structures to be contoured. Correction and alignment routines are included to deal with variable section thickness, section distortion and mass loss, variations in photography in the electron microscope, and terminal screen curvature when combining projected images with contour lines on the monitor. The STERECON system organizes and displays the digitized data from successive sections as a 3-D reconstruction. Reconstructions can be viewed in any orientation as contour stacks with hidden lines removed; as wire-frame models; or as shaded, solid models with variable lighting, transparency, and reflectivity. Volumes and surface areas of the reconstructed objects can be determined. Particular attention was paid to making the system convenient for the biological user. Users are given a choice of three different stereo-viewing methods.     

Synchrotron tomographic images from human lung adenocarcinoma: Three‐dimensional reconstruction and histologic correlations

High‐resolution tomographic images using synchrotron X‐rays are expected to provide detailed reflection of microstructures, thereby allowing for the examination of histologic structures without destruction of the specimen. This study aims to evaluate the synchrotron tomographic images of mixed ground‐glass opacity excised on 5‐mm sections in comparison to pathologic examination. The Institutional Review Board of our institute approved this retrospective study, and written informed consent was obtained from each patient whose lung tissue would be used. Obtained lung cancer specimens were brought to the multiple Wiggler 6C beam line at the Pohang Light Source (PLS‐II) in Korea, and phase contrast X‐ray images were obtained in November 2016. The X‐ray emanated from a bending magnet of the electron storage ring with electron energy of 3 GeV, and a typical beam current was 320 mA. Reconstructed tomographic images were compared with images from histologic slides obtained from the same samples. Pulmonary microstructures including terminal bronchioles, alveolar sacs, and vasculature were identified with phase contrast X‐ray images. Images from normal lung tissue and mixed ground‐glass opacity were clearly distinguishable. Hyperplasia of the interalveolar septum and dysplasia of microstructure were clearly identified. The imaging findings correlated well with hematoxylin‐eosin stained specimens. Tomographic images using synchrotron radiation have the potential for clinical applications. With refinement, this technique may become a diagnostic tool for detection of lung cancer.     

Edge detection,three-dimensional cell boundary reconstruction and volume and surface area estimation from differential interference contrast images

Three-dimensional (3-D) cell morphology is important for the understanding of cell function and can by quantified in terms of volume and surface area. Differential interference contrast (DIC, or Nomarski) imaging can enable cell edges to be clearly visualized in unstained tissue due to the slight difference in refractive index between aqueous media and cytoplasm. DIC is affected in only one direction - the direction of the optical shear. A 1-D edge detector was used in that direction with a scale length equal to that of an in-focus edge to highlight cell boundaries. By comparison with the signal from the edge detector on an out-of-focus slice, the in-focus slices could be segmented and, after noise suppression, cell outlines obtained. A voxel paradigm was used to calculate cell volume and differential geometry was used for surface area estimation. We applied this approach to obtain 3-D dimensional information by optical sectioning of motile Amoeba proteus.     

卷取机夹送辊安装调整对夹送辊工作压力的影响

分析了热连轧卷取机夹送辊在卷取带钢过程中状态变化,提出现场安装调整的精密准确检测方法,对改善钢卷卷形,提高产品质量起到积极作用。     

The effect of mechanical vibration and drift on the reconstruction of exit waves from a through focus series of HREM images

Experimental HREM images can show a limited resolution as a result of mechanical vibration and drift. In this paper the effect of such mechanical vibrations on the accuracy of the through focus exit wave reconstruction method is investigated for different thicknesses of a test structure of La₃Ni₂B₂N₃. A through-focus series of HREM images for this structure is simulated for different kinds of mechanical vibration corresponding to an information limit g of about 7 nm⁻¹: (1) no mechanical vibration, (2) isotropic mechanical vibration, and (3) several anisotropic mechanical vibrations. From these through-focus series the reconstructed exit wave is calculated (Ultramicroscopy 64 (1996) 109). The above isotropic and anisotropic mechanical vibrations have a large effect on the reconstructed exit waves when compared with the reconstructed exit wave without mechanical vibration, i.e. the range of amplitudes and phases in a reconstructed exit wave decreases and the background intensity increases. The initial thickness and orientation can be obtained using a least-squares refinement procedure (Acta Crystallogr. A 54 (1998) 91) when there is no mechanical vibration present. In the case of isotropic or anisotropic vibration, the refined thickness and orientation are likely to give wrong results depending on the size of the vibrations and on the number of significant reflections (which is related to the size of the unit cell, the thickness and the misorientation).     

The two-dimensional and three-dimensional processing of images provided by conventional microscopes

In this paper, I present an interesting processing method of microscopic images. High-pass type filters are generally used for image focusing. They enhance the high spatial frequencies. They are, however, efficient only in cases when the picture is not sharp because of the low contrast on high frequencies (for example in a TV picture). These filters, are not appropriate if the lack of sharpness has been caused by other factors. In this case, it is not possible to construct a three-dimensional model of the observed object. Better results and a three-dimensional model can be obtained by applying the following theory. As part of this paper, an original program based on this theory is described.     

3D volumes constructed from pixel-based images by digitally clearing plant and animal tissue

Construction of three-dimensional volumes from a series of two-dimensional images has been restricted by the limited capacity to decrease the opacity of tissue. The use of commercial software that allows colour-keying and manipulation of two-dimensional images in true three-dimensional space allowed us to construct three-dimensional volumes from pixel-based images of stained plant and animal tissue without generating vector information. We present three-dimensional volumes of (1) the crown of an oat plant showing internal responses to a freezing treatment, (2) a sample of a hepatocellular carcinoma from a woodchuck liver that had been heat-treated with computer-guided radiofrequency ablation to induce necrosis in the central portion of the tumour, and (3) several features of a sample of mouse lung. The technique is well suited to images from large sections (greater than 1 mm) generated from paraffin-embedded tissues. It is widely applicable, having potential to recover three-dimensional information at virtually any resolution inherent in images generated by light microscopy, computer tomography, magnetic resonance imaging or electron microscopy.