The point-spread function of a confocal microscope: its measurement and use in deconvolution of 3-D data

We have measured the point-spread function (PSF) for an MRC-500 confocal scanning laser microscope using subresolution fluorescent beads. PSFs were measured for two lenses of high numerical aperture—the Zeiss plan-neofluar 63 × water immersion and Leitz plan-apo 63 × oil immersion—at three different sizes of the confocal detector aperture. The measured PSFs are fairly symmetrical, both radially and axially. In particular there is considerably less axial asymmetry than has been demonstrated in measurements of conventional (non-confocal) PSFs. Measurements of the peak width at half-maximum peak height for the minimum detector aperture gave approximately 0·23 and 0·8 μm for the radial and axial resolution respectively (4·6 and 15·9 in dimensionless optical units). This increased to 0·38 and 1·5 μm (7·5 and 29·8 in dimensionless units) for the largest detector aperture examined. The resulting optical transfer functions (OTFs) were used in an iterative, constrained deconvolution procedure to process three-dimensional confocal data sets from a biological specimen—pea root cells labelled in situ with a fluorescent probe to ribosomal genes. The deconvolution significantly improved the clarity and contrast of the data. Furthermore, the loss in resolution produced by increasing the size of the detector aperture could be restored by the deconvolution procedure. Therefore for many biological specimens which are only weakly fluorescent it may be preferable to open the detector aperture to increase the strength of the detected signal, and thus the signal-to-noise ratio, and then to restore the resolution by deconvolution.     

Localization of ribosomal and telomeric DNA sequences in intact plant nuclei by in-situ hybridization and three-dimensional optical microscopy

We have combined the use of three-dimensional (3-D) fluorescence microscopy and computer image processing of images with in-situ hybridization to analyse the 3-D organization of interphase nuclei in plants. In sections of root tips of Pisum sativum, using cDNA probes, we have shown that telomeres are arranged around the nuclear periphery and that the ribosomal genes in this species appear to exist in discrete, 3-D domains.     

Three-dimensional imaging of corneal cells using in vivo confocal microscopy

Confocal microscopy is a unique and powerful imaging paradigm which allows optical sectioning through intact tissue. Real-time tandem scanning confocal microscopy has previously been used to generate high-magnification two-dimensional (2-D) images of cells in living organ systems. Inherent problems with movement, however, have prevented the in vivo acquisition of complete 3-D datasets. The development of a new objective lens, used in combination with specialized real-time image acquisition procedures, has allowed sequential serial sections to be obtained in vivo from the rabbit cornea for the first time. These sections can be digitially registered and stacked on the computer to provide a 3-D reconstruction of the corneal cells. This technique should serve as a useful method for studying 3-D structures and analysing 4-D phenomena at the cellular level in living animals. Three-dimensional images of a stromal nerve in normal rabbit cornea and of fibroblasts within a rabbit corneal wound are presented as examples of current capabilities.     

Image adaptive point-spread function estimation and deconvolution for in vivo confocal microscopy

Visualizing deep inside the tissue of a thick biological sample often poses severe constraints on image conditions. Standard restoration techniques (denoising and deconvolution) can then be very useful, allowing one to increase the signal-to-noise ratio and the resolution of the images. In this paper, we consider the problem of obtaining a good determination of the point-spread function (PSF) of a confocal microscope, a prerequisite for applying deconvolution to three-dimensional image stacks acquired with this system. Because of scattering and optical distortion induced by the sample, the PSF has to be acquired anew for each experiment. To tackle this problem, we used a screening approach to estimate the PSF adaptively and automatically from the images. Small PSF-like structures were detected in the images, and a theoretical PSF model reshaped to match the geometric characteristics of these structures. We used numerical experiments to quantify the sensitivity of our detection method, and we demonstrated its usefulness by deconvolving images of the hearing organ acquired in vitro and in vivo.     

Three-dimensional analysis of cell nucleus structures visualized by confocal scanning laser microscopy

Studies of the three-dimensional (3-D) organization of cell nuclei are becoming increasingly important for the understanding of basic cellular events such as growth and differentiation. Modern methods of molecular biology, including in situ hybridization and immunofluorescence, allow the visualization of specific nuclear structures and the study of spatial arrangements of chromosome domains in interphase nuclei. Specific methods for labelling nuclear structures are used to develop computerized techniques for the automated analysis of the 3-D organization of cell nuclei. For this purpose, a coordinate system suitable for the analysis of tri-axial ellipsoidal nuclei is determined. High-resolution 3-D images are obtained using confocal scanning laser microscopy. The results demonstrate that with these methods it is possible to recognize the distribution of visualized structures and to obtain useful information regarding the 3-D organization of the nuclear structure of different cell systems.     

Isotropic high-resolution three-dimensional confocal micro-rotation imaging for non-adherent living cells

Recently, micro-rotation confocal microscopy has enabled the acquisition of a sequence of micro-rotated images of nonadherent living cells obtained during a partially controlled rotation movement of the cell through the focal plane. Although we are now able to estimate the three-dimensional position of every optical section with respect to the cell frame, the reconstruction of the cell from the positioned micro-rotated images remains a last task that this paper addresses. This is not strictly an interpolation problem since a micro-rotated image is a convoluted two-dimensional map of a three-dimensional reality. It is rather a 'reconstruction from projection' problem where the term projection is associated to the PSF of the deconvolution process. Micro-rotation microscopy has a specific difficulty. It does not yield a complete coverage of the volume. In this paper, experiments illustrate the ability of the classical EM algorithm to deconvolve efficiently cell volume despite of the incomplete coverage. This cell reconstruction method is compared to a kernel-based method of interpolation, which does not take account explicitly the point-spread-function (PSF). It is also compared to the standard volume obtained from a conventional z-stack. Our results suggest that deconvolution of micro-rotation image series opens some exciting new avenues for further analysis, ultimately laying the way towards establishing an enhanced resolution 3D light microscopy.     

Confocal microscopy of the in-situ crystalline lens

The fine structure of the in-situ rabbit crystalline ocular lens from the ex-vivo rabbit eye was observed with a confocal scanning laser microscope in the scattered light mode. The images were observed through the full thickness of the cornea and aqueous humour to a depth of 50 μm in the anterior ocular lens. The following structures were observed from optical sections of the ocular lens: two concentric regions of the lens capsule, epithelial cells, lens sutures, and surface and interior regions of individual lenticular fibres. The observed lateral resolution of the microscope objective was degraded by imaging across thick (millimetre) structures. This study shows the feasibility of obtaining high-contrast images of transparent objects across 1.7 mm of ocular tissue (cornea and aqueous humour) using confocal light microscopy.     

Blind deconvolution of 3D fluorescence microscopy using depth‐variant asymmetric PSF

The 3D wide‐field fluorescence microscopy suffers from depth‐variant asymmetric blur. The depth‐variance and axial asymmetry are due to refractive index mismatch between the immersion and the specimen layer. The radial asymmetry is due to lens imperfections and local refractive index inhomogeneities in the specimen. To obtain the PSF that has these characteristics, there were PSF premeasurement trials. However, they are useless since imaging conditions such as camera position and refractive index of the specimen are changed between the premeasurement and actual imaging. In this article, we focus on removing unknown depth‐variant asymmetric blur in such an optical system under the assumption of refractive index homogeneities in the specimen. We propose finding few parameters in the mathematical PSF model from observed images in which the PSF model has a depth‐variant asymmetric shape. After generating an initial PSF from the analysis of intensities in the observed image, the parameters are estimated based on a maximum likelihood estimator. Using the estimated PSF, we implement an accelerated GEM algorithm for image deconvolution. Deconvolution result shows the superiority of our algorithm in terms of accuracy, which quantitatively evaluated by FWHM, relative contrast, standard deviation values of intensity peaks and FWHM. Microsc. Res. Tech. 79:480–494, 2016. © 2016 Wiley Periodicals, Inc.     

An evaluation of two-photon excitation versus confocal and digital deconvolution fluorescence microscopy imaging in Xenopus morphogenesis.

The ability to visualize cell motility occurring deep in the context of opaque tissues will allow many currently intractable issues in developmental biology and organogenesis to be addressed. In this study, we compare two-photon excitation with laser scanning confocal and conventional digital deconvolution fluorescence microscopy, using the same optical configuration, for their ability to resolve cell shape deep in Xenopus gastrula and neurula tissues. The two-photon microscope offers better depth penetration and less autofluorescence compared to confocal and conventional deconvolution imaging. Both two-photon excitation and confocal microscopy also provide improved rejection of "out-of-focus" noise and better lateral and axial resolution than conventional digital deconvolution microscopy. Deep Xenopus cells are best resolved by applying the digital deconvolution method on the two-photon images. We have also found that the two-photon has better depth penetration without any degradation in the image quality of interior sections compared to the other two techniques. Also, we have demonstrated that the quality of the image changes at different depths for various excitation powers.     

A method of PSF generation for 3D brightfield deconvolution

This paper addresses the problem of 3D deconvolution of through focus widefield microscope datasets (Z‐stacks). One of the most difficult stages in brightfield deconvolution is finding the point spread function. A theoretically calculated point spread function (called a ‘synthetic PSF’ in this paper) requires foreknowledge of many system parameters and still gives only approximate results. A point spread function measured from a sub‐resolution bead suffers from low signal‐to‐noise ratio, compounded in the brightfield setting (by contrast to fluorescence) by absorptive, refractive and dispersal effects. This paper describes a method of point spread function estimation based on measurements of a Z‐stack through a thin sample. This Z‐stack is deconvolved by an idealized point spread function derived from the same Z‐stack to yield a point spread function of high signal‐to‐noise ratio that is also inherently tailored to the imaging system. The theory is validated by a practical experiment comparing the non‐blind 3D deconvolution of the yeast Saccharomyces cerevisiae with the point spread function generated using the method presented in this paper (called the ‘extracted PSF’) to a synthetic point spread function. Restoration of both high‐ and low‐contrast brightfield structures is achieved with fewer artefacts using the extracted point spread function obtained with this method. Furthermore the deconvolution progresses further (more iterations are allowed before the error function reaches its nadir) with the extracted point spread function compared to the synthetic point spread function indicating that the extracted point spread function is a better fit to the brightfield deconvolution model than the synthetic point spread function.     

Three-dimensional image restoration and super-resolution in fluorescence confocal microscopy

Confocal scanning laser microscopy (CSLM) provides optical sectioning of a fluorescent sample and improved resolution with respect to conventional optical microscopy. As a result, three-dimensional (3-D) imaging of biological objects becomes possible. A difficulty is that the lateral resolution is better than the axial resolution and, thus, the microscope provides orientation-dependent images. However, a theoretical investigation of the process of image formation in CSLM shows that it must be possible to improve the resolution obtained in practice. We present two methods for achieving such a result in the case of 3-D fluorescent objects. The first method applies to conventional CSLM, where the image is detected only on the optical axis for any scanning position. Since the resulting 3-D image is the convolution of the object with the impulse-response function of the instrument, the problem of image restoration is a deconvolution problem and is affected by numerical instability. A short introduction to the linear methods developed for obtaining stable solutions of these problems (the so-called regularization theory of ill-posed problems) is given and an application to a real image is discussed. The second method applies to a new version of CSLM proposed in recent years. In such a case the full image must be measured by a suitable array of detectors. For each scanning position the data are not single numbers but vectors. Then, in order to recover the object, one must solve a Fredholm integral equation of the first kind. A method for the solution of this equation is presented and the possibility of achieving super-resolution is demonstrated. More precisely, we show that it is possible to improve by about a factor of 2 the resolution of conventional CSLM both in the lateral and axial directions.     

Study of Golgi-impregnated material using the confocal tandem scanning reflected light microscope

The tandem scanning reflected-light microscope (TSM) is a real-time, direct-view confocal microscope. Only those points in the specimen situated in the focal plane contribute information to the image. A Tracor Northern TMS with piezo-electric control of the objective lens was used to generate 3-D images from Golgi-impregnated hamster cerebral cortex. Stereoscopic pairs of images were recorded as 35-mm colour film transparencies by photographing while automatically through-focusing along inclined axes. Transferring the image via a TV camera to the computer, stereo-pairs were obtained by oblique through-focusing and summing, displaying maximum intensity data in each line of sight. Pseudocolour topographic displays were generated by assigning the pixel value in a z map image as the focal depth at which the back-scattered light signal was maximal. The TSM was also modified so that a conventional transmitted-light image with a large depth of field could be obtained simultaneously as the very shallow depth of field confocal back-scattered-light image seen at any focus level. The conventional image is a silhouette of the impregnated neurons: the top surface of the cell is not visible and the relationships of processes that cross over cell bodies cannot be discerned. TSM gives a high-contrast image. The Golgi precipitate over the neuronal surface is resolved as globular or ovoid, coloured particles. The smaller particles also cover the dendritic spines. All the confocal range (extended focus) image display methods satisfactorily demonstrated the 3-D arrangement of cell bodies and processes in the chosen volume.     

Comparison of three-dimensional imaging properties between two-photon and single-photon fluorescence microscopy

The imaging performance in single-photon (1-p) and two-photon (2-p) fluorescence microscopy is described. Both confocal and conventional systems are compared in terms of the three-dimensional (3-D) point spread function and the 3-D optical transfer function. Images of fluorescent sharp edges and layers are modelled, giving resolution in transverse and axial directions. A comparison of the imaging properties is also given for a 4Pi confocal system. Confocal 2-p 4Pi fluorescence microscopy gives the best axial resolution in the sense that its 3-D optical transfer function has the strongest response along the axial direction.     

A tilting device for three-dimensional microscopy: Application to in situ imaging of interphase cell nuclei

The resolution of an optical microscope is considerably less in the direction of the optical axis (z) than in the focal plane (x-y plane). This is true of conventional as well as confocal microscopes. For quantitative microscopy, for instance studies of the three-dimensional (3-D) organization of chromosomes in human interphase cell nuclei, the 3-D image must be reconstructed by a point spread function or an optical transfer function with careful consideration of the properties of the imaging system. To alleviate the reconstruction problem, a tilting device was developed so that several data sets of the same cell nucleus under different views could be registered. The 3-D information was obtained from a series of optical sections with a Zeiss transmission light microscope Axiomat using a stage with a computer-controlled stepping motor for movement in the z-axis. The tilting device on the Axiomat stage could turn a cell nucleus through any desired angle and also provide movement in the x-y direction. The technique was applied to 3-D imaging of human lymphocyte cell nuclei, which were labelled by in situ hybridization with the DNA probe pUC 1.77 (mainly specific for chromosome 1). For each nucleus, 3-D data sets were registered at viewing angles of 0°, 90° and 180°; the volumes and positions of the labelled regions (spots) were calculated. The results also confirm that, in principle, any angle of a 2p geometry can be fixed for data acquisition with a high reproducibility. This indicates the feasibility of axiotomographical microscopy of cell nuclei.     

Potential of CLSM in studying some modern and fossil palynological objects

We have tested possibilities and limitations of confocal laser scanning microscopy to study the morphology of pollen and spores and inner structure of sporoderms. As test objects, we used pollen grains of the modern angiosperm Ribes niveum (Grossulariaceae) and Datura metel (Solanaceae), fossil angiosperm pollen grains of Pseudointegricorpus clarireticulatum and Wodehouseia spinata dated to the Late Cretaceous, fossil gymnosperm pollen grains of Cycadopites‐type dated to the Middle Jurassic, and fossil megaspores Maexisporites rugulaeferus, M. grosstriletus, and Trileites sp. dated to the Early Triassic. For comparative purpose, we studied the same objects with application of conventional light, scanning electron (to entire pollen grains and spores or to semithin sections of their walls), or transmission electron microscopy. The resolution of confocal microscope is much lower than that of electron microscopes, as are its abilities to reconstruct the surface patterns and inner structure. On the other hand, it can provide information that is unreachable by other microscopical methods. Thus, the structure of endoapertures in angiosperm pollen grains can be directly observed. It is also helpful in studies of asymmetrical pollen and pollen grains bearing various appendages and having complicated exine structure, because rotation of 3‐D reconstructions allows one to examine all sides and structures of the pollen grain. The exact location of all visible and concealed structures in the sporoderm can be detected; this information helps to describe the morphology and inner structure of pollen grains and to choose necessary directions of further ultrathin sectioning for a transmission electron microscopical study. In studies of fossil pollen grains that are preserved in clumps and stuck to cuticles, confocal microscope is useful in determining the number of apertures in individual pollen grains. This can be done by means of virtual sections through 3‐D reconstructions of pollen grains. Fossil megaspores are too large and too thick‐walled objects for a confocal study; however, confocal microscope was able to reveal a degree of compression of fossil megaspores, the presence of a cavity between the outer and inner sporoderm layers, and to get some information about sporoderm inner structure.     

Comparison of in vivo and ex vivo cellular structure in rabbit eyes detected by tandem scanning microscopy

Using the tandem scanning microscope, in vivo confocal microscopic images of living eyes were compared to images obtained from ex vivo, freshly enucleated or fixed tissue in the rabbit. In the normal cornea, microscopic details of the superficial epithelium, basal lamina, stromal fibrocyte nuclei, nerves and endothelial cell borders were easily discernible. Removal of the eye from the intact animal resulted in loss of detail with distortion of the normal structural interrelationships within the corneal stroma whilst enhancing details of the corneal epithelium. Formalin fixation further enhanced details of the basal and suprabasal corneal epithelial cell nuclei and the stromal fibrocyte cell borders whilst inducing prominent brightly reflecting folds in the thickened stroma with concomitant enhancement of the edge contrast of the collagen lamellae. These changes appeared to be related, in part, to hydration of the cornea and artefactual pooling of water between structures that may enhance reflectivity by increasing the difference between the refractive index of the cellular and extracellular elements. We conclude that microscopic examination of ex vivo preparations of corneal tissue, although providing increased resolution similar to conventional light microscopic techniques, significantly altered the normal structural relationships and could lead to erroneous measurements of the physiological properties of the tissue as compared to in vivo microscopy of undisturbed, intact tissue.     

Blind deconvolution of 3D transmitted light brightfield micrographs

The blind deconvolution algorithm for 3D transmitted light brightfield (TLB) microscopy, published previously ( Holmes et al . Handbook of Biological Confocal Microscopy (1995), is summarized with example images. The main emphasis of this paper is to discuss more thoroughly the importance and usefulness of this method and to provide more detailed evidence, some being quantitative, of its necessity. Samples of horseradish peroxidase (HRP)-stained pyramidal neurones were prepared and evaluated for the ability to see fine structures clearly, including the dendrites and spines. It is demonstrated that the appearance of fine spine structure, and means of identifying spine categories, is made possible by using blind deconvolution. A comparison of images of the same sample from reflected light confocal microscopy, which is the conventional light microscopic way of viewing the 3D structure of these HRP-stained samples, shows that the blind deconvolution method is far superior for clearly showing the structure with less distortion and better resolution of the spines. The main significance of this research is that it is now possible to obtain clear images of 3D structure by light microscopy of absorbing stains. This is important because the TLB microscope is probably the most widely used modality in the life-science laboratory, yet, until now, there has been no reliable means for it to provide visualization of 3D structure clearly. The main importance of the blind deconvolution approach is that it obviates the need to measure the point spread function of the optical system, so that it now becomes realistic to provide a 3D light microscopic deconvolution method that can be pervasively used by microscopists.     

A confocal laser microscope scanner for digital recording of optical serial sections

A confocal laser microscope scanner developed at our institute is described. Since an ordinary microscope is used, it is easy to view the specimen prior to scanning. Confocal imaging is obtained by laser spot illumination, and by focusing the reflected or fluorescent light from the specimen onto a pinhole aperture in front of the detector (a photomultiplier tube). Two rotating mirrors are used to scan the laser beam in a raster pattern. The scanner is controlled by a microprocessor which coordinates scanning, data display, and data transfer to a host computer equipped with an array processor. Digital images with up to 1024 × 1024 pixels and 256 grey levels can be recorded. The optical sectioning property of confocal scanning is used to record thin (～ 1 μm) sections of a specimen without the need for mechanical sectioning. By using computer-control to adjust the focus of the microscope, a stack of consecutive sections can be automatically recorded. A computer is then used to display the 3-D structure of the specimen. It is also possible to obtain quantitative information, both geometric and photometric. In addition to confocal laser scanning, it is easy to perform non-confocal laser scanning, or to use conventional microscopic illumination techniques for (non-confocal) scanning. The design has proved reliable and stable, requiring very few adjustments and realignments. Results obtained with this scanner are reported, and some limitations of the technique are discussed.     

A procedure to determine the correct thickness of an object with confocal microscopy in case of refractive index mismatch

A difference in refractive index (n) between immersion medium and specimen results in increasing loss of intensity and resolution with increasing focal depth and in an incorrect axial scaling in images of a confocal microscope. Axial thickness measurements of an object on such images are therefore not exact. The present paper describes a simple procedure to determine the correct axial thickness of an object with confocal fluorescence microscopy. We study this procedure for a specimen that has a higher refractive index than the immersion medium and with a thickness up to 100 µm. The measuring method was experimentally tested by comparing the thickness of polymer layers measured on axial images of a confocal microscope in case of a water–polymer mismatch to reference values obtained from an independent technique, i.e. scanning electron microscopy. The case when the specimen has a lower refractive index than the immersion medium is also shown by way of illustration. Measured thickness data of a water layer and an oil layer with the same actual thickness were obtained using an oil-immersion objective lens with confocal microscopy. Good agreement between theory and experiment was found in both cases, consolidating our method.