Efficient Monte Carlo rendering with realistic lenses

In this paper we present a novel approach to simulate image formation for a wide range of real world lenses in the Monte Carlo ray tracing framework. Our approach sidesteps the overhead of tracing rays through a system of lenses and requires no tabulation. To this end we first improve the precision of polynomial optics to closely match ground‐truth ray tracing. Second, we show how the Jacobian of the optical system enables efficient importance sampling, which is crucial for difficult paths such as sampling the aperture which is hidden behind lenses on both sides. Our results show that this yields converged images significantly faster than previous methods and accurately renders complex lens systems with negligible overhead compared to simple models, e.g. the thin lens model. We demonstrate the practicality of our method by incorporating it into a bidirectional path tracing framework and show how it can provide information needed for sophisticated light transport algorithms.     

An Eyeglass Simulator Using Conoid Tracing

This paper proposes a method for displaying images at the fovea of the retina taking visual acuity into account. Previous research has shown that a point light source projected onto the retina forms an ellipse, which can be computed with wavefront tracing from each point in space. We propose a novel concept using conoid tracing, with which we can acquire defocusing information several times faster than that acquired by previous methods. We also show that conoid tracing is more robust and produces higher quality results. In conoid tracing the ray is regarded as a conoid, a thin cone‐like shape with varying elliptical cross‐section. The viewing ray from the retina is traced as a conoid and evaluated at each sample location. Using the sampled and pre‐computed data for the spatial distribution of blurring, we implemented an interactive eyeglass simulator. This paper demonstrates some visualization results utilizing the interactivity of the simulator, which an eyeglass lens design company uses to evaluate the design of complex progressive lenses.     

Rendering realistic spectral bokeh due to lens stops and aberrations

Creating bokeh effect in synthesized images can improve photorealism and emphasize interesting subjects. Therefore, we present a novel method for rendering realistic bokeh effects, especially chromatic effects, which are absent for existing methods. This new method refers to two key techniques: an accurate dispersive lens model and an efficient spectral rendering scheme. This lens model is implemented based on optical data of real lenses and considers wavelength dependency of physical lenses by introducing a sequential dispersive ray tracing algorithm inside this model. This spectral rendering scheme is proposed to support rendering of lens dispersion and integration between this new model and bidirectional ray tracing. The rendering experiments demonstrate that our method is able to simulate realistic spectral bokeh effects caused by lens stops and aberrations, especially chromatic aberration, and feature high rendering efficiency.     

A Smooth Surface Based on Biquadratic Patches

Ray tracing can generate high-quality color images of free-form surfaces. To reduce CPU time, introduce extra knots into the system and use biquadratics instead of bicubics.     

Efficient Ray Tracing Through Aspheric Lenses and Imperfect Bokeh Synthesis

We present an efficient ray‐tracing technique to render bokeh effects produced by parametric aspheric lenses. Contrary to conventional spherical lenses, aspheric lenses do generally not permit a simple closed‐form solution of ray‐surface intersections. We propose a numerical root‐finding approach, which uses tight proxy surfaces to ensure a good initialization and convergence behavior. Additionally, we simulate mechanical imperfections resulting from the lens fabrication via a texture‐based approach. Fractional Fourier transform and spectral dispersion add additional realism to the synthesized bokeh effect. Our approach is well‐suited for execution on graphics processing units (GPUs) and we demonstrate complex defocus‐blur and lens‐flare effects.     

An innovative blemish detection system for curved LED lenses

The functions of LED lenses include focusing, beauty, and protection to avoid the waste of light and light pollution. Nevertheless, LED lens with a transparent and curved surface is more difficult to detect the visual blemishes than electronic and optical components by current computer vision systems. This research proposes an innovative blemish detection system to detect visual blemishes of the curved LED lenses. A spatial domain image with equal sized blocks is converted to discrete cosine transform (DCT) domain and some representative energy features of each DCT block are extracted. These energy features of each block are integrated by the Hotelling’s T-squared statistic and the suspected blemish blocks can be determined by the multivariate statistical method. Then, the grey clustering technique based on the block grey relational grades is applied to further confirm the block locations of real blemishes. Finally, a simple thresholding method is applied to set a threshold for distinguishing between defective areas and uniform regions. Experimental results show that the proposed system achieves a high 95.46% probability of correctly discriminating visual blemishes from normal regions and a low 0.13% probability of erroneously detecting normal regions as blemishes on curved surfaces of LED lenses.     

Distributed real-time rendering for ultrahigh-resolution multiscreen 3D display

Large-scale autostereoscopic three-dimensional (3D) displays can give audiences a truly immersive feeling with strong visual impact. However, the traditional autostereoscopic 3D display systems are limited by the display hardware, making it difficult to directly achieve large-scale 3D displays with high resolution. Multiscreen splicing with laser backlights can be used for large-scale and ultrahigh-resolution 3D display, but it normally results in subscreen image asynchronization, view zone error, or obvious edge overlapping. To solve the problems mentioned above, a distributed real-time rendering system for ultrahigh-resolution multiscreen 3D display is proposed. Fifteen 3D LCD display devices are driven through a host, cooperating with laser backlights, a lenticular lens array (LLA), and a directional diffuser to display high resolution, high frame rate, large size, and wide-viewing angle 3D images. The resolution of the whole display system can reach 23,040 × 21,600. The rendering system provides a large-scale and real-time 3D scene image with an ultrahigh-definition resolution at a speed of 40 frames per second and high quality.     

Stripification of Free-Form Surfaces With Global Error Bounds for Developable Approximation

Developable surfaces have many desired properties in the manufacturing process. Since most existing CAD systems utilize tensor-product parametric surfaces including B-splines as design primitives, there is a great demand in industry to convert a general free-form parametric surface within a prescribed global error bound into developable patches. In this paper, we propose a practical and efficient solution to approximate a rectangular parametric surface with a small set of C ⁰ -joint developable strips. The key contribution of the proposed algorithm is that, several optimization problems are elegantly solved in a sequence that offers a controllable global error bound on the developable surface approximation. Experimental results are presented to demonstrate the effectiveness and stability of the proposed algorithm.     

Sparse high‐degree polynomials for wide‐angle lenses

Rendering with accurate camera models greatly increases realism and improves the match of synthetic imagery to real‐life footage. Photographic lenses can be simulated by ray tracing, but the performance depends on the complexity of the lens system, and some operations required for modern algorithms, such as deterministic connections, can be difficult to achieve. We generalise the approach of polynomial optics, i.e. expressing the light field transformation from the sensor to the outer pupil using a polynomial, to work with extreme wide angle (fisheye) lenses and aspherical elements. We also show how sparse polynomials can be constructed from the large space of high‐degree terms (we tested up to degree 15). We achieve this using a variant of orthogonal matching pursuit instead of a Taylor series when computing the polynomials. We show two applications: photorealistic rendering using Monte Carlo methods, where we introduce a new aperture sampling technique that is suitable for light tracing, and an interactive preview method suitable for rendering with deep images.     

Optimal shape error analysis of the matching image for a free-form surface

When using an optical non-contact scanning system to measure an object that has a large surface, large curvature, or a full 360° profile, one can acquire only one set of sectional measurement points each time. For reconstructing the entire object, every set of sectional measurement points acquired at different positions must match. Therefore, the optimal shape error analysis for the matching image of two or more sets of sectional measurement points is desired. This paper presents a measurement system that combines two CCD cameras, one line laser and a three-axis motion stage. It forms an optical non-contact scanning system in association with the mathematical method of direct shape error analysis for the use in reverse engineering. This analysis and measurement system can be used for the profile measurements of free-form objects. It analyzes the matching image of a free-form surface with high efficiency and accuracy. The validity and applicability of this system are demonstrated by two practical examples.     

A New Approach for Direct Manipulation of Free-Form Curve

There is an increasing demand for more intuitive methods for creating and modifying free-form curves and surfaces in CAD modeling systems. The methods should be based not only on the change of the mathematical parameters, such as control points, knots, and weights, but also on the user's specified constraints and shapes. This paper presents a new approach for directly manipulating the shape of a free-form curve, leading to a better control of the curve deformation and a more intuitive CAD modeling interface. The user's intended deformation of a curve is automatically converted into the modification of the corresponding NURBS control points and knot sequence of the curve. The algorithm for this approach includes curve elevation, knot refinement, control point repositioning, and knot removal. Several examples shown in this paper demonstrate that the proposed method can be used to deform a NURBS curve into the desired shape. Currently, the algorithm concentrates on the purely geometric consideration. Further work will include the effect of material properties.     

Polynomial Optics: A Construction Kit for Efficient Ray‐Tracing of Lens Systems

Simulation of light transport through lens systems plays an important role in graphics. While basic imaging properties can be conveniently derived from linear models (like ABCD matrices), these approximations fail to describe nonlinear effects and aberrations that arise in real optics. Such effects can be computed by proper ray tracing, for which, however, finding suitable sampling and filtering strategies is often not a trivial task. Inspired by aberration theory, which describes the deviation from the linear ray transfer in terms of wavefront distortions, we propose a ray‐space formulation for nonlinear effects. In particular, we approximate the analytical solution to the ray tracing problem by means of a Taylor expansion in the ray parameters. This representation enables a construction‐kit approach to complex optical systems in the spirit of matrix optics. It is also very simple to evaluate, which allows for efficient execution on CPU and GPU alike, including the computation of mixed derivatives of any order. We evaluate fidelity and performance of our polynomial model, and show applications in high‐quality offline rendering and at interactive frame rates.     

A Rendering Equation for Specular Transfers and Its Integration into Global Illumination

In this paper, we present a rigorous theoretical formulation of the fundamental problem—indirect illumination from area sources via curved ideal specular surfaces. Intensity and area factors are introduced to clarify this problem and to rectify the radiance from these specular surfaces. They take surface geometry, such as Gaussian curvature, into account. Based on this formulation, an algorithm for integrating ideal specular transfers into global illumination is also presented. This algorithm can deal with curved specular reflectors and transmitters. An implementation is described based on wavefront tracing and progressive radiosity. Sample images generated by this method are presented.     

An approach of designing and controlling free-form surfaces by using NURBS boundary Gregory patches

Designers require a means of designing complex free-form surfaces easily and intuitively. One general approach to designing such surfaces is to first define a curve mesh consisting of characteristic lines, such as cross sections and boundary curves, then to interpolate the curve mesh using free-form surfaces. NURBS surfaces are widely used but make the interpolation of an irregular curve mesh difficult. This has been a major limiting constraint on designers. In this paper, we propose a new surface representation that enables the smooth interpolation of an irregular curve mesh with NURBS curves and surfaces.     

Microplastic lens array fabricated by a hot intrusion process

A microplastic lens array has been successfully constructed on top of a 500-/spl mu/m-thick PC (Polycarbonate film) by using a micro hot intrusion process. A single-layer LIGA process is used to fabricate the high-aspect-ratio nickel mold insert that has circular hole patterns of 80 /spl mu/m in diameter and 200 /spl mu/m in depth. Under the hot intrusion process, plastic material can be intruded into these circular-shape holes and stopped at desired depth under elevated temperature and pressure to fabricate microlenses. By adjusting the embossing load, temperature and time, the curvature and height of the lens are controllable when the same mold insert is used. The optical properties of these microlenses have been characterized and the average radius of curvature is found as 41.4 /spl mu/m with a standard deviation of 1.05 /spl mu/m. Experimental characterization and theoretical model are conducted and developed for the micro-intrusion process in terms of the radius of curvature and height of the lenses and they correspond well with experimental data within 5% of variations. The focusing capability of the lenses is demonstrated by comparing the images of laser light with and without using the lenses. When the projection screen is placed 200 /spl mu/m away from the lens, the full-width at half-maximum (FWHM) for the lens is 110 /spl mu/m while the original FWHM of the optical fiber is 300 /spl mu/m.     

Design of compact projection lenses using double‐layered diffractive optical elements

Abstract— Based on several special properties of diffractive optical elements (DOEs) such as savings in mass and to freely modulate the wavefront of incident light, a new compact projection lens with double‐layered DOEs is presented. It is comprised of five lenses and has nearly half the weight of its original structure. The modulation transfer function (MTF) value on‐axis is 0.7 at a spatial frequency of 33 lp/mm and more than 0.3 for all off‐axis values, which satisfies the requirement of a color‐filter‐type liquid‐crystal‐on‐silicon (LCoS) 0.59‐in. display with a SVGA resolution. The maximum distortion is 0.46%.     

Shape and topology optimization of acoustic lens system using phase field method

A layout optimization method for a two-dimensional acoustic lens system used in underwater imaging is presented. To this end, a shape and topology optimization is formulated for the design problem of a lens system for the first time. The layout of a lens system to be optimized includes the number of lenses, shape of lens surfaces, distances between lenses, and lens materials. A phase field function is employed to implicitly parameterize the boundaries of the lenses, which move according to design sensitivities during optimization. Multiple lenses with different materials are optimized using a single phase field function. Because the ratio of the acoustic wavelength with respect to lens dimensions is large, diffraction effects should be taken into account. Accordingly, the performance of a lens system should be analyzed using wave acoustics and not the ray tracing method. The optimization problem is formulated to remove the aberrations of coma and field curvature. The validity of the proposed optimization method is demonstrated by solving benchmark design problems including a lens system with a large field of view.     

A Competitive Analysis of Load Balancing Strategies for Parallel Ray Tracing

This paper examines the effectiveness of load balancing strategies for ray tracing on large parallel computer systems and cluster computers. Popular static load balancing strategies are shown to be inadequate for rendering complex images with contemporary ray tracing algorithms, and for rendering NTSC resolution images on 128 or more computers. Strategies based on image tiling are shown to be ineffective except on very small numbers of computers. A dynamic load balancing strategy, based on a diffusion model, is applied to a parallel Monte Carlo rendering system. The diffusive strategy is shown to remedy the defects of the static strategies. A hybrid strategy that combines static and dynamic approaches produces nearly optimal performance on a variety of images and computer systems. The theoretical results should be relevant to other rendering and image processing applications.     

Automatic Lighting Design using a Perceptual Quality Metric

Lighting has a crucial impact on the appearance of 3D objects and on the ability of an image to communicate information about a 3D scene to a human observer. This paper presents a new automatic lighting design approach for comprehensible rendering of 3D objects. Given a geometric model of a 3D object or scene, the material properties of the surfaces in the model, and the desired viewing parameters, our approach automatically determines the values of various lighting parameters by optimizing a perception-based image quality objective function. This objective function is designed to quantify the extent to which an image of a 3D scene succeeds in communicating scene information, such as the 3D shapes of the objects, fine geometric details, and the spatial relationships between the objects.
Our results demonstrate that the proposed approach is an effective lighting design tool, suitable for users without expertise or knowledge in visual perception or in lighting design.