Tracking,recognition, and distance detection of hand gestures for a 3‐D interactive display

Abstract— This study proposes an interactive system for displays, the technologies of which consists of three main parts: hand‐gesture tracking, recognition, and depth measurement. The proposed interactive system can be applied to a general 3‐D display. In this interactive system, for hand‐gesture tracking, Haar‐like features are employed to detect a specific hand gesture to start tracking, while the mean‐shift algorithm and Kalman filter are adopted for fast tracking. First, for recognizing hand gestures, a principal component analysis (PCA) algorithm is used to localize colored areas of skin, and then hand gestures are identified by comparison with a prepared database. Second, a simple optical system is set up with an infrared laser source and a grid mask in order to project a proposed horizontal stripe pattern. Third, the projected patterns are deciphered to extract the depth information using the Hough‐transform algorithm. The system containing hand‐gesture localization, recognition, and associated depth detection (the distance between the display and the hand), was included in a prototype of an interactive display. Demonstration of rotation recognition of a finger‐pointing hand gesture was successful by using the algorithm of radar‐like scanning.     

Color displays and flexible displays using quick‐response liquid‐powder technology for electronic paper

Abstract— Color displays and flexible displays that use electronic liquid powder have been developed. Novel types of color displays using either a colored powder or a color filter are discussed. We have also developed a flexible display with low‐cost substrate films with a high‐throughput roll‐to‐roll manufacturing method. These technologies enable a QR‐LPD to be widely used as an electronic‐paper display.     

Monocular hyper‐realistic AR head‐up display

We proposed and developed a novel monocular hyper‐realistic head dome projector for an amusement application and a novel monocular windshield augmented reality projector for augmented reality and head‐up display applications. They use monocular vision that eliminates the depth cues caused by binocular parallax information. Our developed monocular hyper‐realistic head dome projector and windshield augmented reality projector system achieved a high hyper‐reality performance with free depth perception and high visibility.     

Psychophysical evaluations of a current multi‐view 3‐D display: Its advantages in glossiness reproduction

Abstract— Although two‐view 3‐D displays requiring stereo glasses are on the market, the shape of objects they present is distorted when the observer's head moves. This problem can be solved by using a (passive) multi‐view 3‐D display because such a display can produce motion parallax. Another problem has to do with the surface quality of the presented object, but little is known about the fidelity of such displays as far as the surface quality goes. Previously, it was found that a two‐view 3‐D display has a problem in which glossiness deteriorates when the observer's head moves and that it can be alleviated by using a head tracker, whose data enables the display to produce correct motion parallax and luminance changes when the viewer's head moves. Here, it was determined whether this problem can be solved by using commercially available multi‐view 3‐D displays, whose finite number of viewpoints and certain amount of cross‐talk, however, make luminance changes inexact and smaller than they should be. It was found that this display can solve the problem to a certain extent.     

Two‐parameter optimization procedure for a TN display

Abstract— In our work, a two‐parameter optimization procedure for a TN display has been performed. The procedure consists of the numerical calculation of the optical parameters of a TN display, such as contrast ratio and luminance as a function of both the LC‐layer dichroic properties and the polarization coefficient of the polarizers used. The calculations have been done for: human eye sensitivity; real spectral characteristics of light sources (both internal and external ones); both the positive and negative modes of operating of the display; real director profile of the LC layer. Additionally, our procedure takes into account the interference phenomena of the display and the quasi‐real properties of the polarizing films. As a result of our work, a close relationship between the TN display optical parameters and the dichroic LC layer and polarizing films used have been obtained. This makes it possible to choose the initial display elements for different display application and user requirements.     

Performance of liquid‐crystal displays for fire‐service thermal‐imaging cameras

Abstract— As use of handheld thermal‐imaging cameras (TICs) becomes more prevalent in the first‐responder community, it is important that standard test metrics be available to characterize imaging performance. A key performance consideration is the quality of the image presented on the TIC display. This paper focuses on TICs that use liquid‐crystal displays to render an image for the user. Current research on TIC performance for first‐responder applications makes use of trained observers and/or composite‐video‐output‐signal measurements. Trained observer tests are subjective and composite video output tests do not evaluate the performance of the complete imaging system. A non‐destructive objective method was developed that tests the performance of the entire thermal‐imaging system, from the infrared sensor to the display. A thermal target was used to correlate the measured thermal imager composite video output signal with the luminance of the display. A well‐characterized charge‐coupled‐device (CCD) camera and digital recording device were used to measure the display luminance. An electro‐optical transfer function was determined that directly relates the composite video output signal to the luminance of the display, providing a realistic characterization of system performance.     

High luminance and high see‐through head‐mounted displays with beam‐splitter‐array waveguides

We have developed head‐mounted displays with high transmittance and luminance, which could be utilized outside safely without dimming glasses. We first specified required optical performance specifications by considering user's safety and usability. In order to ensure that the user is able to recognize both surrounding environment and the image of the head‐mounted display, we set the target specification that the transmittance is higher than or equal to 85%, and the luminance contrast ratio is larger than or equal to 1.15 with display image of white solid pattern. We then developed the beam‐splitter‐array waveguide to achieve the requirements. It has advantages in high efficiency and high see‐through property. In order to determine configuration of the waveguide, we have performed optical ray trace simulation. We also established versatile waveguide measurement method applicable to different‐type waveguides. By utilizing the waveguide we have developed, we made a prototype of a head‐mounted display (HMD) with high transmittance 94% and high luminance 4.8 × 10³ cd/m² and thus luminance contrast ratio 1.25 under the sun. With these advantages, our HMD is suitable for usage outside including applications of work support systems where dimming effect is not preferred, and the HMD is used under the sun.     

High color purity emission from quantum dots by optimizing the full width at half the maximum and optical density to blue light

In this paper, we got wide color gamut of quantum dot (QD) films by optimizing the spectra width and optical density (OD) of quantum dots. The specific methods to achieve the following: QD R: one layer of color filter R film was coated below the QD R layer. QD G: one layer of yellow‐green film was coated below the QD G film. By a structure optimal design, we got wide color gamut up to 99.2% BT2020 (equal to 132.86% NTSC) in Cd‐based QD and 93.6% BT2020 (equal to 125.35% NTSC) in Cd‐free QD. Furthermore, the gamut of QD display will continue to be improved by continuous refining the structure of QD display.     

A multi‐plane optical see‐through head mounted display design for augmented reality applications

Augmented reality (AR) display technology greatly enhances users' perception of and interaction with the real world by superimposing a computer‐generated virtual scene on the real physical world. The main problem of the state‐of‐the‐art 3D AR head‐mounted displays (HMDs) is the accommodation‐vergence conflict because the 2D images displayed by flat panel devices are at a fixed distance from the eyes. In this paper, we present a design for an optical see‐through HMD utilizing multi‐plane display technology for AR applications. This approach manages to provide correct depth information and solves the accommodation‐vergence conflict problem. In our system, a projector projects slices of a 3D scene onto a stack of polymer‐stabilized liquid crystal scattering shutters in time sequence to reconstruct the 3D scene. The polymer‐stabilized liquid crystal shutters have sub‐millisecond switching time that enables sufficient number of shutters to achieve high depth resolution. A proof‐of‐concept two‐plane optical see‐through HMD prototype is demonstrated. Our design can be made lightweight, compact, with high resolution, and large depth range from near the eye to infinity and thus holds great potential for fatigue‐free AR HMDs.     

Spatial optical modulator (SOM): Samsung's light modulator for next‐generation laser displays

Abstract— A new type of diffractive spatial optical modulators (SOMs) has been developed for projection‐display and other applications such as holographic data storage, programmable lithography, and optical communications. It exhibits the inherent advantages of fast response time and high‐performance light modulation, suitable for high‐quality and high‐resolution projection displays. The ±1st‐order efficiency and contrast ratio of 39% and 1000:1 was achieved for a prototype SOM. The response time can be as fast as 0.7μsec with a 400‐nm displacement, enough to make a full‐HD display, being driven by 10‐V. A laser display in full‐HD format (1920 × 1080) was successfully demonstrated by using prototype projection engines having SOM devices, signal‐processing circuits, and projection optics.     

A method for selecting display primaries to match a target color gamut

Abstract— A method for selecting primaries of a wide‐gamut display is proposed, in which display color gamut is designed to match a target color gamut in CIELAB color space. A standard deviation of the relative maximum chroma of display and target color gamuts is defined. The selection method optimizes display primaries for the minimum standard deviation so that display and target color gamuts are similar in shape. It is shown that the color gamut of a laser display designed by this method is similar in shape to the theoretical maximum, or optimal, color gamut of objects. It is also shown that the color gamut of an LED display can be designed to include 99.7% of the gamut of Pointer's real‐world surface colors. LED primaries are selected to minimize the standard deviation of the relative maximum chroma of effective display color gamut and a target color gamut which is defined to include Pointer's real‐world surface colors. For both the laser and LED displays, it is necessary to constrain the red‐primary wavelength to avoid excessive optical power for the red primary.     

A compact UWB bandpass filter with a notched band using a multistubs loaded resonator

A novel multistubs loaded resonator (MSLR) is proposed in this article, which is constructed by several open‐ and short‐circuited stubs. The analysis shows that it is characterized by four resonant modes. Then, the MSLR is applied in the design of a compact ultra‐wideband (UWB) bandpass filter. The measured results show that its 3dB bandwidth can cover [3.0, 11.5] GHz, that is, 3 dB fractional bandwidth is 117%, and the return loss within the passband is greater than 15 dB. Especially, the roll‐off rate is higher than 33 dB/GHz and more than 40 dB harmonic suppression can be achieved up to 17 GHz. In order to suppress the interference of some undesired narrowband signal such as wireless local‐area network (WLAN) radio signal, a notched band is created for the UWB bandpass filter, which is realized by forming one stepped slot on each of the feedlines, respectively. The measured results show that a notched band with 2.01% fractional bandwidth at the center frequency of 5.85 GHz can be achieved and its suppression is about ?19 dB.     

World's first large size 77‐inch transparent flexible OLED display

Large flexible organic light‐emitting diode (OLED) display provides various electronic applications such as curved, bendable, rollable, and commercial display, because of its thinness, light weight, and design freedom. In this work, the process flow and key technologies to fabricate the world's first large size 77‐inch transparent flexible OLED display are introduced. “White OLED on TFT + color filter” method is used to fabricate the aforementioned display. On both thin‐film transistor and color filter substrates, transparent polyimide (PI) was used as plastic substrate with multi‐barrier. In case of a transparent flexible display, the multi‐barrier is required for the additional consideration to overcome the decrease of transmittance due to the difference in refractive index of the conventional multi‐barrier. We developed the special multi‐barrier to increase transparency with superior water vapor transition rate characteristic. The optimized amorphous indium gallium zinc oxide thin‐film transistors were employed on the multi‐barrier, and it shows the highly uniform electrical performance and reliability on plastic substrate. Also, the typical panel failure mechanism during laser lift‐off process caused by a particle in PI is studied, and a sacrificial layer was suggested between PI and a carrier glass to reduce the panel failure. Finally, we successfully realized the world's first 77‐inch transparent flexible OLED display with ultra‐high‐definition resolution, which can be rolled up to a radius of 80 mm with a transmittance of 40%.     

Floating autostereoscopic display with in situ interaction

Floating three‐dimensional (3D) display implements direct interaction between human hands and virtual 3D images, which offers natural and effective augmented reality interaction. In this study, we propose a novel floating autostereoscopic display, combining head tracking lenticular display with an image projection system, to offer the observers with an accurate 3D image floating in midair without any optical elements between observers and the virtual 3D image. Combined with a gesture recognition device, the proposed system can achieve in situ augmented reality interaction with the floating 3D image. A distortion correction method is developed to achieve 3D display with accurate spatial information. Moreover, a coordinate calibration method is designed to improve the accuracy in the in situ interaction. Experiments were performed to prove the feasibility of the proposed system, and the good results show the potential of human‐computer interaction in medicine and life sciences.     

A novel quarter‐wave retardation film for improving viewing angle properties in time‐sequential stereoscopic 3D‐LCDs

We have successfully developed a quarter‐wave retardation film (QWF) for wide viewing angle 3D liquid crystal displays (3D‐LCDs) that provides high luminance, low crosstalk, low color change, and low head‐tilt‐angle dependency. It was found that the out‐of‐plane retardation (Rth) of the QWF in the LCD needs to be close to 0 nm in order to improve the 3D display properties at an off‐axis position and that the in‐plane retardation (Re) needs to be adjusted from 120 to 130 nm to achieve low color change with head tilting. We adopted a coating process for making our QWF because of its potential for retardation control. 3D‐LCDs with this QWF whose Rth was nearly zero had high performance and allowed off‐axis other than on‐axis.     

The construction and performance of a multiviewer 3‐D television display

Abstract— The De Montfort University (DMU) autostereoscopic 3‐D display, intended for television applications, is described. It provides freedom of viewer movement over a typical “living room” sized area, with no restrictions on viewer's head positions. The display is capable of supplying 3‐D images to multiple viewers who do not need to wear special glasses. It operates by producing regions (exit pupils) in the viewing field where either a left or a right image is perceived. The positions of the exit pupils are steered to the viewers' eyes by the use of head tracking. Design issues that became apparent during the construction of a first prototype, and the findings from tests on it, are described. In addition, the current status of a more advanced prototype is reported.     

Dual layered display that presents auto‐stereoscopic 3D images to multiple viewers in arbitrary positions

Dual layered display or also called tensor display that consists of two panels in a stack can present full‐parallax 3D images with high resolution and continuous motion parallax by reconstructing corresponding light ray field within a viewing angle. The depth range where the 3D images can be displayed with reasonable resolution, however, is limited around the panel stack. In this paper, we propose a dual layered display that can present stereoscopic images to multiple viewers located at arbitrary positions in observer space with high resolution and large depth range. Combined with the viewer tracking system, the proposed method provides a practical way to realize high‐resolution large‐depth auto‐stereoscopic 3D display for multiple observers without restriction on the observer position and the head orientation.     

The color properties of a reflective CMYK module using polymer‐dispersed liquid crystal (PDLC)

A reflective CMYK (cyan, magenta, yellow, and black) module using polymer‐dispersed liquid crystal (PDLC) is investigated for multi‐color reflective display. Combined with the electro‐optical properties and visible spectral reflectivity of PDLC films, the color properties of the reflective CMYK module were evaluated in terms of the Uniform Color Space‐CIE 1976 L*a*b*. It is found that the blue light reflectivity of the PDLC films is lower than green light and red light reflectivity. With the increase of the voltage applied on PDLC, the color lightness of the CMYK module generally decreases, while the color saturation increases. When the voltage changed from 0 to 70 V with a 5‐V change amplitude, modules C, M, Y, and K severally exhibit at least five, six, three, and seven colors.     

Effect of vibration on eye,head and helmet movements while wearing a helmet‐mounted display

Previous research has demonstrated a loss of helmet‐mounted display (HMD) legibility for users exposed to whole body vibration. A pair of human factors studies was conducted to evaluate the effect of whole body vibration on eye, head, and helmet movements for seated users of a HMD while conducting simple fixation and smooth pursuit tracking tasks. These experiments confirmed that vertical eye motion can be demonstrated, that is consistent with the human visual systems' response to the vestibular–ocular reflex (VOR). Helmet slippage was also shown to occur, which could exacerbate loss of display legibility. The largest amplitudes in eye movements were observed during exposure to sinusoidal vibration in the 4–6 Hz range, which is consistent with the frequencies that past research has associated with whole‐body resonance and the largest decrease in display legibility. Further, the measured eye movements appeared to be correlated with both the angular acceleration of the user's head and the angular slippage of the user's helmet. This research demonstrates that the loss of legibility while wearing HMDs likely results from a combination of VOR‐triggered eye movements and movement of the display. Future compensation algorithms should consider adjusting the display in response to both VOR‐triggered eye and HMD motion.     

Diagnosis of lossy resonator filters with source–Load coupling using Y‐parameters

This article presents a novel approach to extract the coupling matrix (CM) of a lossy cross‐coupled resonator bandpass filter with source–load coupling using admittance parameters (also known as Y‐parameters). The Y‐parameters are calculated by characteristic polynomials corresponding to the measured S‐parameters. The unloaded quality factor of resonators and the CM can be extracted from the Y‐parameters. The method allows one to diagnose a filter with source–load coupling without necessity of dealing with the degenerate poles problem of the Y‐parameters and the measurement noise. The proposed diagnosis method can be used in a filter tuning and speeds up its physical realization. The method is verified by a fabricated fourth‐order bandpass filter and a simulated substrate integrated waveguide dual‐mode filter with source–load couplings. © 2014 Wiley Periodicals, Inc. Int J RF and Microwave CAE 24:713–717, 2014.