A noise resistant synchronization scheme for HDTV images

A method that increases the error resistance of the HDTV system and offers graceful picture degradation in the presence of bit errors, is presented. Due to the nature of the presently proposed compression schemes for HDTV systems, an error in a data bit does not only affect the block the bit belongs to, but unfortunately the effects of this error may perpetuate to the following blocks. This is because a bit error may cause loss of synchronization between the data bits and the picture blocks they represent. Our method restricts the effects of a bit error to a picture block whose size is significantly smaller than those used by the HDTV systems. We achieve synchronization by transmitting a header-word for each such synchronization block. Each header-word contains the number of data bits representing the compressed block. This header-word is protected by two levels of FEC code. To decrease the number of extra bits needed by the header-words, two different synchronization block sizes are used, a relatively small block size for the reference frames and a larger size for the inter-frames. The resulting method improves the quality of the picture in the presence of errors and defers the SNR at which the HDTV picture suddenly deteriorates by 2.5 to 3 dB. It also allows operation at higher order modulation transmission schemes, e.g., 32-QAM instead of 16-QAM, without the requirement of increased signal power     

A learning-based visual saliency prediction model for stereoscopic 3D video (LBVS-3D)

Saliency prediction models provide a probabilistic map of relative likelihood of an image or video region to attract the attention of the human visual system. Over the past decade, many computational saliency prediction models have been proposed for 2D images and videos. Considering that the human visual system has evolved in a natural 3D environment, it is only natural to want to design visual attention models for 3D content. Existing monocular saliency models are not able to accurately predict the attentive regions when applied to 3D image/video content, as they do not incorporate depth information. This paper explores stereoscopic video saliency prediction by exploiting both low-level attributes such as brightness, color, texture, orientation, motion, and depth, as well as high-level cues such as face, person, vehicle, animal, text, and horizon. Our model starts with a rough segmentation and quantifies several intuitive observations such as the effects of visual discomfort level, depth abruptness, motion acceleration, elements of surprise, size and compactness of the salient regions, and emphasizing only a few salient objects in a scene. A new fovea-based model of spatial distance between the image regions is adopted for considering local and global feature calculations. To efficiently fuse the conspicuity maps generated by our method to one single saliency map that is highly correlated with the eye-fixation data, a random forest based algorithm is utilized. The performance of the proposed saliency model is evaluated against the results of an eye-tracking experiment, which involved 24 subjects and an in-house database of 61 captured stereoscopic videos. Our stereo video database as well as the eye-tracking data are publicly available along with this paper. Experiment results show that the proposed saliency prediction method achieves competitive performance compared to the state-of-the-art approaches.

     

Effective multi-program broadcasting of prerecorded video using VBR MPEG-2 coding

The tradeoff between picture quality and bandwidth usage is a prominent issue in the world of broadcasting. Since broadcasters are able to transmit multiple streams simultaneously in a channel, they face the challenge of guaranteeing the contracted picture quality required by each of the transmitted video streams while maximizing the number of video streams carried in each channel. We have developed an easy to implement MPEG-2 based multi-program video coding system suitable for digital TV broadcast, video on demand, and high definition TV over broadcast satellite networks with limited bandwidth. Compared to present broadcast systems and for the same level of contracted picture quality, our system greatly increases the number of video streams transmitted in each channel. As a result, either a large number of transponders can be freed to carry real-time broadcasting or the level of picture quality can be significantly increased. By switching from tape storage to video server technology, the need for numerous playback (VTR) systems at the headend is eliminated. In addition, the most of the complete MPEG-2 encoders are replaced by much less complex MPEG-2 transcoders. All this means a much more cost-effective solution for broadcast stations.     

Efficient Lossless Compression of 4-D Medical Images Based on the Advanced Video Coding Scheme

This paper presents an efficient lossless compression method for 4-D medical images based on the advanced video coding scheme (H.264/AVC). The proposed method efficiently reduces data redundancies in all four dimensions by recursively applying multiframe motion compensation. Performance evaluations on real 4-D medical images of varying modalities including functional magnetic resonance show an improvement in compression efficiency of up to three times that of other state-of-the-art compression methods such as 3D-JPEG2000.     

Adaptive compression coding

A compression technique which preserves edges in compressed pictures is developed. The proposed compression algorithm adapts itself to the local nature of the image. Smooth regions are represented by their averages and edges are preserved using quad trees. Textured regions are encoded using BTC (block truncation coding) and a modification of BTC using look-up tables. A threshold using a range which is the difference between the maximum and the minimum grey levels in a 4×4 pixel quadrant is used. At the recommended value of the threshold (equal to 18), the quality of the compressed texture regions is very high, the same as that of AMBTC (absolute moment block truncation coding), but the edge preservation quality is far superior to that of AMBTC. Compression levels below 0.5-0.8 b/pixel may be achieved     

Guidelines for an improved quality of experience in 3‐D TV and 3‐D mobile displays

Stereoscopic (3‐D) movies have become widely popular all over the world. In addition, 3‐D TVs and mobile devices have already been introduced to the consumer market. However, while some manufacturers are introducing 3‐D cameras and movie studios are using proprietary solutions, there are no guidelines for consistently capturing high‐quality stereoscopic content. In this paper, a comprehensive stereoscopic image and video database with content captured at various distances from the camera lenses and under different lighting conditions will be presented. Subjective tests to assess the perceived 3‐D quality of these videos and images, which were shown on displays of different sizes, have been conducted. In addition, the horizontal parallax of the content was adjusted to verify via subjective tests whether this change could increase the viewer's quality of experience. Finally, guidelines of acquisition distances between the cameras and the real scene will be published.     

Metameric failure assessment and reduction between RGB and laser phosphor projectors

Metameric failure is commonly observed when different types of displays reproduce the same color, as it is defined by a colorimetry system, but the outputs do not match visually. Metameric failure is impacted by the used colorimetry system and the relation between the involved displays' spectral power distributions (SPDs). In this work, we assess the metameric failure between the upcoming types of theatrical projectors, RGB laser, and laser phosphor (LaPH) and propose a method to reduce it. Our analysis starts by evaluating the performance of existing colorimetry systems in terms of metameric failure reduction. Among the colorimetry systems tested, the CIE 2006 2° (CIE06 2°) system resulted in the least observed metameric failure for a large portion of the participants but not their absolute majority (>50%). The limited performance of existing colorimetry systems led us to questioning the feasibility of successful perceptual color matching between the two projectors. To explore and potentially rule-out this scenario, we performed a subjective color matching experiment. The analysis of the results revealed the key role that the projectors' SPD differences play on color matching. Based on the observations of the first two studies, we propose a novel colorimetry system that reduces further than existing colorimetry the systems the metameric failure between RGB and LaPH projectors. Our proposed system is a modified version of CIE06–2° that accounts for the spectral differences of the two light sources. Evaluation showed that our solution outperforms existing colorimetry systems.     

A high-quality fixed-length compression scheme for color images

We present a new compression method which compresses 8×8 picture blocks by fixed-length codewords. The compression operation is performed on the discrete cosine transforms, DCT, of each block. As a result, our method combines the distinct advantage of being fixed-length with the high image quality obtained by the DCT based compression methods. Our method has excellent error-resistance characteristics since it does not have the synchronization and error propagation problems inherent in variable-length coding methods     

Data transmission schemes for DVD-like interactive TV

Current interactive services for digital TV are limited. They basically display a Web page alongside the TV program, which enhances the viewer's experience by providing extra information about the TV program. We define new interactive services for digital TV, which provide DVD-like interactivity to TV viewers. These services enable viewers to control the content and final presentation of a TV program. Some of the attractive applications of our services include parental management, multilingual audio, multiangle video, video in video, etc. The challenge in implementing these services is in transmitting an extra audio or video stream (called incidental) along with the main streams of the TV program. In the first part of this paper, we present a framework for adding the incidental streams to the original transmission stream without increasing the required bandwidth, degrading the picture quality of the main streams, or violating the compatibility of the transmitted stream with standard TV receivers. In the second part of this paper, we explore the two basic mechanisms of the presented framework: traffic characterization and admission control. We present methods for implementing these mechanisms. Using our methods, one can determine whether a TV transmission network has the capability of sending an incidental stream or not. Simulations were conducted to test the validity of our method. The results verify that our method successfully transmits the incidental streams without any discrepancy and without affecting the quality of the main streams.