An image super-resolution algorithm for different error levels per frame.

In this paper, we propose an image super-resolution (resolution enhancement) algorithm that takes into account inaccurate estimates of the registration parameters and the point spread function. These inaccurate estimates, along with the additive Gaussian noise in the low-resolution (LR) image sequence, result in different noise level for each frame. In the proposed algorithm, the LR frames are adaptively weighted according to their reliability and the regularization parameter is simultaneously estimated. A translational motion model is assumed. The convergence property of the proposed algorithm is analyzed in detail. Our experimental results using both real and synthetic data show the effectiveness of the proposed algorithm.     

Cross-layer optimization for video transmission over multirate GMC-CDMA wireless links.

In this paper, we consider the problem of video transmission over wireless generalized multicarrier code division multiple access (GMC-CDMA) systems. Such systems offer deterministic elimination of multiple access interference. A scalable video source codec is used and a multirate setup is assumed, i.e., each video user is allowed to occupy more than one GMC-CDMA channels. Furthermore, each of these channels can utilize a different number of subcarriers. We propose a cross-layer optimization method to select the source coding rate, channel coding rate, number of subcarriers per GMC-CDMA channel and transmission power per GMC-CDMA channel given a maximum transmission power for each video user and an available chip rate. Universal rate distortion characteristics (URDC) are used to approximate the expected distortion at the receiver. The proposed algorithm is optimal in the operational rate distortion sense, subject to the specific setup used and the approximation caused by the use of the URDC. Experimental results are presented and conclusions are drawn.     

Rate-Distortion Optimized Video Transmission Over DS-CDMA Channels with Auxiliary Vector Filter Single-User Multirate Detection

In this paper, we consider the rate-distortion optimized resource allocation for video transmission over multi-rate wireless direct-sequence code-division-multiple-access (DS-CDMA) channels. We consider the performance of transmitting scalable video over a multipath Rayleigh fading channel via a combination of multi-code multirate CDMA and variable sequence length multirate CDMA channel system. At the receiver, despreading is done using adaptive space-time auxiliary-vector (AV) filters. We propose a new interference cancelling design that uses just a single AV filter for single-user mutirate despreading. Our experimental results show that the proposed interference cancelling design has excellent performance in scalable video transmission over DS-CDMA systems that use a combination of multicode multirate and variable processing gain multirate CDMA. The proposed design takes advantage of the fact that single user's video data is transmitted using two spreading codes, one for the base layer and one for the enhancement layers, and of the fact that these spreading codes can have different processing gains. The proposed interference cancelling design is compared with two conventional single-user multirate CDMA receiver configurations, however now we use an AV filter rather than a simple matched filter. We also propose a resource allocation algorithm for the optimal determination of source coding rate, channel coding rate and processing gain for each scalable layer, in order to minimize the expected distortion at the receiver.     

MPEG-4 and rate-distortion-based shape-coding techniques

We address the problem of the efficient encoding of object boundaries. This problem is becoming increasingly important in applications such as content-based storage and retrieval, studio and television postproduction, and mobile multimedia applications. The MPEG-4 visual standard will allow the transmission of arbitrarily shaped video objects. The techniques developed for shape coding within the MPEG-4 standardization effort are described and compared first. A framework for the representation of shapes using their contours is presented next. Such representations are achieved using curves of various orders, and they are optimal in the rate-distortion sense. Finally, conclusions are drawn     

An operational rate-distortion optimal single-pass SNR scalablevideo coder

We introduce a new methodology for signal-to-noise ratio (SNR) video scalability based on the partitioning of the DCT coefficients. The DCT coefficients of the displaced frame difference (DFD) for inter-blocks or the intensity for intra-blocks are partitioned into a base layer and one or more enhancement layers, thus, producing an embedded bitstream. Subsets of this bitstream can be transmitted with increasing video quality as measured by the SNR. Given a bit budget for the base and enhancement layers the partitioning of the DCT coefficients is done in a way that is optimal in the operational rate-distortion sense. The optimization is performed using Lagrangian relaxation and dynamic programming (DP). Experimental results are presented and conclusions are drawn     

New temporal filtering scheme to reduce delay in wavelet-based video coding.

Scalability is an important desirable property of video codecs. Wavelet-based motion-compensated temporal filtering provides the most powerful scheme for scalable video coding and provides high-compression efficiency that competes with the current state of art codecs. However, the delay introduced by the temporal filtering schemes is sometimes very high, which makes them unsuitable for many real-time applications. In this paper, ue propose a new temporal filter set to minimize delay in 3-D wavelet-based video coding. The new filter set gives a performance at par with existing longer filters. The length of the filter can vary from two to any number of frames depending on delay requirements. If the frames are processed as separate groups of frames (GOFs), the proposed filter set will not have any boundary effects at the GOF. Experimental results are presented and conclusions are drawn.     

Accurate image registration for MAP image super-resolution

The accuracy of image registration plays a dominant role in image super-resolution methods and in the related literature, landmark-based registration methods have gained increasing acceptance in this framework. In this work, we take advantage of a maximum a posteriori (MAP) scheme for image super-resolution in conjunction with the maximization of mutual information to improve image registration for super-resolution imaging. Local as well as global motion in the low-resolution images is considered. The overall scheme consists of two steps. At first, the low-resolution images are registered by establishing correspondences between image features. The second step is to fine-tune the registration parameters along with the high-resolution image estimation, using the maximization of mutual information criterion. Quantitative and qualitative results are reported indicating the effectiveness of the proposed scheme, which is evaluated with different image features and MAP image super-resolution computation methods.     

Joint source-channel coding for motion-compensated DCT-based SNR scalable video

In this paper, we develop an approach toward joint source-channel coding for motion-compensated DCT-based scalable video coding and transmission. A framework for the optimal selection of the source and channel coding rates over all scalable layers is presented such that the overall distortion is minimized. The algorithm utilizes universal rate distortion characteristics which are obtained experimentally and show the sensitivity of the source encoder and decoder to channel errors. The proposed algorithm allocates the available bit rate between scalable layers and, within each layer, between source and channel coding. We present the results of this rate allocation algorithm for video transmission over a wireless channel using the H.263 Version 2 signal-to-noise ratio (SNR) scalable codec for source coding and rate-compatible punctured convolutional (RCPC) codes for channel coding. We discuss the performance of the algorithm with respect to the channel conditions, coding methodologies, layer rates, and number of layers.