Grouped Approach for the Design of H.264/AVC Motion Estimation Architectures

This letter presents a novel approach for organizing computational resources into groups within H.264/AVC motion estimation architectures, leading to reductions of up to 75% in the equivalent gate count with respect to state‐of‐the‐art designs.     

Foveation-Based Error Resilience and Unequal Error Protection over Mobile Networks

By exploiting new human-machine interface techniques, such as visual eyetrackers, it should be possible to develop more efficient visual multimedia services associated with low bandwidth, dynamic channel adaptation and robust visual data transmission. In this paper, we introduce foveation-based error resilience and unequal error protection techniques over highly error-prone mobile networks. Each frame is spatially divided into foveated and background layers according to perceptual importance. Perceptual importance is determined either through an eye tracker or by manually selecting a region of interest. We attempt to improve reconstructed visual quality by maintaining the high visual source throughput of the foveated layer using foveation-based error resilience and error correction using a combination of turbo codes and ARQ (automatic reQuest). In order to alleviate the degradation of visual quality, a foveation based bitstream partitioning is developed. In an effort to increase the source throughput of the foveated layer, we develop unequal delay-constrained ARQ (automatic reQuest) and rate compatible punctured turbo codes where the punctual pattern of RCPC (rate compatible punctured convolutional) codes in H.223 Annex C is used. In the simulation, the visual quality is significantly increased in the area of interest using foveation-based error resilience and unequal error protection; (as much as 3 dB FPSNR (foveal peak signal to noise ratio) improvement) at 40% packet error rate. Over real-fading statistics measured in the downtown area of Austin, Texas, the visual quality is increased up to 1.5 dB in PSNR and 1.8 dB in FPSNR at a channel SNR of 5 dB.     

TES modeling for analysis of a video multiplexer

The transport of video images is likely to be a major application of high-speed networks of the future. These applications are capable of utilizing the high bandwidths that will become available with the advent of B-ISDN. In this paper, we propose a new methodology (called TES) for modeling the frame bitrate stream generated by compressed video sources. The main characteristic of this method is that it can model an arbitrary marginal distribution and approximate the autocorrelation structure of the random bitrate process generated by compressed frames. We present a modeling example utilizing this method, based on data from a video coding algorithm employing a layering technique. Using the source model, we develop a simulation model of a multiplexer of video sources. We show that this model can be used to address a number of design issues that arise in this class of problem. In particular, we show that for a layered video coding algorithm, it is possible to have a gain in the number of sources multiplexed at the cost of some loss of low priority packets.     

A Video Server cost/performance Estimator tool

The Video Server Estimator (VSE) is an analytical tool which allows a user to perform a cost/performance analysis of video servers with hierarchical storage. The underlying model comprises multiple systems, main memory, expanded storage, disks and a tape library. The main objective of the tool is to optimally allocate the video files to different storage media based on the system parameters and the video file request probability distribution. The cost and the size of the video server that can accommodate a customer profile are determined. Furthermore, the impact of design parameters on the cost and performance are examined through a parametric analysis.     

CAL delivery selection criteria and authoring systems

Abstract  In the past, authoring systems have been used to generate computer-assisted learning materials that have often followed the rather restrictive programmed learning format. A number of innovative ways of using recently developed systems to develop CAL packages that include a wider range of learning activities (access to data bases, simulations, interactive video, etc.) are described. Analogous to the concept of a media selection model, a computer delivery mode selection model is presented as an aid to decision making for designers. This increase in flexibility should broaden the applicability of computerassisted learning (CAL) to a wider range of educational objectives and raise the level of the cognitive emphasis in learning packages, as well as facilitate the implementation of visually appealing materials. The paper also implies a standard of acceptability for authoring systems.     

基于iebook的电子书播放外部视频功能的实现

Exe类型电子书制作软件集成文字内容和小图片非常容易,效果也很不错,但是对集成高品质的音视频、数码照片等大容量数据文件却无能为力。通过对iebook超级精灵自带模板以及Exe电子书文件的深入分析,把flash技术、流媒体对象和file协议有机结合,实现动态加载指定相对路径下的外部视频文件到电子书中,大大提高了iebook超级精灵在处理多媒体方面的实用性。     

分层码率控制策略在机器人遥操作中的应用

为实现卫星自维护遥操作系统中稳定可靠的视频反馈目标,提出一种基于分层码率控制的视频传输策略.利用实时探测到的带宽选择不同码率的视频流分层,使得视频传输对于不同的网络带宽具有自适应性.试验结果表明,该策略能够在波动带宽下给予遥操作者稳定流畅的视频反馈,有效地提高了遥操作系统的视觉临场感性能.     

基于模糊神经网络的大场景人群密度估计方法 *

提出了一种估计大场景下密集人群密度的方法。该方法根据人类视觉的模糊性原理,认为用模糊集来划分人群密度范围比用确定的方法更符合人眼视知觉的认知方式,利用统计的方法确定灰度共生矩阵各指标对于各个密度类别的隶属函数;设计基于误差反向传播训练算法（BP）的模糊神经网络,计算样本模式对于各个密度类别的隶属度,并根据人群密度变化的时域连续性原理对人群密度范围进行合理估计。实验表明该方法提高了估计精度。     

基于视频帧的彩色水印嵌入算法研究

为了增强水印的内容认证性,提出了视频帧中嵌入彩色水印的算法.先分别选取I帧的单色通道做DCT变换,分块后提取奇异值,将彩色水印的对应通道层做DWT变换,对低频区域置乱后提取奇异值,再将水印奇异值嵌入到载体奇异值中,然后由三色通道合成水印视频图像.最后进行了攻击实验,实验结果表明,该算法具有较好的水印提取能力和一定的鲁棒性.     

基于JMF的音视频会议系统的研究与实现

介绍了Java媒体框架应用编程接口（JMF）的结构特点及其实时传输协议（RTP）支持,实现了端对端的实时音视频网络会议系统.文中阐述了小型多人视频会议系统的工作原理以及RTP传输、数据源复用等关键技术问题,最后重点描述了基于JMF的音视频会议系统的设计方案,并详细介绍了系统软件的具体实现.