MPEG-4 FGS流媒体的常质量GOP带宽分配机制

分析MPEG-4FGS的位平面R-D模型，提出一种基于场景的常质量GOP带宽分配机制及GOP带宽分配的静态算法和动态算法，以保证同一场景内连续GOP的质量稳定．实验结果表明：常质量GOP带宽分配机制能够平滑一场景内连续GOP的质量，并且连续帧的质量波动也较小．     

基于GOP取帧和跳数的自适应协作ARQ

为给多媒体数据传输提供有效QoS保障,提出一种适用于无线多媒体传感器网络数据传输的自适应协作ARQ机制。采用跨层设计的方法,分析ARQ机制协作传输跳数与能效的规律,根据节点间通信距离自适应选取最优协作传输跳数,结合数据帧跳数,自适应调整最大重传次数,根据快进快退码率基于帧间依赖关系进行GOP取帧。分析结果表明,该机制在丢包率和端到端平均时延方面与传统ARQ相比具有较优的性能,能有效提高无线多媒体传感器网络通信的可靠性和实时性。     

基于错误传播模型的非均等视频流丢失保护

提出一种适用于丢包网络、面向图像组（GOP）层的非均等视频流丢失保护方案。利用GOP中不同帧之间的非均等显著性,将不同数量前向错误校正包分配到GOP层的不同帧中。采用帧间包交错机制将突发包丢失分散到不同帧上,提高处理突发包丢失时的鲁棒性。仿真结果表明,在不同信道丢失模式下,该方案能提高视频接收质量。     

场景切换视频自适应帧间码率控制

针对视频帧中可能出现的大量场景切换,提出一种基于非连接点的场景切换检测算法,提高编码性能,该场景检测算法复杂度低,在运动估计的同时,完成视频场景切换检测。场景切换将导致GOP(group of pictures)长度的变化,并可能出现GOP长度太短的情况。提出改进的自适应GOP时域滤波技术,避免由于GOP太短引起的编码性能下降。针对视频场景切换检测分割出的不同长度的GOP,提出一种基于率失真模型的帧间码率控制算法,利用视频的失真与码率及视频帧复杂度的关系,对帧间码率分配进行优化,提高重构视频帧的总质量。实验结果表明,基于场景检测的自适应帧间码率控制算法能够获得较好的编码性能。     

基于TCP友好速率控制和前向纠错的MPEG-2视频传输

针对Internet视频传输面临拥塞控制和数据包丢失的问题，结合TCP友好的速率控制算法和前向纠错机制建立视频传输的分层体系构架和控制策略。传输体系同时采用以GOP为基本分析单元的视频帧速率预测模型，实现根据网络丢包率的变化动态地优化配置前向纠错的冗余信息。实验证明，传输体系采用动态优化的前向纠错能实时地适应带宽的变化，有效地降低数据包丢失带来的影响，从而改善视频回放质量。     

基于RTP/RTCP主动丢包的立体视频传输研究

针对立体视频数据量大容易在传输过程中导致网络拥塞的问题,提出一种端到端的拥塞控制传输机制。在NS-2平台上,根据RTP/RTCP在反馈间隔内对丢包个数的反馈信息以及各帧重要性不同的特点,采用在发送端主动丢包的方法优先丢弃不重要的数据,保证较重要的数据信息优先传输。实验结果表明,该机制能有效保护重要帧,增加可解码帧数,增强视频平滑度,与不采用保护拥塞控制相比,可解码帧数均能提高25%以上。     

支持IPTV高清码流连续平滑播放的多级缓冲区设计与实现

把流媒体系统作为一个复杂的控制系统进行研究,给出支持多级反馈控制机制的系统框图,重点分析媒体播放器从流接收到播放的全过程.同时,为了提高用户体验质量,实现音视频流在接收端的连续平滑播放,设计了多级缓冲机制以减少IP网络抖动和丢包产生的影响,实现了根据接收端的解码能力,自适应地选择解码层次和调整帧播放速率.最终采用多线程技术实现了MPEG-2 TS复用H.264高清视频流的解码播放,并给出试验结果.     

H.264/SVC比特自适应分配的等级B帧码率控制算法

为减少码率控制中实际输出码率与目标码率之间的误差,改善视频序列编码尾部质量下降的缺陷,同时针对可伸缩视频编码中码率控制算法的不足,提出一种自适应比特分配的码率控制算法。算法基于对根据相邻图像帧之间的相关性以及对恒定质量的考虑,在图像组(GOP)之间平均分配目标比特,而在GOP内部则根据编码复杂度自适应分配目标比特,同时适当调整初始量化参数(QP),再根据目标比特分别计算P帧、B帧的QP。对不同的视频序列进行了实验测试,其结果验证了算法的准确性和有效性。     

一种帧级无线视频传输不平等保护策略

针对信源不平等保护内容划分这一问题，提出了一种基于帧级的无线视频传输不平等保护策略．这种策略通过分析计算GOP中各种编码模式帧的重要性，从而实现选择性保护B帧、选择性丢弃B帧和选择性丢弃B／P帧的算法，通过这些算法来保护视频GOP中对整体恢复质量影响较大的数据，同时主动放弃部分对整体质量影响较小的数据，以此来达到恢复质量整体最优的目标．实验结果证明了基于这些算法的不平等保护策略的有效性．     

实时语音的自适应回放算法

由于丢包和延时抖动的引入而使网络传输的实时语音质量让人难以接受，目前对丢包和延时抖动提出了很多的解决方案．但是却很少把这两者结合在一起进行研究。本文提出了一种新的自适应回放算法，通过监测接收和回放队列，结合丢包的自适应恢复技术，达到语音高质量的连续回放。实验证明，该算法能在严格的平均回放延时条件下努力减小由于超时而引起的丢包，获得较好的重建语音质量。     

XOR-based frame loss recovery scheme for video streaming

High coding dependencies among video frames suffer from vulnerability to packet loss, which impacts the playback quality of video streaming. In this paper, according to the characteristics of MPEG4/H.264 encoding methods, we propose a simple and low-complexity XOR-based FEC frame loss recovery scheme. Within an entire Group of Pictures (GOP), the proposed scheme shows the ability to recover simultaneously I-frame loss and one P-frame loss. The high frame loss resilience improves the playback QoS of compressed video streaming. The mathematical analysis reveals that the proposed scheme has 72.7% performance improvement than no frame loss protection in term of full GOP frames successful decoding rate.     

An error-resilient GOP structure for robust video transmission

Recent advances in technology have resulted in a significant growth in wireless communications and widespread access to information via the Internet, which have resulted in a strong demand for reliable transmission of video data. The challenge of robust video transmission is to protect the compressed data against hostile channel conditions while bringing little impact on bandwidth efficiency. In motion-compensated video-coding schemes, such as MPEG-1 or MPEG-2, an I frame normally is followed by several P frames and possibly B frames in a group-of-pictures (GOP). In error-prone environments, error happening in the previous frames in a GOP may propagate to all the following frames until the next I frame, which is the beginning of the next GOP. In this paper, we propose a novel GOP structure for robust transmission of MPEG video bitstream. By selecting the optimal position of the I frame in a GOP, robustness can be achieved without reducing any coding efficiency. Another advantage of the proposed GOP structure is also analyzed: compared with the conventional GOP structure, it provides reverse-play operation for MPEG video streaming with much less requirement on the network bandwidth. Experimental results demonstrate both the robustness of the proposed GOP structure and the efficient reverse-play functionality it leads to.     

A new multi-level statistical model for variable bit rate MPEG sources over ATM networks and its performance study

In this paper, we propose a new traffic model for MPEG-coded video sequences. The proposed modeling scheme uses scene-based traffic characteristics and considers the correlations between frames of consecutive group of pictures (GOPs). Using a simple scene detection algorithm, scene changes are modeled by a state transition matrix and the number of GOPs of a scene state is modeled by a geometric distribution. Frames of a scene are modeled by the mean I, P, and B frame sizes of each state. For more accurate traffic modeling, the residual bits that represent the difference between the original frame size and the mean frame size of each frame type are compensated by autoregressive processes. The modeling results show that our scene-based model can capture the statistical traffic characteristics of the original video sequences well and estimate the queueing performance with good approximation quality.     

一种面向视频应用的有效实时码率控制算法

为提供实时视频传输服务,同时保证一定的视频质量,提出了一种基于JVT-G012的动态码率控制算法。在编码过程中,根据图像内容的运动特性,动态决定GOP长度,同时防止输出缓冲器的上溢和下溢;为复杂度较高的宏块（MB）分配较多的比特。实验结果表明,该算法对于场景变化较大的实际视频序列有较好的编码效果。     

一种低延迟限制下H.264码率控制算法

对于实时、双向视频通信而言,减少传输时所造成的延迟是十分重要的。本文针对H.264视频压缩编码标准,提出了一种在低延迟条件下,仍可维持高画质并避免缓存区溢出的码率控制算法。鉴于I帧量化参数的选择对于整个GOP编码比特及失真的影响,本文通过对整个GOP的预测码率和失真做率失真优化,来选择可以平衡整个GOP编码量和失真的量化参数。同时增加一个主动跳帧策略,在缓存区未达饱和状态时,仍主动跳过一些并不重要的图像,而留出区空间使那些相对重要的图像可以保留。实验结果表明,在低延迟条件下,本文的方法不论在避免跳帧和维持画质方面均高于JVT新近采纳的JVT-H017提案。     

Cross-Layer prioritized H.264 video packetization and error protection over noisy channels

Video transmission over wireless channels is affected by channel-induced packet losses. Distortion due to channel errors can be alleviated by applying forward error correction. Aggregating H.264/AVC slices to form video packets with sizes adapted to their importance can also improve transmission reliability. Larger packets are more likely to be in error but smaller packets require more overhead. We present a cross-layer dynamic programming (DP) approach to minimize the expected received video distortion by jointly addressing the priority-adaptive packet formation at the application layer and rate compatible punctured convolutional (RCPC) code rate allocation at the physical layer for prioritized slices of each group of pictures (GOP). Some low priority slices are also discarded to improve protection to more important slices and meet the channel bit-rate limitations. We propose two schemes. Our first scheme carries out joint optimization for all slices of a GOP at a time. The second scheme extends our cross-layer DP-based approach to slices of each frame by predicting the expected channel bit budget per frame for live streaming. The prediction uses a generalized linear model developed over the cumulative mean squared error per frame, channel SNR, and normalized compressed frame bit budget. The parameters are determined over a video dataset that spans high, medium and low motion complexity. The predicted frame bit budget is used to derive the packet sizes and corresponding RCPC code rates for live transmission using our DP-based approach. Simulation results show that both proposed schemes significantly improve the received video quality over contemporary error protection schemes.     

MPEG压缩域多尺度镜头切变检测算法

如何在压缩域进行镜头的切变检测一直是视频自动索引和检索中的难点。提出了一种MPEG压缩域多尺度镜头切变检测算法,在GOP、slot和B帧三个尺度上对MPEG视频流进行分析。通过对相邻I帧的检测,确定一个GOP中是否存在镜头切变;通过对slot的分析,确定镜头切变在GOP中所处的区域;通过对B帧的检测,确定镜头切变发生的确切位置。