Repetitive Delivery Scheme for Left and Right Views in Service‐Compatible 3D Video Service

This paper introduces a novel repetitive delivery scheme for the left and right views in service‐compatible (SC) 3D video that provides full backward compatibility to a legacy DTV system while retaining HD 3D visual quality without additional bandwidth or a codec over the legacy broadcasting channel. The proposed SC delivery scheme transmits individual view sequences of a 3D video in interlaced form, that is, a left‐view sequence of a 3DTV program to be used repeatedly is transmitted first and stored locally, and the right‐view sequence of the 3D program is then transmitted. This paper specifically describes the signaling, synchronization, and storage format methods used to validate the proposed SC delivery scheme. The experiment results show that the proposed SC delivery scheme can be effectively applied for an SC 3DTV service without degrading the DTV quality using only legacy DTV platforms.     

Efficient Multiplexing Scheme of Stereoscopic Video Sequences for Digital Broadcasting Services

This letter introduces a stereoscopic video broadcasting system that provides 3D visual service and has full backward compatibility with legacy digital television (DTV) service in the same channel capacity. The proposed stereoscopic video broadcasting system in this letter is composed of both a hybrid codec and a multiplexer with a newly defined stereoscopic‐related signaling method. In conclusion, the proposed method can be effectively applied for 3D broadcasting services without major changes in legacy broadcasting platforms.     

有线网络开展3DTV技术方案与应用研究

提出了有线网络开展3DTV直播、点播、节目注入和有线网络传输、机顶盒解码显示等系列技术方案,介绍了3D影像的技术路标,给出了有线网络开展3DTV技术方案,包括3D电视直播、点播平台以及3DTV传输格式与信道编码.对设计方案进行了应用验证,同时对开展3DTV的商用性进行了分析.     

Design of Synchronization and T‐STD Model for 3DTV Service over Hybrid Networks

The objective of digital broadcasting has evolved from providing a plain video service to offering a realistic visual experience. Technologies such as 3DTV and UHDTV have been suggested to achieve this new objective by providing an immersive and stereoscopic visual experience. However, owing to the high bandwidth requirements of such services, the broadcasting industry has faced a challenge to find a new transport mechanism for overcoming the bandwidth limitation. The standardization organizations, the Advanced Television Systems Committee, Digital Video Broadcasting, and Telecommunications Technology Association, have been working on the integration of broadcasting and a broadband network (IP) to resolve the bandwidth issue of realistic video services. This paper introduces a frame‐level timeline synchronization and transport system target decoder model for providing a stable 3DTV service over a hybrid network. The experimental results indicate that the proposed technologies can be successfully adopted as a reference model in a broadcast‐broadband hybrid 3DTV service and other IP‐associated hybrid broadcasting services.     

3D visual experience oriented cross-layer optimized scalable texture plus depth based 3D video streaming over wireless networks

3D video streaming over the mobile Internet generally incurs the inferior 3D visual experience due to the time-varying characteristics of wireless channel. The conventional video streaming optimization methods generally neglect the harmony among different networking protocol layers. This paper proposes a cross-layer optimized texture plus depth based scalable 3D video streaming method to improve the expected 3D visual experience of the user by systematically considering the application layer texture-video/depth/FEC bit-rate allocation, MAC layer multi-channel allocation, and physical layer modulation and channel coding scheme (MCS) selection. In the cross-layer optimization, a networking-related 3D visual experience model which fuses the overlapped retinal view visual quality and depth sensation with mimicking human vision system is established to predict the 3D visual experience under the specific parameter configurations of different protocol layers. The efficiency and effectiveness of the proposed cross-layer optimized 3D video streaming method has been validated by subjective and objective experimental results.     

An HDTV‐Compatible 3DTV Broadcasting System

We introduce a high‐definition three‐dimensional television (3DTV) broadcasting system that is fully compatible with the existing transmission system of high‐definition television (HDTV). Specifically, we developed high‐definition 3DTV broadcasting subsystems including a 3DTV camera, 3DTV video multiplexer and demultiplexer, 3DTV receiver, and 3DTV outdoor broadcast van. To verify the developed subsystems, we performed experimental services of 3DTV broadcasting during the 2002 FIFA World Cup Korea/Japan.. According to our subjective evaluation test, 88% of 273 viewers rated the perceived depth of 3DTV as “Good,” and 36% of the viewers preferred 3DTV to other digital broadcasting services.     

Small-world brain functional network altered by watching 2D/3DTV

With the development of display technology, the healthy problems caused by watching 2D/3DTV have received more and more attention. This paper utilized resting-state functional magnetic resonance imaging to study the changes of small-world brain network before and after one-hour 2D/3DTV watching, and explored the brain fatigue mechanism caused by watching 2D/3DTV. We conclude that one-hour watching of 2DTV will not increase the burden of brain. On the contrary, one-hour watching of 3DTV requires the brain to regulate the efficiency of brain areas, such as temporal lobe and occipital lobe, which may explain the fact that watching 3DTV can easier cause brain fatigue than watching 2DTV.     

Objective image quality assessment of 3D synthesized views

Depth-Image-Based-Rendering (DIBR) techniques are essential for three-dimensional (3D) video applications such as 3D Television (3DTV) and Free-Viewpoint Video. However, this process is based on 3D warping and can induce serious distortions whose impact on the perceived quality is far different from the one experienced in the 2D imaging processes. Since quality evaluation of DIBR-synthesized views is fundamental for the design of perceptually friendly 3D video systems, an appropriate objective quality metric targeting the assessment of DIBR-synthesized views is momentous. Most of the 2D objective quality metrics fail in assessing the visual quality of DIBR-synthesized views because they have not been conceived for addressing the specificities of DIBR-related distortions. In this paper, a new full-reference objective quality metric, 3DSwIM (3D Synthesized view Image Quality Metric), dedicated to artifacts detection in DIBR-synthesized view-points is presented. The proposed scheme relies on a comparison of statistical features of wavelet subbands of two input images: the original image and the DIBR-based synthesized image. A registration step is included before the comparison step so that best matching blocks are always compared to ensure “shifting-resilience”. In addition, a skin detection step weights the final quality score in order to penalize distorted blocks containing “skin-pixels” based on the assumption that a human observer is most sensitive to impairments affecting human subjects. Experimental tests show that the proposed method outperforms the conventional 2D and DIBR-dedicated quality metrics under test.     

Adaptive Pre‐/Post‐Filters for NRT‐Based Stereoscopic Video Coding

Non‐real‐time delivery of stereoscopic video has been considered as a service scenario for 3DTV to overcome the limited bandwidth in the terrestrial digital television system. A hybrid codec combining MPEG‐2 and H.264/AVC has been suggested for the compression of stereoscopic video for 3DTV. In this paper, we propose a stereoscopic video coding scheme using adaptive pre‐/post‐filters (APPF) to improve the quality of 3D video while retaining compatibility with legacy video coding standards. The APPF are applied adaptively to blocks of various sizes determined by the macroblock coding mode and reference frame index. Experiment results show that the proposed method achieves up to 24.86% bit rate savings relative to a hybrid codec of MPEG‐2 and H.264/AVC including the inter‐view prediction.     

分布式2D视频到3D视频转换系统

2D-to-3D video conversion is a feasible way to generate 3D programs for the current 3DTV industry. However, for large-scale 3D video production, current systems are no longer ade-quate in terms of the time and labor required for conversion. In this paper, we introduce a distributed 2D-to-3D video conversion system that includes a 2D-to-3D video conversion module, architecture of the parallel computation on the cloud, and 3D video cod-ing in the system. The system enables coope-ration among multiple users in the simultane-ous completion of their conversion tasks so that the conversion efficiency is greatly pro-moted. In the experiments, we evaluate the system based on criteria related to both time consumption and video coding performance.     

A Die‐Selection Method Using Search‐Space Conditions for Yield Enhancement in 3D Memory

Three‐dimensional (3D) memories using through‐silicon vias (TSVs) as vertical buses across memory layers will likely be the first commercial application of 3D integrated circuit technology. The memory dies to stack together in a 3D memory are selected by a die‐selection method. The conventional die‐selection methods do not result in a high‐enough yields of 3D memories because 3D memories are typically composed of known‐good‐dies (KGDs), which are repaired using self‐contained redundancies. In 3D memory, redundancy sharing between neighboring vertical memory dies using TSVs is an effective strategy for yield enhancement. With the redundancy sharing strategy, a known‐bad‐die (KBD) possibly becomes a KGD after bonding. In this paper, we propose a novel die‐selection method using KBDs as well as KGDs for yield enhancement in 3D memory. The proposed die‐selection method uses three search‐space conditions, which can reduce the search space for selecting memory dies to manufacture 3D memories. Simulation results show that the proposed die‐selection method can significantly improve the yield of 3D memories in various fault distributions.     

Analyzing the FCC's DTV spectral emission mask and potentialdegradation to adjacent channels due to antenna pattern differences

The FCC DTV spectral emission mask is analyzed with an NTSC subjective noise weighting function to determine the desired NTSC to undesired adjacent channel DTV signal ratio at the threshold of visibility of interference. Factors which alter the NTSC/DTV adjacent channel signal ratio at various receiving locations within the NTSC service are examined: (1) the azimuth patterns of the NTSC and DTV broadcast antennas; (2) the elevation patterns of the NTSC and DTV broadcast antennas; and (3) the centers of radiation of the NTSC and DTV broadcast antennas. These factors together with the NTSC/DTV authorized power ratio may make the DTV spillover spectrum exceed acceptable picture (and sound) interference levels even though compliance with the FCC DTV spectral emission mask is met. Spectral shaping solutions are examined by use of the NTSC subjective noise weighting     

System‐Level Performance of Spread Spectrum‐Based Add‐on Service Overlaid onto the Existing Terrestrial Digital Multimedia Broadcast Band

We consider an overlaid broadcast service, where a spread spectrum (SS)‐based broadcast signal is overlaid onto the existing terrestrial Digital Multimedia Broadcasting (T‐DMB) band. The system is similar to the augmented data transmission in the ATSC DTV, for which it was investigated mostly in terms of link level performance, such as bit error rate. Our focus in this paper is on the system‐level performances. More specifically, utilizing both a large scale path loss and a small scale fading channel model, the primary objective is to explore the tradeoff between the coverage and the achievable rate of the overlaid service and, finally, to determine the achievable rate in the overlaid service for marginal coverage reduction in the existing broadcast service. The analytical and simulation results show that an SS‐based add‐on service of 10 kbps to 20 kbps can co‐exist with the T‐DMB service while resulting in only a marginal degradation in T‐DMB coverage (for example, less than one percent reduction).     

基于优化BM3D的毫米波大规模MIMO信道估计

针对毫米波大规模多入多出系统在射频链路数量有限时,波束域信道估计是一个有挑战性的问题,提出一种基于优化BM3D的信道估计方案。利用基于三维透镜的多入多出系统信道矩阵可被视为二维自然图像的结构特性,将图像重构技术融入信道估计。BM3D 是目前最精确的图像去噪算法之一,通过块匹配实现分组,利用三维变换域的收缩完成协同滤波。考虑信道的稀疏特性和路径的聚类特性,对BM3D算法进一步优化以提高性能。仿真结果表明,提出的优化BM3D方案在所有考虑的信噪比区域均能取得令人满意的信道估计精度。     

新一代基于HEVC的3D视频编码技术

HEVC标准出台后,新一代基于HEVC的多视点加深度编码也将正式推出。基于HEVC的3D视频编码作为HEVC标准的扩展部分,主要面向立体电视和自由立体视频。从该编码方式的基本结构出发,较全面地介绍了视频编码方式、深度图编码方式和对深度图的编码控制三个方面的关键技术,包括视点间运动预测、深度图建模模式和视点合成优化等技术。     

Impact of 2D and 3D display watching on EEG power spectra: A standardized low-resolution tomography (sLORETA) study

We investigated whether watching two-dimensional television (2DTV) or three-dimensional television (3DTV) resulted in differences in the brain’s processing of sensory information. We divided 25 participants into 2DTV (n = 13) and 3DTV (n = 12) groups. Participants watched 2DTV or 3DTV for 1, 2, or 3 h on different days. Before and at the end of each session, electroencephalography (EEG) was recorded for 10 min. The Simulation Sickness Questionnaire (SSQ) and the Visual Analog Scale (VAS) were used to assess general discomfort before and after watching. Each frequency band of the resting EEG was transformed into a standardized low-resolution electromagnetic tomographic (sLORETA) image. In the 2DTV group, 2 h of watching increased theta power in the central cortex and 3 h of watching increased beta power in the occipital cortex. In the 3DTV group, 3 h of watching increased delta power in the parahippocampal gyrus and middle frontal cortex. Theta power was significantly higher in the insular cortex after 3 h of 3DTV than after 3 h of 2DTV. SSQ scores were significantly higher after 1 h of 2DTV than after 1 h of 3DTV. Watching 2DTV vs. 3DTV triggered different time-dependent activity patterns. Watching 3DTV for 3 h increased slow-wave activity in the prefrontal cortex, while watching 2DTV increased fast-wave activity in the occipitoparietal cortex. Up to 2 h of 3DTV watching did not cause major changes in fatigue or EEG activity compared with 2DTV. Our findings promise to be useful in designing safety guidelines for watching 3DTV.     

基于3D空间信道模型的3D波束赋形技术研究

移动数据流量爆炸式增长对小区吞吐量提出了更高的要求,同时智能终端的急剧增多,使终端之间的信号干扰越来越严重。传统基站天线阵列下倾角是固定的,波束之间干扰较大。随着有源天线技术的逐渐成熟,通过垂直维度的波束赋形动态改变天线的下倾角已经成为可能。本文通过分析已有的空间信道模型,研究了基于球形坐标系统的空间信道模型的建模方法,为3D动态波束赋形技术评估提供了信道基础;并且在提出的3D信道模型基础上评估了动态调整波束的下倾角可以减少用户之间的干扰,提高小区的吞吐量。     

三维监控系统中基于三维重构的交互式标定

标定多个监控摄像机的位姿是智能监控系统的基础.传统的标定方法需人工逐一标定每个目标摄像机,且难以处理非重叠监控视场以及摄像机运动和扰动的情况.对此本文提出一种基于三维重构的交互式标定框架,通过引入场景三维特征点云作为中间层,仅需一次性建立其与参考背景模型间的几何变换关系,即可通过目标摄像机图像与三维点云的匹配实现自适应标定,可显著降低工作量.由于匹配是建立在监控图像与三维点云之间而非监控图像之间,因此可以处理监控视场非重叠的情况.对于摄像机运动和扰动,提出了一种在线相对姿态传递方法,能够克服摄像机扰动和运动带来的姿态变化问题.实验证明了本文方法的有效性.