三维视频编码技术的发展与挑战

介绍了三维视频编码的核心技术。首先比较了纯视频格式和深度增强格式三维视频编码技术的发展方向及面临的挑战,其中重点分析了深度估计技术和视点合成技术的研究思路;然后概括了国际3DV/FTV标准的制定现状;最后对三维视频编码技术进行了总结和展望。     

结合立体视觉舒适度的立体图像显著性检测

针对先前的立体图像显著性检测模型未充分考虑立体视觉舒适度和视差图分布特征对显著区域检测的影响,提出了一种结合立体视觉舒适度因子的显著性计算模型.该模型在彩色图像显著性提取中,首先利用SLIC算法对输入图像进行超像素分割,随后进行颜色相似区域合并后再进行二维图像显著性计算;在深度显著性计算中,首先对视差图进行预处理;然后基于区域对比度进行显著性计算;最后,结合立体视觉舒适度因子对二维显著图和深度显著图进行融合,得到立体图像显著图.在不同类型立体图像上的实验结果表明,该模型获得了85%的准确率和78%的召回率,优于现有常用的显著性检测模型,并与人眼立体视觉注意力机制保持良好的一致性.     

基于全景相机的3D坐标测量方法

全景相机通过一次成像获取其周围3600场景,是一种大视场快速图像采集装置。研究了应用双鱼眼全景相机获取三维空间点的方法,研究了单鱼眼镜头成像模型,双鱼眼全景相机成像模型及图像变换原理。研究了鱼眼镜头成像畸变等校模型参数的标定方法,实现了对鱼眼畸变图像的矫正。提出了由全景图像数据解算任意方向等效鱼眼镜头成像数据的数学模型。最后应用平行光轴双目立体视觉技术,获得了被测场景的3D坐标数据。研究结果表明,应用这种方法在4 m×3 m×3 m的测量范围内精度可达13 mm。     

四相VRM中无直流偏磁集成磁件

以消除直流偏磁和提高变换器输出性能为目的,提出了应用于四相电压调整模块的立体式集成磁件结构。利用"场"、"路"结合的方法分析了集成磁件消除直流偏磁的原理;推导得到集成磁件等效电路;并给出集成磁件的电磁设计方法。最后通过Saber仿真、3D Maxwell仿真和样机实验,验证了所提耦合磁件结构的可行性及交错并联变换器具有较好的输出性能。     

立体图像视差线性调整算法

为使立体图像能在特定显示设备上舒适显示,本文提出一种调整立体图像的方法.首先利用立体图像融像区知识,计算不同显示设备舒适显示的水平视差范围;利用匹配的SIFT(scale-invariant features)特征点来估计立体图像的视差范围,建立起立体图像原有视差到舒适显示视差的线性映射;最后利用奇异值分解估计该映射的变换矩阵,通过变换矩阵计算出调整后的图像,消除立体图像垂直视差,并将立体图像的水平视差调整到舒适观看的范围.实验结果表明,本文提出的方法可以解决不同显示设备上立体图像视差调整的问题,得到更好的显示效果.     

双目立体视觉传感器的现场标定技术

双目立体视觉传感器在机器视觉和三维测量中有着广泛的应用。其中测量精度是一个很重要的因素,尤其是在三维测量中,高测量精度的要求使得传感器的标定显得尤为重要。该文提出了一种双目立体视觉传感器的现场标定方法,不仅提高了标定精度,还避免了离线标定中大量的重复性劳动,同时也研究了摄像机镜头畸变的问题。实验结果表明,此方法能够得到满意的标定精度。     

Measurement of binocular disparity in polarized based stereoscopic display by using digital camera

This work presents an image displacement measurement by using a box pattern and the edge spread function analysis in the polarized based stereoscopic displays. The measurement determines to identify three factors (i.e., box size, image displacement, and spatial frequency response (SFR)) from the box patterns. The polarized based stereoscopic displays might sacrifice pixels for producing 3D images, which might produce errors in the image displacement and then affect the depth perception indirectly. Based on the measurement, the errors can be quantified by using the three factors. Owing to the light leakage distorting the edge spread function to obtain an inferior SFR, exactly how light leakage affects the edge spread function can be resolved on the basis of the SFR results, especially at a frequency (1/display pixel) of 1.9 in the case of the horizontal displacement. Light leakage also induces the error of the box height in even and odd intervals of the vertical displacements more than 2 pixels and 0.5 pixels, respectively. The image displacement measurement provides a simple and comprehensive means of evaluating the optical characteristics, disparity, and sharpness of the stereoscopic displays, via the three factors.     

Disparity-based just-noticeable-difference model for perceptual stereoscopic video coding using depth of focus blur effect

Human 3D perception provides an important clue to the removal of redundancy in stereoscopic 3D (S3D) videos. Because objects outside the binocular fusion limit cannot be fused on retina, the human visual system (HVS) makes them blur according to the depth-of-focus (DOF) effect to increase the binocular fusion limit and suppress diplopia, i.e. double vision. Based on human depth perception, we propose a disparity-based just-noticeable-difference model (DJND) to save bit-rate and improve visual comfort in S3D videos. We combine the DOF blur effect with conventional JND models in the pixel domain into DJND. Firstly, we use disparity information to get the average disparity value of each block. Then, we integrate the DOF blur effect into luminance JND (LJND) by a selective low pass Gaussian filter to minimize the visual stimulus in S3D videos. Finally, we incorporate disparity information into the filtered JND models to obtain DJND. Experimental results demonstrate that the proposed method successfully improves both image quality and visual comfort in viewing S3D videos without increasing the bit-rate.     

Live delivery of neurosurgical operating theater experience in virtual reality

A system for assisting in microneurosurgical training and for delivering interactive mixed reality surgical experience live was developed and experimented in hospital premises. An interactive experience from the neurosurgical operating theater was presented together with associated medical content on virtual reality eyewear of remote users. Details of the stereoscopic 360‐degree capture, surgery imaging equipment, signal delivery, and display systems are presented, and the presence experience and the visual quality questionnaire results are discussed. The users reported positive scores on the questionnaire on topics related to the user experience achieved in the trial.     

“模拟电子技术基础”课程的立体化教材建设

本文介绍了我校"模拟电子技术基础"课程立体化教材建设的整体思路,探讨立体化教材的内涵和表现形式,论述了如何将教学改革成果和科研成果融入教材,妥善处理传统内容继承与现代内容引进的问题;建立具有示范和辐射作用的数字化教材资源,突出了电子技术的应用性和实践性,强化学生工程实践能力的培养。