一种基于智能场景分析的2D转3D视频时分算法

2D转3D视频的快速实现算法主要有时分法和位移法。对时分法的原理和缺陷进行了分析,在此基础上提出了一种新的基于场景特征的时分算法,它能更好地3D化平面视频。该算法利用了基于视频帧图像的颜色信息和运动矢量信息对视频进行自动分割的方法,根据视频段场景特征自适应选择左右眼最佳配对帧方法,以及通过视频段运动矢量信息来调整左右眼对应帧和补帧的方法来改进处理和立体化视频。对合成立体视频的立体显示实验分析证明改进方法有效地改善了合成立体视频的质量。     

自动驾驶3D目标检测研究综述

精确实时地进行目标检测是自动驾驶车辆能够准确感知周围复杂环境的重要功能之一,如何对周围物体的尺寸、距离、位置、姿态等3D信息进行精准判断是自动驾驶3D目标检测的经典难题.服务于自动驾驶的3D目标检测已成为近年来炙手可热的研究领域,鉴于此,对该领域主要研究进展进行综述.首先,介绍自动驾驶感知周围环境各相关传感器的特点;其次,介绍3D目标检测算法并按照传感器获取数据类型将其分为:基于单目/立体图像的算法、基于点云的算法以及图像与点云融合的算法;然后,对每类3D目标检测的经典算法以及改进算法进行详细综述、分析、比较,梳理了当前主流自动驾驶数据集及其3D目标检测算法的评估标准,并对现有文献广泛采用的KITTI和NuScenes数据集实验结果进行对比及分析,归纳了现有算法存在的难点和问题;最后,提出自动驾驶3D目标检测在数据处理、特征提取策略、多传感器融合和数据集分布问题方面可能遇到的机遇及挑战,并对全文进行总结及展望.     

基于Java3D的三维栅格生成与可视化*

针对在实际生产过程中采样点数据之间的相关性对生成的三维栅格数据影响的问题,使用了八分域搜索算法以及实验变差函数来改进原有的距离反比加权算法。该方法能够减少搜索距离以及丛聚效应,并且使用Java3D创建了三维可视化的虚拟场景,对最终生成的三维栅格进行显示。最后,通过可视化的效果,证明改进后的算法更符合实际情况。     

基于调和映射的三维医学图像增强系统

医学成像仪器产生12位的体数据,然而普通显示器只支持8位的灰度图。如果使用普通显示器来显示医学图像,显卡会自动将这些12位数据转化成8位数据,这就造成了数据动态范围被压缩。解决这一问题,在2D领域通常使用昂贵的医学专用灰阶显示器。在3D领域却限制了医生使用三维可视化软件。尝试将一些在2D图像处理中使用的图像增强技术如加权平均模板,不同程度曝光等来实现色调映射算法等应用到三维体数据的显示当中,通过种种复杂的数据变换,使得在普通显示器上显示的8位灰度图呈现出更高的动态范围,得到更为生动、更加丰富的显示效果。这种技术也可以实现任意位数的转化,使得12位显示器的显示效果也可以得到增强。     

三维重建中点云模型与纹理图像的配准

研究三维立体图像优化问题,实现高真实度的纹理图.由于立体图像重建过程产生累加误差,影响匹配精度.目前半自动和自动纹理贴图中三维扫描数据与高分辨率纹理图像对应点配准精度低、计算量大.为解决上述问题,在标准ICP(Iterative Closest Point)算法的基础上,提出一种改进的LM-ICP 2D和3D配准算法.通过法向量内积加权的最近点迭代,动态更新特征对应,减小误匹配点对配准精度的影响,并利用LM(Levenberg-Marquardt)算法优化投影矩阵.采用真实数据进行仿真.实验表明,提出的算法能得到精度高、真实性强的匹配图像效果,为设计提供参考.     

股骨3D模型构建在股骨头置换手术中的应用研究

医学影像三维可视化图像处理技术将医学影像的诊断与分析方法从二维空间拓展到了三维空间,极大地增强了医生对影像信息的阅读能力与水平。通过多维度、多层次观察和分析病变组织与器官的的形态及其与周围组织与器官的空间位置关系,可以更准确地对患者进行诊断并制定有效的治疗方案。本研究在系统分析图像分割算法的基础上,应用Mimics医学图像处理专用软件,通过窗宽窗位调整、阈值分割、蒙板编辑、区域增长以及形态学等一系列图像处理操作,分离出股骨并实施了股骨解剖模型的三维重建。该模型可以任意选择解剖结构进行组合显示及多方位观察,可任意调整透明度和伪彩,为医疗诊断和治疗的手术前科学规划及手术过程中的准确导航提供了一种有效的方法。     

基于Retinex和BM3D的图像增强

为克服传统Retinex算法没有解决的噪声问题,提出了一种基于Retinex和BM3D的图像增强算法。该方法将BM3D去噪环节加入到传统Retinex算法中。首先,计算出图像各像素之间的相对明暗关系,进而对待处理图像中的每个像素点灰度值进行校正;然后,通过在相邻图像块中搜索相似块,组成一个三维矩阵,并在三维空间进行滤波处理,得到块预估计值;最后,对图像中每个点进行加权得到最终的处理结果。实验结果表明,该算法既能显示阴影、光照区域中的细节,又能有效消除图像中含有的噪声,克服了传统Retinex图像增强算法的不足。     

利用Helmholtz互易原理由两对图像重建物体三维表面

针对利用Helmhohz互易原理由一对图像重构三维表面时存在计算时间长、显示质量不高的问题,提出一种利用上下对、左右对图像重建三维物体表面的高效算法.利用其中一对图像的匹配结果分割另一对图像的外极线,将整个外极线的匹配问题转化为相应子段的匹配问题,并交错地递归这种处理过程;引入不要求端点匹配的动态规划匹配算法实现子段对应,并分段重构物体=三维表面的点.实验结果表明,与单对图像重构算法相比,该算法能够大幅度地缩小动态规划算法的搜索范围,使得重构速度提高了一个数量级;通过上下、左右方向扫描线恢复三维表面点并大约增加0.5倍的重构点数量,使得表面显示质量得到明显提高.     

基于边缘检测的图像线刻画3D打印方法

本文提出了一种基于边缘检测的适用于3D打印的线刻画图像方法。首先对图像进行灰度化操作;其次通过基于高斯差分法的图像边缘检测提取图像的基本轮廓,利用具有噪声的基于密度的空间聚类算法(Density-Based SpatialClusteringofApplicationswithNoise,DBSCAN)对图像采样点进行聚类;再次对所有采样点使用基于节约算法CW启发式构造策略的LK(Lin-Kernighan)算法进行连接,得到初始线刻画图像;最后通过鲁棒平滑算法对线条平滑处理获得线刻画图像。该方法采用图像区域自动分割,计算速度快。3D打印的结果表明,该方法下的打印时间明显缩短且图像的边缘特征非常清晰。     

3D视觉结合图像检测与导纳控制的圆轴孔零件机器人装配

面向机器人柔顺装配圆轴与圆孔零件,建立基于3D、单目视觉与导纳控制的机器人自动装配系统,提出基于三维点云的轴线位姿估计算法、图像深度学习目标检测、导纳控制结合的圆轴孔零件的装配策略.针对3D视觉估计圆孔零件位姿问题,重点研究基于三维点云的轴线位姿估计算法.首先,介绍三维点云关键点选取方法;然后,以点云表面法线与轴线的几何约束为基础,提出并分析轴线粗估计的算法;最后,在轴线粗估计的基础上,提出并分析基于迭代鲁棒最小二乘的轴线位姿优化的算法.实验结果表明:轴线位姿估计的角度均方根误差为0.248°,位置均方根误差为0.463 mm,与现有流行的轴线估计方法相比,所提方法的精度更高,使装配策略很好地满足了机器人圆形轴孔零件装配的精度高、稳定可靠的要求.     

Optical simulation for cross‐talk evaluation and improvement of autostereoscopic 3‐D displays with a projector array

Abstract— Multi‐view spatial‐multiplexed autostereoscopic 3‐D displays normally use a 2‐D image source and divide the pixels to generate perspective images. Due to the reduction in the resolution of each perspective image for a large view number, a super‐high‐resolution 2‐D image source is required to achieve 3‐D image quality close to the standard of natural vision. This paper proposes an approach by tiling multiple projection images with a low magnification ratio from a microdisplay to resolve the resolution issue. Placing a lenticular array in front of the tiled projection image can lead to an autostereoscopic display. Image distortion and cross‐talk issues resulting from the projection lens and pixel structure of the microdisplay have been addressed with proper selection of the active pixel and adequate pixel grouping and masking. Optical simulation has shown that a 37‐in. 12‐view autostereoscopic display with a full‐HD (1920 × 1080) resolution can be achieved with the proposed 3‐D architecture.     

Efficiency analysis for multi‐view spatially multiplexed autostereoscopic 2‐D/3‐D displays

Abstract— The wide‐viewing freedom often requested by users of autostereoscopic displays can be delivered by spatial multiplexing of multiple views in which a sequence of images is directed into respective directions by a suitable autostereoscopic optical system. This gives rise to two important design considerations — the optical efficiency and the resolution efficiency of the device. Optical efficiency is particularly important in portable devices such as cell phones. A comparison is given between lens and barrier systems for various spatial multiplexing arrangements. Parallax‐barrier displays suffer from reduced optical efficiency as the number of views presented increases whereas throughput efficiency is independent of the number of views for lens displays. An autostereoscopic optical system is presented for the emerging class of highly efficient polarizer‐free displays. Resolution efficiency can be evaluated by investigating quantitative and subjective comparisons of resolution losses and pixel appearance in each 3‐D image. Specifically, 2.2‐in.‐diagonal 2‐D/3‐D panel performance has been assessed using Nyquist boundaries, human‐visual contrast‐sensitivity models, and autostereoscopic‐display optical output simulations. Four‐view vertical Polarization‐Activated Microlens technology with either QVGA mosaic or VGA striped pixel arrangements is a strong candidate for an optimum compromise between display brightness, viewing angle, and 3‐D pixel appearance.     

3‐D crosstalk and luminance uniformity from angular luminance profiles of multiview autostereoscopic 3‐D displays

Abstract— Autostereoscopic 3‐D display technologies enable a more immersive media experience by adding real depth to the visual content. However, the method used for the creation of a sensation of depth or stereo illusion contains several display design and content‐related issues that need to be carefully considered to maintain sufficient image quality. Conventionally, methods used for 3‐D image‐quality evaluations have been based on subjective testing. Optical measurements, in addition to subjective testing, can be used as an efficient tool for 3‐D display characterization. Objective characterization methods for autostereoscopic displays have been developed. How parameters affecting stereo image quality can be defined and measured, and how their effect on the stereo image quality can be evaluated have been investigated. Developed characterization methods are based on empirically gathered data. In this paper, previously presented methodology for two‐view displays is extended to cover autostereoscopic multiview displays. A distinction between displays where the change in content occurs in clear steps when the user moves in front of the display, and displays where the apparent movement of the objects is more continuous as a function of the head movement is made. Definitions for 3‐D luminance and luminance uniformity, which are equally important, as well as 3‐D crosstalk, which is the dominant factor in the evaluations of the perceived 3‐D image quality, is focused upon.     

裸眼3D LED显示的全息透镜板在线拼接的检测方法

全息透镜板的高精度拼接与装配是基于全息透镜技术的大屏幕LED裸眼3D显示系统搭建中的关键问题。理论计算与实验结果表明,全息透镜板与LED显示模组横向相对位置误差小于1.332mm时,可以满足显示的要求。基于裸眼3D显示系统的投射条纹,提出了基于投射条纹的全息透镜板位置实时调整方法。依据此方法提出了基于极大值测量条纹中心间距的图像处理算法,并结合LabView编写了图像处理程序。实验结果表明,使用该方法测得的亮暗条纹间距的测量精度为0.1mm,反算出全息透镜板与LED屏之间的位置误差小于0.03mm,满足实时调整全息透镜板位置的要求,可以作为全息透镜板在线拼接的检测方法。     

Key design issues for autostereoscopic 2‐D/3‐D displays

Abstract— Flat‐panel 2‐D/3‐D autostereoscopic displays are now being commercialized in a variety of applications, each with its own particular requirements. The autostereoscopic display designer has two key considerations to address in order to meet customer needs — the optical output of the display (defined by the output window structure) and the choice of optical components. Window structure determines 3‐D image resolution, achievable lateral and longitudinal viewing freedom, crosstalk, and 3‐D fringe contrast. Optical‐component selection determines the quality of the imaging of such windows, viewing distances, device ruggedness, thickness, and brightness. Trade‐offs in window design are described, and a comparison of the leading optical component technologies is given. Selection of Polarisation Activated Microlenses? architectures for LCD and OLED applications are described. The technology delivers significant advantages particularly for minimising nominal viewing distances in high pixel density panels and optimizing device ruggedness while maintaining display brightness.     

Simple method of characterizing the spatial luminance distribution at the user position for autostereoscopic 3‐D display

Abstract— The image quality of autostereoscopic 3‐D displays strongly depends on the user position. So, characterization of the spatial luminance distribution at the user position is important. For the measurement of the spatial luminance distribution, a method that places a diffuser screen at the user position and is illuminated by a 3‐D display has been investigated. By placing the diffuser screen and 3‐D display non‐parallel, the luminance distribution at the various distances can be determined. Though the accuracy of this measurement method is somewhat limited, the measuring procedure is fast and simple, compared with other time‐consuming methods.     

基于多投影的多视点自动立体三维显示系统

多视点自动立体显示有望成为今后主流的三维显示技术,它是一种无需借助任何辅助观察设备的多视点、多观察区、高分辨率、显示效果逼真的三维显示方式。阐述了基于多投影的多视点自动立体显示系统的设计原理,详细地描述了系统的软硬件构架,建立了基于多投影仪和水平光学各向异性显示结构的自动立体显示样机,开发了投影仪阵列自动校准系统,提高了投影仪的校准精度,避免了因投影仪数目多而导致的繁琐的校准过程。实验结果能够给观众带来逼真的三维视觉体验。     

Autostereoscopic 3D pictures on optically rewritable electronic paper

In this article, we disclose a method to fabricate the three‐dimensional (3D) image on an optically rewritable (ORW) electronic paper (e‐paper) by deploying the lenticular lenses array on the top of the ORW e‐paper. Unlike other autostereoscopic 3D liquid crystal displays, our autostereoscopic 3D ORW e‐paper is actually a green technology, which is without electrode and voltage. No electricity is needed to maintain the 3D image on the ORW e‐paper. We can easily change a 3D image by erasing and rewriting with photoalignment technology.     

Influence of 3‐D cross‐talk on qualified viewing spaces in two‐ and multi‐view autostereoscopic displays

Abstract— To estimate the qualified viewing spaces for two‐ and multi‐view autostereoscopic displays, the relationship between image quality (image comfort, annoying ghost image, depth perception) and various pairings between 3‐D cross‐talk in the left and right views are studied subjectively using a two‐view autostereoscopic display and test charts for the left and right views with ghost images due to artificial 3‐D cross‐talk. The artificial 3‐D cross‐talk was tuned to simulate the view in the intermediate zone of the viewing spaces. It was shown that the stereoscopic images on a two‐view autostereoscopic display cause discomfort when they are observed by the eye in the intermediate zone between the viewing spaces. This is because the ghost image due to large 3‐D cross‐talk in the intermediate zone elicits different depth perception from the depth induced by the original images for the left and right views, so the observer's depth perception is confused. Image comfort is also shown to be better for multi‐views, especially the width of the viewing space, which is narrower than the interpupillary distance, where the parallax of the cross‐talking image is small.     

TransCAIP: A Live 3D TV System Using a Camera Array and an Integral Photography Display with Interactive Control of Viewing Parameters

The system described in this paper provides a real-time 3D visual experience by using an array of 64 video cameras and an integral photography display with 60 viewing directions. The live 3D scene in front of the camera array is reproduced by the full-color, full-parallax autostereoscopic display with interactive control of viewing parameters. The main technical challenge is fast and flexible conversion of the data from the 64 multicamera images to the integral photography format. Based on image-based rendering techniques, our conversion method first renders 60 novel images corresponding to the viewing directions of the display, and then arranges the rendered pixels to produce an integral photography image. For real-time processing on a single PC, all the conversion processes are implemented on a GPU with GPGPU techniques. The conversion method also allows a user to interactively control viewing parameters of the displayed image for reproducing the dynamic 3D scene with desirable parameters. This control is performed as a software process, without reconfiguring the hardware system, by changing the rendering parameters such as the convergence point of the rendering cameras and the interval between the viewpoints of the rendering cameras.