基于重要性采样的动态场景全频阴影实时绘制算法

由于环境光源下的柔和阴影绘制需要针对每像素对来自全景方向的上千个光源进行昂贵的可见性计算,这给实时绘制带来了巨大的挑战.在消除预计算的前提下,提出了一种环境光源下动态场景全频阴影实时绘制算法.通过基于光照强度的环境图重要性采样、场景几何信息近似采样、阴影图预滤波、BRDF重要性采样等方法,实现了环境光源下动态场景的全频阴影及其环境映射绘制.实验表明,算法可满足环境光源、场景物体及其材质动态变化的要求,并可在保证实时绘制效率的前提下,取得近似于预计算算法的绘制质量.     

增强现实中的光照一致性研究

增强现实中的光照一致性是确保虚拟物体和真实场景很好融合的关键,它能使计算机模拟出的虚拟物体与真实场景相融合后显得更加真实。因此需要根据真实场景中光照分布情况,对虚拟物体做阴影处理,从而消除虚拟物体的飘浮感。针对动态场景中的高实时性要求,对现有的光照估计算法进行改进,并应用聚类算法对光源进行筛选,较好地解决了动态环境下虚实场景的光照一致性问题。实验结果表明,采用所提出的改进算法,能够得到逼真的阴影视觉效果,同时系统具有良好的实时性。     

基于环境映照自动对齐的高质量虚实融合技术

要实现高品质的增强现实效果需要解决虚拟物体与现实场景的光照一致性问题.虽然采用HDR技术能获取场景的环境映照,但需要解决所获取的光照环境信息与真实场景的对齐问题.为此提出一种基于特征自动匹配的环境映照对齐方法.首先采用Affine-SIFT算法和随机抽样一致性算法对环境映照和拍摄场景进行特征匹配并优化匹配结果,然后利用基于运动推断结构的摄像机定标算法求得匹配对的三维位置,从而计算出环境映照与真实场景的对应关系,实现了二者的自动对齐.基于该技术搭建的高真实感实时虚实融合系统采用基于关键帧的相机跟踪技术,可以实时地将虚拟物体注册到拍摄的视频场景里,并允许对其进行实时的交互编辑.在渲染时有效地利用了自动对齐后的光照环境信息,采用重要性采样算法和阴影映射技术实现了实时的高质量渲染.实验结果表明,所搭建的增强现实系统很好地解决了实时虚实融合中的几何一致性和光照一致性问题.     

可变材质的实时全局光照明绘制

现有的基于预计算的全局光照明绘制算法都假设场景中物体的材质固定不变,这样,从入射光照到出射的辐射亮度之间的传输变换就是线性变换.通过对这种线性变换的预计算,可以在动态光源下实现全局光照明的实时绘制.但是,当材质可以改变时,这种线性变换不再成立,因此,现有算法无法直接用于动态材质的场景.提出了一种方法:在修改场景中的物体材质时,可以实时得到场景在直接光照和间接光照下的绘制效果.将最终到达视点的辐射亮度根据其之前经过的反射次数及相应的反射材质分为多个部分,每个部分和先后反射的材质的乘积成正比,从而把该非线性问题转化为线性问题.又将所有可选的材质都表示为一组基的线性组合.将这组基作为材质赋予场景中的物体,就有各种不同的组合方式,预计算每种组合下所有部分的出射辐射亮度.在绘制时,根据各物体材质投影到基上的系数线性组合预计算的数据就能实时得到最终的全局光照明的绘制结果.该方法适用于几何场景、光照和视点都不发生变化的场景.使用双向反射分布函数来表示物体的材质,不考虑折射或者半透明的情况.该实现最多包含两次反射,并可以实时绘制得到一些很有趣的全局光照明效果,比如渗色、焦散等等.     

基于图像的光照

基于图像的光照技术是利用现实世界的光照图像来照明现实的或计算机生成的场景及物体的一种方法。介绍了基于图像光照的基本方法和步骤，在LightWave 3D图形软件中建立三维物体模型，加入高动态范围图像作为场景照明环境，通过光通量与高动态范围图像的结合，获得了逼真的光照及环境映射图像。     

采用重要性面片采样的实时全局光照

提出了一种实时全局光照的计算方法。该方法支持任意视点下动态光源的一次间接光照计算,并且物体表面材质可实时编辑,该算法预计算了各面片上的形状因子来解决遮挡问题,并记录形状因子较大的重要性面片作为间接光源。渲染时先从光源方向对场景记录了一个扩展的阴影图,包含了光源照射到的面片ID和其光通量,再根据采样好的间接光源来计算间接光照。使用CUDA,整个光照计算过程在GPU中完成,可以对静态场景进行实时渲染,并能达到逼真的渲染效果。     

基于图像分解的光照估计算法

增强现实技术的目的在于将计算机生成的虚拟物体叠加到真实场景中。实现良好的虚实融合需要对场景光照进行估算,针对高光场景,利用场景中的不同反射光信息对场景进行有效的光照估计,首先通过基于像素聚类方法的图像分解对图像进行反射光的分解,得到漫反射图和镜面反射图,对漫反射图进行进一步的本征图像分解,得到反照率图和阴影图;之后结合分解结果和场景深度对输入图像的光照信息进行计算;最后使用全局光照模型对虚拟物体进行渲染,可以得到虚实场景高度融合的光照效果。     

虚实融合场景中的深度感知研究综述

混合现实系统可以提供虚拟信息和真实环境实时叠加的虚实融合场景,在教育培训、文物保护、军事仿真、装备制造、手术医疗和展览展示等领域具有十分广阔的应用前景。混合现实系统首先利用标定数据构建虚拟摄像机模型,然后根据头部跟踪结果和虚拟摄像机位置实时绘制虚拟内容并将其叠加在真实环境中,用户通过虚实融合场景中渲染的图形化线索和虚拟物体特征感知其深度信息,但存在用于指导虚实融合场景绘制的视觉规律和感知理论匮乏、图形化线索可提供的绝对深度信息缺失和虚拟物体的渲染维度和特征指标不足等问题。本文分析了面向虚实融合场景绘制渲染的视觉规律,从用户感知的角度出发,围绕虚实融合场景中图形化线索绘制和虚拟物体渲染等展开综述,并对虚实融合场景中深度感知的研究趋势和重点进行展望和预测。     

基于移动增强现实的实时软阴影绘制算法

由于移动设备的计算能力和存储空间有限,基于移动终端的光照估计和实时软阴影绘制技术和研究很少,提出一种适用于移动增强现实的实时软阴影绘制算法。根据移动终端光线传感器的数值来计算光源的方向,得到模拟的点光源,在该点光源附近均匀采样得到多个虚拟光源,叠加每个虚拟光源产生的阴影效果,实时绘制出软阴影。实验结果表明,在保证移动终端良好的虚实融合效果的情况下,采用该算法具有良好的实时性,为移动终端软阴影的绘制提供了有效的解决方法。     

利用深度图优化的自然光束体构建与绘制

为了模拟由散射形成的自然光束,提出基于深度图的光束体优化构建和实时绘制算法.首先把阴影体视作特殊的光束体参与计算,实现光束被物体遮挡的光照与阴影交错的效果;其次利用深度图在GPU中消除重叠的阴影体,降低填充率,优化复杂场景中多个阴影体与光束体相交情况的绘制效果.该算法将自然光束体构建中的一部分提前到预处理中完成,另一部分在GPU内核实现,提高了效率,再结合GPU上高效的散射计算绘制出动态光源产生的自然光束效果;此外,添加了大气中因散射可见的尘埃粒子的模拟,进一步增强了真实感.对动态光源下多个场景的实验结果表明,文中算法解决了散射光束中的遮挡与阴影问题,有效地模拟了光影交错的综合效果,并具有实时性.     

Spatially varying image based lighting by light probe sequences

We present a novel technique for capturing spatially or temporally resolved light probe sequences, and using them for image based lighting. For this purpose we have designed and built a real-time light probe, a catadioptric imaging system that can capture the full dynamic range of the lighting incident at each point in space at video frame rates, while being moved through a scene. The real-time light probe uses a digital imaging system which we have programmed to capture high quality, photometrically accurate color images of 512×512 pixels with a dynamic range of 10000000:1 at 25 frames per second. By tracking the position and orientation of the light probe, it is possible to transform each light probe into a common frame of reference in world coordinates, and map each point and direction in space along the path of motion to a particular frame and pixel in the light probe sequence. We demonstrate our technique by rendering synthetic objects illuminated by complex real world lighting, first by using traditional image based lighting methods and temporally varying light probe illumination, and second an extension to handle spatially varying lighting conditions across large objects and object motion along an extended path.     

Lighting Simulation of Augmented Outdoor Scene Based on a Legacy Photograph

We propose a novel approach to simulate the illumination of augmented outdoor scene based on a legacy photograph. Unlike previous works which only take surface radiosity or lighting related prior information as the basis of illumination estimation, our method integrates both of these two items. By adopting spherical harmonics, we deduce a linear model with only six illumination parameters. The illumination of an outdoor scene is finally calculated by solving a linear least square problem with the color constraint of the sunlight and the skylight. A high quality environment map is then set up, leading to realistic rendering results. We also explore the problem of shadow casting between real and virtual objects without knowing the geometry of objects which cast shadows. An efficient method is proposed to project complex shadows (such as tree's shadows) on the ground of the real scene to the surface of the virtual object with texture mapping. Finally, we present an unified scheme for image composition of a real outdoor scene with virtual objects ensuring their illumination consistency and shadow consistency. Experiments demonstrate the effectiveness and flexibility of our method.     

从单幅高动态范围图像恢复环境中物体的材质

提出一种从单幅高动态范围图像恢复一般环境中物体材质的方法,适用于单一材质物体,对物体形状和光照条件没有任何特殊要求.在一般光照环境中,获取被考察物体的一幅高动态范围图像以及用来近似物体光照的一个或几个高动态范围环境映照,然后用模拟退火算法求解逆向绘制问题.在求解过程中采用了基于图像的光照和光线跟踪技术,充分考虑了物体自身互反射的影响.最后得到了物体表面反射模型的最优参数.若与基于图像的建模技术相结合,可以根据真实物体的照片建立真实感模型.     

Approximating global illumination on mesostructure surfaces with height gradient maps

Rendering global illumination for objects with mesostructure surfaces is a time-consuming task, and cannot presently be applied to interactive graphics. This paper presents a real-time rendering method based on a mesostructure height gradient map (MHGM) to exhibit lighting effects on meso-scale details in dynamic environments. We approximate global illumination using a lighting model including three components: incident ambient light, direct light and single bounce indirect light. MHGM is introduced to create local apex sets, which would help us to compute the three components adaptively. Our approach runs entirely on the graphics hardware, and uses deferred shading and the graphics pipeline to accelerate computation. We achieve high quality results which can render meso-scale details with approximate global illumination even for low-resolution geometric models. Moreover, our approach fully supports dynamic scenes and deformable objects.     

基于梯度图的微结构表面全局光照实时绘制

针对带有微结构表面的几何模型全局光照计算复杂、难以达到实时性要求的问题,提出一种基于高度梯度图分析的全局光照实时绘制方法.首先,定义微结构高度梯度图,并据此构建可见点的局部最高点集合.其次,给出面向微结构表面对象实时绘制的全局光照计算模型,将光照计算近似分解为环境光入射、光源直接光照和一次交互漫反射这3种分量的计算.在环境光计算过程中,提出一种自适应环境光遮挡计算,借助局部最高点集合计算遮挡角.在直接光照中,给出一种微结构阴影的修正方法,搜索入射光方向的最近局部最高点剖面;通过比较剖面内光线投影与局部最高点的遮挡角,近似确定由微结构造成的阴影区域.最后,根据可见点的局部最高点集合确定一次交互漫反射的采样范围,进行渗色处理.整个全局光照计算方法在图像空间完成,较好地利用了延迟着色的思想和GPU并行计算的特点.算法可以在使用低精度几何模型时表现出带有微结构表面的高精度模型的全局光照效果,且适用于动态场景和可变形物体的全局光照计算.     

EnvyDepth: An Interface for Recovering Local Natural Illumination from Environment Maps

In this paper, we present EnvyDepth, an interface for recovering local illumination from a single HDR environment map. In EnvyDepth, the user quickly indicates strokes to mark regions of the environment map that should be grouped together in a single geometric primitive. From these annotated strokes, EnvyDepth uses edit propagation to create a detailed collection of virtual point lights that reproduce both the local and the distant lighting effects in the original scene. When compared to the sole use of the distant illumination, the added spatial information better reproduces a variety of local effects such as shadows, highlights and caustics. Without the effort needed to create precise scene reconstructions, EnvyDepth annotations take only tens of seconds to produce a plausible lighting without visible artifacts. This is easy to obtain even in the case of complex scenes, both indoors and outdoors. The generated lighting environments work well in a production pipeline since they are efficient to use and able to produce accurate renderings.     

Scalable Height Field Self‐Shadowing

We present a new method suitable for general purpose graphics processing units to render self‐shadows on dynamic height fields under dynamic light environments in real‐time. Visibility for each point in the height field is determined as the exact horizon for a set of azimuthal directions in time linear in height field size and the number of directions. The surface is shaded using the horizon information and a high‐resolution light environment extracted on‐line from a high dynamic range cube map, allowing for detailed extended shadows. The desired accuracy for any geometric content and lighting complexity can be matched by choosing a suitable number of azimuthal directions. Our method is able to represent arbitrary features of both high‐ and low‐frequency, unifying hard and soft shadowing. We achieve 23 fps on 1024×1024 height fields with 64 azimuthal directions under a 256×64 environment lighting on an Nvidia GTX 280 GPU.