高动态图像色调映射技术新进展*

传统显示设备受自身动态范围限制,无法很好地显示高动态图像的效果,需要用色调映射方法进行合理的动态域压缩,获得更好的图像显示质量。综述了现有高动态图像的色调映射技术,首先简要介绍了高动态图像色调映射方法的概念;再介绍了色调映射算子的分类,以色调映射处理方式为主分别介绍了空域不变算法、空域变化算法及混合算法这三大类算子近年来发展起来的各种新方法,并指出各种方法的技术优势及对此进行了归纳总结;最后阐述了该技术的应用领域及其继续发展的方向。     

高动态范围图像和色阶映射算子

图像传感器动态响应范围的局限使其在捕捉高动态范围场景时力不从心, 为了捕捉高动态范围图像(High dynamic range image, HDRI), 近年来出现了许多新型传感器和新方法, 本文将简要介绍这些研究进展; 同样由于动态响应范围的局限, 显示设备也不能胜任HDRI的显示, 必须利用色阶映射算子(Tone mapping operator, TMO)将图像的动态范围进行合理的压缩, TMO最终决定了图像显示的质量, 本文将众多的TMO归纳为全局算子和局部算子并进行了详细论述.     

一种基于人眼视觉及对数域的HDR图像动态范围压缩方法

当前人们对图像质量的要求越来越高,高动态范围（HDR）图像广泛应用于影视、医疗等领域,已经成为图像处理领域中的重要研究方向。针对现有的动态范围压缩方法造成图像偏暗区域和偏亮区域发生信息丢失的问题,对传统的对数域动态范围压缩方法进行改进,并根据人眼对亮度的适应特性实现对图像整体动态范围压缩的同时,保留了更多的偏暗区域和偏亮区域信息。     

基于图像特征的色调映射方法评价体系

为解决高动态范围图像在传统显示设备中准确显示的问题,将模糊的视觉注意机制转化为确定的特征点个数,提出一种基于图像特征的评价体系,以判别色调映射方法所得结果图像是否保持特征信息。针对图像进行对比度调整,将场景亮度变换到可以显示的范围,同时保持细节与颜色等对于表现原始场景的重要信息。对7种色调映射全局方法,即Logarithmic TMO,Exponential TMO,TumblinRushmeier TMO,Schlick TMO,Ferwerda TMO,Ward Hist Adj TM O,Drago TM O进行比较分析,得出Ward Hist Adj TM O色调映射的整体效果最优。     

基于一致性敏感哈希块匹配的HDR图像去伪影融合方法

高动态范围(High dynamic range, HDR)图像成像技术的出现, 为解决由于采集设备动态范围不足而导致现有数字图像动态范围有限的问题提供了一条切实可行的思路.合成高动态范围图像的过程中因相机抖动或运动物体所造成的模糊和伪影问题, 可通过块匹配对多曝光图像序列进行去伪影融合加以解决.但对于具有复杂运动变化的真实场景, 现有的去伪影融合方法准确度和效率仍存在不足.为此, 本文结合相机响应函数和一致性敏感哈希提出了一种高动态图像去伪影融合方法.仿真结果表明, 该方法有效降低了计算复杂度, 具有较好的鲁棒性, 在有效去除伪影的同时提升了高动态范围图像质量.     

基于多通道图像的非彩物体图像高动态合成

提出一种基于非彩色物体3CCD多通道的高动态图像的合成方法。将非彩色物体在3CCD中3个通道的3个不同分量提取作为合成的图像序列,充分利用3CCD图像的信息,可以有效地去除部分图片中的高光区域与过饱和区域,并减少需要进行合成的图像数量。实验表明该方法相对于一般的非彩色物体图像具有更好的动态范围与信噪比。     

基于相机阵列的高动态范围图像合成方法

针对传统的高动态范围图像合成方法不能适应动态光照的问题, 提出了基于相机阵列的不同曝光的多幅图像的配准及高动态范围图像合成方法。首先利用相机阵列获取不同曝光图像, 结合相机阵列标定参数, 采用光场合成孔径理论对图像进行配准, 并对配准后的图像作中值位图进行二次配准。根据拟合出的各相机的光照响应曲线, 进而将二次配准后的不同曝光的图像合成为一幅高动态范围图像。实验表明, 该方法可以有效地在动态光照下合成高动态范围图像, 取得了不错的效果。     

在可编程图形硬件上实现图像高动态范围压缩

通过在亮度图像梯度域上对大梯度进行衰减,压缩图像亮度的动态范围,可以使高动态范围图像在被显示时,既能够适应常规的显示硬件,同时又充分保留原始图像的细节信息,使得图像在被观察时能够重现真实场景的亮度效果.文中采用适合由图形处理器加速的快速算法,将整个处理过程通过可编程图形硬件实现,建立快速的图像动态范围压缩技术,建立起适用于高动态范围图像显示的实时应用框架,使之不仅适用于基于图像的动态范围调整的绝大部分情况,还能够成为各种交互式图形应用的核心技术之一.     

在可编程图形硬件上实现图像高动态范围压缩

通过在亮度图像梯度域上对大梯度进行衰减,压缩图像亮度的动态范围,可以使高动态范围图像在被显示时,既能够适应常规的显示硬件,同时又充分保留原始图像的细节信息,使得图像在被观察时能够重现真实场景的亮度效果。文中采用适合由图形处理器加速的快速算法,将整个处理过程通过可编程图形硬件实现,建立快速的图像动态范围压缩技术,建立起适用于高动态范围图像显示的实时应用框架,使之不仅适用于基于图像的动态范围调整的绝大部分情况,还能够成为各种交互式图形应用的核心技术之一。     

亮度分区自适应对数色调映射算法*

色调映射可将高动态范围图像显示在低动态范围显示器上。常用的对数全局色调映射算法由于压缩范围有限容易引起细节丢失,为此本文给出一种基于亮度分区的自适应对数色调映射算法。首先将高动态范围图像由RGB颜色空间转换为XYZ颜色空间以提取图像亮度信息,然后将亮度图分为高、中、低三个照度区域。根据区域亮度属性实施对数色调映射实现动态范围局部压缩,并进行融合处理以消除区域交界处的显示效果。同时采用双边滤波技术进行细节补偿。实验结果表明,此算法能有效压缩动态范围并再现真实场景信息,同时可以保留丰富的细节。     

一种高动态范围图像可视化算法*

提出的自适应HDR图像可视化算法中,输入图像被分解为基本层和细节层.该算法将整体明暗效果的显示看做整体问题,对表示亮度的基本层采用基于整体统计信息的直方图调整算法处理;可视细节信息的保持作为局部问题,算法采用自适应细节增强算法处理细节层.通过定义映射图对细节增强后的图像进行最终映射,将两方面结合起来得到最终结果.实验结果表明,该算法能对HDR图像进行较高视觉质量的显示.     

Evaluation of HDR tone‐mapping algorithms using a high‐dynamic‐range display to emulate real scenes

Abstract— Current HDR display technology approaches the dynamic‐range capabilities of the fully adapted human visual system. As such, this technology has potential for performing as a surrogate for real‐world scenes in the perceptual evaluation of high‐dynamic‐range (HDR) image‐reproduction algorithms that aim to map HDR scenes to the limited dynamic ranges available in typical display and print technology. Compared with direct image assessment in comparison with real‐world scenes, it is clear that use of HDR display technology has the benefit of simplicity in experimental design while maintaining the HDR of the original scene. To evaluate this potential application of HDR display technology, seven published versions of well‐known HDR tone‐mapping algorithms were benchmarked for perceptual rendering accuracy against each of four real‐world scenes constructed in the laboratory and against corresponding images on an HDR display. The results illustrate that visual assessments obtained from the HDR display and those obtained from real‐world scenes are in good agreement, validating the potential for HDR display technology as an evaluation tool in this context.     

高动态范围图像梯度压缩算法

高动态范围（HDR）图像是一种可以表示实际场景中亮度大范围变化的图像类型,图像中的像素值正比于场景中对应点的实际亮度值,因此,可以更好地表示场景中亮区和暗区的光学特性。为了在常规显示硬件上显示HDR图像,采用梯度压缩算法,在亮度图像梯度域上对大梯度进行衰减,压缩图像亮度的动态范围。实验结果表明,该算法能对HDR图像进行较高视觉质量的显示。     

Evaluation of Tone‐Mapping Operators for HDR Video Under Different Ambient Luminance Levels

Since high dynamic range (HDR) displays are not yet widely available, there is still a need to perform a dynamic range reduction of HDR content to reproduce it properly on standard dynamic range (SDR) displays. The most common techniques for performing this reduction are termed tone‐mapping operators (TMOs). Although mobile devices are becoming widespread, methods for displaying HDR content on these SDR screens are still very much in their infancy. While several studies have been conducted to evaluate TMOs, few have been done with a goal of testing small screen displays (SSDs), common on mobile devices. This paper presents an evaluation of six state‐of‐the‐art HDR video TMOs. The experiments considered three different levels of ambient luminance under which 180 participants were asked to rank the TMOs for seven tone‐mapped HDR video sequences. A comparison was conducted between tone‐mapped HDR video footage shown on an SSD and on a large screen SDR display using an HDR display as reference. The results show that there are differences between the performance of the TMOs under different ambient lighting levels and the TMOs that perform well on traditional large screen displays also perform well on SSDs at the same given luminance level.     

Aerial full spherical HDR imaging and display

This paper describes a framework for aerial imaging of high dynamic range (HDR) scenes for use in virtual reality applications, such as immersive panorama applications and photorealistic superimposition of virtual objects using image-based lighting. We propose a complete and practical system to acquire full spherical HDR images from the sky, using two omnidirectional cameras mounted above and below an unmanned aircraft. The HDR images are generated by combining multiple omnidirectional images captured with different exposures controlled automatically. Our system consists of methods for image completion, alignment, and color correction, as well as a novel approach for automatic exposure control, which selects optimal exposure so as to avoid banding artifacts. Experimental results indicated that our system generated better spherical images compared to an ordinary spherical image completion system in terms of naturalness and accuracy. In addition to proposing an imaging method, we have carried out an experiment about display methods for aerial HDR immersive panoramas utilizing spherical images acquired by the proposed system. The experiment demonstrated HDR imaging is beneficial to immersive panorama using an HMD, in addition to ordinary uses of HDR images.     

一种亮度可控与细节保持的高动态范围图像色调映射方法

高动态范围(High dynamic range, HDR)图像通常需压缩其动态范围,以便于进行存储、传输、重现. 本文提出一种具有亮度可控与细节保持特性的HDR图像的全局色调映射方法.该方法对HDR图像 照度直方图进行裁剪与补偿,令色调映射后的低动态范围(Low dynamic range, LDR)图像仍能够保持原有的细节特性, 同时利用概率模型估算出输出LDR图像的亮度与标准差,进而调整直方图亮度区域的分配, 使得输出LDR图像的亮度接近用户设置的亮度,最后以分段直方图均衡的方法进行HDR色调映射处理. 仿真结果表明,该方法能对HDR图像动态范围进行合理的压缩映射,输出的LDR图像的亮度可由用户控制或自适应选择, 同时能保持图像的细节信息,令图像的主观视觉感受对比和谐.     

Art,science, and appearance in HDR

Abstract— High‐dynamic‐range (HDR) image capture and display has become an important engineering topic. The discipline of reproducing scenes with a high range of luminances has a five‐century history that includes painting, photography, electronic imaging, and image processing. HDR images are superior to conventional images. There are two fundamental scientific issues that control HDR image capture and reproduction. The first is the range of information that can be measured using different techniques. The second is the range of image information that can be utilized by humans. Optical veiling glare severely limits the range of luminance that can be captured and seen. It is the improved quantization of digital data and the preservation of the scene's spatial information that causes the improvement in quality in HDR reproductions.     

A high dynamic range rendering pipeline for interactive applications

Realistic images can be computed at interactive frame rates for Computer Graphics applications. Meanwhile, High Dynamic Range (HDR) rendering has a growing success in video games and virtual reality applications, as it improves the image quality and the player’s immersion feeling. In this paper, we propose a new method, based on a physical lighting model, to compute in real time a HDR illumination in virtual environments. Our method allows to re-use existing virtual environments as input, and computes HDR images in photometric units. Then, from these HDR images, displayable 8-bit images are rendered with a tone mapping operator and displayed on a standard display device. The HDR computation and the tone mapping are implemented in OpenSceneGraph with pixel shaders. The lighting model, together with a perceptual tone mapping, improves the perceptual realism of the rendered images at low cost. The method is illustrated with a practical application where the dynamic range of the virtual environment is a key rendering issue: night-time driving simulation.     

HDR到LDR图像的分段式对数映射算法

为了适应低端显示设备输出,需要一定的方法将高动态范围（HDR)图像转换为相应的低动态范围（LDR)图像。如果既考虑到人眼对亮度反应呈对数变化又利用图像自身的亮度分布,对高动态范围图像进行先全局后局部的映射,便得到一种分段式对数映射算法。该算法的复杂度较低,在视觉效果上结合了对数映射和分段映射算法的特点。     

Image quality evaluation for OLED-based smart-phone displays at various lighting conditions

The image quality of three organic light-emitting diode (OLED) based smart-phone displays was assessed at three levels of ambient lighting conditions corresponding to the darkroom, indoor and outdoor environment, respectively. Seven perceptual attributes, i.e., naturalness, colorfulness, brightness, contrast, sharpness, preference, and overall image quality (IQ), were evaluated in both standard dynamic range (SDR) and high dynamic range (HDR) mode via psychophysical experiments by rank order method, while readability was assessed only in SDR mode and gradation was investigated only in HDR mode. The experimental results demonstrate that, besides the color gamut, the tone reproduction curve is also an important factor affecting the colorfulness of mobile display in the two modes. Higher peak luminance would not mean better performance on brightness and contrast for HDR images, which is opposite to SDR mode. Further analysis of variance (ANOVA) indicates that the ranking results of all perceptual attributes are not significantly affected by the ambient lighting levels in both SDR and HDR modes.