Multi-scale and multi-patch transformer for sandstorm image enhancement

Sandstorm is a meteorological phenomenon common in arid and semi-arid regions. A sandstorm can carry large volumes of sand unexpectedly, which leads to severe color deviations and significantly degraded visibility when an image is taken in such a scenario. However, existing image enhancement methods cannot enhance sandstorm images well due to the challenging degradations and the scarcity of sandstorm training data. In this paper, we propose a Transformer with rotary position embedding to perform sandstorm image enhancement via building multi-scale and multi-patch dependencies. Our key insights in this work are 1) a multi-scale Transformer can globally eliminate the color deviations of sandstorm images via aggregating global information, 2) a multi-patch Transformer can recover local details well via learning the spatial variant degradations, and 3) a U-shape Transformer with rotary position embedding as the core unit of multi-scale and multi-patch Transformer can effectively build the long-range dependencies. We also contribute a real-world Sandstorm Image Enhancement (SIE) dataset including 1,400 sandstorm images with different degrees of degradations and various scenes. Experiments performed on synthetic images and real-world sandstorm images demonstrate that our proposed method not only obtains visually pleasing results but also outperforms state-of-the-art methods qualitatively and quantitatively.     

高光谱成像用高帧频CMOS图像传感器北大核心

针对高帧频、全局曝光和光谱平坦等成像应用需求,设计了一款高光谱成像用CMOS图像传感器。其光敏元采用PN型光电二极管,读出电路采用5T像素结构。采用列读出电路以及高速多通道模拟信号并行读出的设计方案来获得低像素固定图像噪声(FPN)和非均匀性抑制。芯片采用ASMC 0.35μm三层金属两层多晶硅标准CMOS工艺流片,为了抑制光电二极管的光谱干涉效应,后续进行了光谱平坦化VAE特殊工艺,并对器件的光电性能进行了测试评估。电路测试结果符合理论设计预期,成像效果良好,像素具备积分可调和全局快门功能,最终实现的像素规模为512×256,像元尺寸为30μm×30μm,最大满阱电子为400 ke^(-),FPN小于0.2%,动态范围为72 dB,帧频为450 f/s,相邻10 nm波段范围内量子效率相差小于10%,可满足高光谱成像系统对CMOS成像器件的要求。     

基于改进残差特征蒸馏的轻量级超分辨率网络

基于深度学习的图像超分辨率算法通常采用递归的方式或参数共享的策略来减少网络参数，这将增加网络的深度，使得运行网络花费大量的时间，从而很难将模型部署到现实生活中。为了解决上述问题，本文设计一种轻量级超分辨率网络，对中间特征的关联性及重要性进行学习，且在重建部分结合高分辨率图像的特征信息。首先，引入层间注意力模块，通过考虑层与层之间的相关性，自适应地分配重要层次特征的权重。其次，使用增强重建模块提取高分辨率图像中更精细的特征信息，以此得到更加清晰的重建图片。通过大量的对比实验表明，本文设计的网络与其他轻量级模型相比，有更小的网络参数量，并且在重建精度和视觉效果上都有一定的提升。     

基于可供性的文化意象交互式智能音箱设计研究

目的 探索将文化民俗有效融入现代产品中的技术思路，保留并延续中华传统文化的生命力，有助于提升用户体验。方法 分析可供性与文化意象之间的主客观互通性;挖掘交互式智能音箱中的可供性触点;构建形态、感官、认知及情境四类可供性的设计框架;以楚文化意象为例进行设计实践，对智能音箱的产品造型与交互操作方式进行设计，并进行设计评价。结果 在可供性理论指导下的楚文化意象交互式智能音箱产品外观及交互体验设计较好地满足了设计目标和用户需求。结论 可供性有助于文化意象的正确提取与转化，可将意象抽象为具有实际意义的设计要素，帮助用户在生理与认知两个层面理解产品的使用方法，同时进一步回味、体验文化内涵和文化精髓。     

Experimental study on uplift behavior of shallow anchor plates in geogrid-reinforced soil

Geogrid reinforcement can significantly improve the uplift bearing capacity of anchor plates. However, the failure mechanism of anchor plates in reinforced soil and the contribution of geogrids need further investigation. This paper presents an experimental study on the anchor uplift behavior in geogrid-reinforced soil using particle image velocimetry (PIV) and the high-resolution optical frequency domain reflectometry (OFDR). A series of model tests were performed to identify the relationship between the failure mechanism and various factors, such as anchor embedment ratio, number of geogrid layers, and their location. The test results indicate that soil deformation and the uplift resistance of anchor plates are substantially influenced by anchor embedment ratio and location of geogrids, whereas the number of geogrid layers has limited influence. In reinforced soil, increasing the embedment ratio greatly improves the ultimate bearing capacities of anchor plates and affects the interlock between the soil and geogrids. As the embedment depth increases, the failure surfaces gradually change from a vertical slip surface to a bulb-shaped surface that is limited within the soil. The strain monitoring data shows that the deformations of geogrids are symmetrical, and the peak strains of geogrids can characterize the reinforcing effects.     

Accelerating BPC-PaCo through Visually Lossless Techniques

Fast image codecs are a current need in applications that deal with large amounts of images. Graphics Processing Units (GPUs) are suitable processors to speed up most kinds of algorithms, especially when they allow fine-grain parallelism. Bitplane Coding with Parallel Coefficient processing (BPC-PaCo) is a recently proposed algorithm for the core stage of wavelet-based image codecs tailored for the highly parallel architectures of GPUs. This algorithm provides complexity scalability to allow faster execution at the expense of coding efficiency. Its main drawback is that the speedup and loss in image quality is controlled only roughly, resulting in visible distortion at low and medium rates. This paper addresses this issue by integrating techniques of visually lossless coding into BPC-PaCo. The resulting method minimizes the visual distortion introduced in the compressed file, obtaining higher-quality images to a human observer. Experimental results also indicate 12% speedups with respect to BPC-PaCo.     

Omega-6支撑身体，Omega-3支撑大脑：均衡摄入对儿童大脑发育的影响（网络首发、推荐阅读）

人体大脑和身体的发育，需要从食物中摄取均衡的营养物质。人类大脑是区分人类和其他动物的特征。食物中的必需脂肪酸是机体组织结构和功能的必要组成部分。Omega-6（O6）亚油酸（LA6）是皮肤组织的组成成分，且是炎症、血栓形成、免疫和其他信号分子的前体；Omega-3（O3）α-亚麻酸（ALA3），特别是其长链代谢产物——二十二碳六烯酸（DHA3），是大脑、视网膜和部分神经组织中的关键组分。从富含LA6脂肪酸（缺乏O3脂肪酸）的植物籽中提取出的廉价而优质油脂，是20世纪的西方国家食品工业生产的主要脂肪来源。在代谢通路中，高浓度的LA6脂肪酸可拮抗O3脂肪酸代谢，造成O3脂肪酸不足，因此，在给怀孕动物的饲料中，只提供富含LA6但缺乏O3脂肪酸的油脂作为唯一的脂肪来源，会导致幼崽大脑发育不良。过去20~30年的研究表明，低含量LA6且含DHA3的油脂可改善大脑的功能。近年来的研究较多集中在营养因素对大脑发育的影响，最新研究数据表明，脂肪酸平衡对营养不良儿童的大脑发育尤为重要。世界卫生组织（WHO）越来越重视大脑的营养健康，通过其下属的食品法典委员会，建议用于治疗严重急性营养不良儿童的即食治疗食品中，使用含有均衡脂肪酸组成/构成的脂肪。同样，脂肪酸均衡对老年人可能也很重要。目前，业界已经有了调整油脂成分的方法，以确保脂肪酸均衡，从而维持人体整个生命周期的大脑健康。     

Quality assessment for color correction-based stitched images via bi-directional matching

With the deepening of social information, the panoramic image has drawn a significant interest of viewers and researchers as it can provide a very wide field of view (FoV). Since panoramic images are usually obtained by capturing images with the overlapping regions and then stitching them together, image stitching plays an important role in generating panoramic images. In order to effectively evaluate the quality of stitched images, a novel quality assessment method based on bi-directional matching is proposed for stitched images. Specifically, dense correspondences between the testing and benchmark stitched images are first established by bi-directional SIFT-flow matching. Then, color-aware, geometric-aware and structure-aware features are respectively extracted and fused via support vector regression (SVR) to obtain the final quality score. Experiments on our newly constructed database and ISIQA database demonstrate that the proposed method can achieve comparable performance compared with the conventional blind quality metrics and the quality metrics specially designed for stitched images.