Multi-scale and multi-patch transformer for sandstorm image enhancement

Sandstorm is a meteorological phenomenon common in arid and semi-arid regions. A sandstorm can carry large volumes of sand unexpectedly, which leads to severe color deviations and significantly degraded visibility when an image is taken in such a scenario. However, existing image enhancement methods cannot enhance sandstorm images well due to the challenging degradations and the scarcity of sandstorm training data. In this paper, we propose a Transformer with rotary position embedding to perform sandstorm image enhancement via building multi-scale and multi-patch dependencies. Our key insights in this work are 1) a multi-scale Transformer can globally eliminate the color deviations of sandstorm images via aggregating global information, 2) a multi-patch Transformer can recover local details well via learning the spatial variant degradations, and 3) a U-shape Transformer with rotary position embedding as the core unit of multi-scale and multi-patch Transformer can effectively build the long-range dependencies. We also contribute a real-world Sandstorm Image Enhancement (SIE) dataset including 1,400 sandstorm images with different degrees of degradations and various scenes. Experiments performed on synthetic images and real-world sandstorm images demonstrate that our proposed method not only obtains visually pleasing results but also outperforms state-of-the-art methods qualitatively and quantitatively.     

Decomposition and replacement: Spatial knowledge distillation for monocular depth estimation

Knowledge distillation has become a key technique for making smart and light-weight networks through model compression and transfer learning. Unlike previous methods that applied knowledge distillation to the classification task, we propose to exploit the decomposition-and-replacement based distillation scheme for depth estimation from a single RGB color image. To do this, Laplacian pyramid-based knowledge distillation is firstly presented in this paper. The key idea of the proposed method is to transfer the rich knowledge of the scene depth, which is well encoded through the teacher network, to the student network in a structured way by decomposing it into the global context and local details. This is fairly desirable for the student network to restore the depth layout more accurately with limited resources. Moreover, we also propose a new guidance concept for knowledge distillation, so-called ReplaceBlock, which replaces blocks randomly selected in the decoded feature of the student network with those of the teacher network. Our ReplaceBlock gives a smoothing effect in learning the feature distribution of the teacher network by considering the spatial contiguity in the feature space. This process is also helpful to clearly restore the depth layout without the significant computational cost. Based on various experimental results on benchmark datasets, the effectiveness of our distillation scheme for monocular depth estimation is demonstrated in details. The code and model are publicly available at : https://github.com/tjqansthd/Lap_Rep_KD_Depth.     

高光谱成像用高帧频CMOS图像传感器北大核心

针对高帧频、全局曝光和光谱平坦等成像应用需求,设计了一款高光谱成像用CMOS图像传感器。其光敏元采用PN型光电二极管,读出电路采用5T像素结构。采用列读出电路以及高速多通道模拟信号并行读出的设计方案来获得低像素固定图像噪声(FPN)和非均匀性抑制。芯片采用ASMC 0.35μm三层金属两层多晶硅标准CMOS工艺流片,为了抑制光电二极管的光谱干涉效应,后续进行了光谱平坦化VAE特殊工艺,并对器件的光电性能进行了测试评估。电路测试结果符合理论设计预期,成像效果良好,像素具备积分可调和全局快门功能,最终实现的像素规模为512×256,像元尺寸为30μm×30μm,最大满阱电子为400 ke^(-),FPN小于0.2%,动态范围为72 dB,帧频为450 f/s,相邻10 nm波段范围内量子效率相差小于10%,可满足高光谱成像系统对CMOS成像器件的要求。     

基于改进残差特征蒸馏的轻量级超分辨率网络

基于深度学习的图像超分辨率算法通常采用递归的方式或参数共享的策略来减少网络参数，这将增加网络的深度，使得运行网络花费大量的时间，从而很难将模型部署到现实生活中。为了解决上述问题，本文设计一种轻量级超分辨率网络，对中间特征的关联性及重要性进行学习，且在重建部分结合高分辨率图像的特征信息。首先，引入层间注意力模块，通过考虑层与层之间的相关性，自适应地分配重要层次特征的权重。其次，使用增强重建模块提取高分辨率图像中更精细的特征信息，以此得到更加清晰的重建图片。通过大量的对比实验表明，本文设计的网络与其他轻量级模型相比，有更小的网络参数量，并且在重建精度和视觉效果上都有一定的提升。     

Simply constructed highly dispersed cobalt nanoparticles in diverse N-doped graphitic carbon with remarkable performances for water electrolysis

Metal/carbon composite materials are highly promising electrocatalysts for water electrolysis. In this work, three composites of metal cobalt nanoparticles highly dispersed in N-doped carbon materials were facilely constructed by pyrolysis of different phenylenediamine based Schiff base-Co complexes (PDBs). Interestingly, the composites derived from PDBs based on different phenylenediamine exhibited different morphologies. The superior case is that rodlike composite catalyst was derived from o-phenylenediamine based PDBs. The obtained catalyst exhibited remarkable performances for both cathodic hydrogen evolution reaction (HER) and anodic oxygen evolution reaction (OER), as well as overall water electrolysis. Only 172 and 289 mV of overpotentials and 1.57 V of cell voltage were exhibited at 10 mA cm^?2 for HER, OER and water splitting in 1.0 M KOH, respectively. The catalyst also displayed robust stability and high Faraday efficiency, and thus are potential high-performance catalyst for commercial water electrolysis.     

Experimental study on uplift behavior of shallow anchor plates in geogrid-reinforced soil

Geogrid reinforcement can significantly improve the uplift bearing capacity of anchor plates. However, the failure mechanism of anchor plates in reinforced soil and the contribution of geogrids need further investigation. This paper presents an experimental study on the anchor uplift behavior in geogrid-reinforced soil using particle image velocimetry (PIV) and the high-resolution optical frequency domain reflectometry (OFDR). A series of model tests were performed to identify the relationship between the failure mechanism and various factors, such as anchor embedment ratio, number of geogrid layers, and their location. The test results indicate that soil deformation and the uplift resistance of anchor plates are substantially influenced by anchor embedment ratio and location of geogrids, whereas the number of geogrid layers has limited influence. In reinforced soil, increasing the embedment ratio greatly improves the ultimate bearing capacities of anchor plates and affects the interlock between the soil and geogrids. As the embedment depth increases, the failure surfaces gradually change from a vertical slip surface to a bulb-shaped surface that is limited within the soil. The strain monitoring data shows that the deformations of geogrids are symmetrical, and the peak strains of geogrids can characterize the reinforcing effects.     

Accelerating BPC-PaCo through Visually Lossless Techniques

Fast image codecs are a current need in applications that deal with large amounts of images. Graphics Processing Units (GPUs) are suitable processors to speed up most kinds of algorithms, especially when they allow fine-grain parallelism. Bitplane Coding with Parallel Coefficient processing (BPC-PaCo) is a recently proposed algorithm for the core stage of wavelet-based image codecs tailored for the highly parallel architectures of GPUs. This algorithm provides complexity scalability to allow faster execution at the expense of coding efficiency. Its main drawback is that the speedup and loss in image quality is controlled only roughly, resulting in visible distortion at low and medium rates. This paper addresses this issue by integrating techniques of visually lossless coding into BPC-PaCo. The resulting method minimizes the visual distortion introduced in the compressed file, obtaining higher-quality images to a human observer. Experimental results also indicate 12% speedups with respect to BPC-PaCo.     

Establishment of a color tolerance for yarn-dyed fabrics from different color-depth yarns

Yarn-dyed fabric is often woven from warp and weft yarns in the same color depth to ensure a uniform color appearance. The difference in color depth between warp and weft tends to result in the uneven color of the yarn-dyed fabric. This article aims to establish a color tolerance for yarn-dyed fabric that can be woven with a qualified color appearance but from the warp and weft yarns in different color depths. A total of 27 yarn-dyed fabric samples in three color series (red, yellow, and blue) were evaluated by using the yarn-dyed fabric from warp and weft yarns in the same color depth of 2% (on weight of fabric, owf) as the standard. Visual assessment and instrumental measurement of color were carried out to establish the color tolerance ellipse that was defined as CMC (Color Measurement Committee) color differences (2:1) of no more than 1.00. It was found that the color strengths (K/S) and color differences (ΔE_CMC(2:1)) of these fabric samples for each color series had linear relationships with the color depths of warp and weft yarns. The color tolerance ellipses indicated that, even though the warp and weft yarns had an apparent color difference, they could be woven in fabrics with relatively uniform color appearance and meet the requirements for yarn-dyed fabric. This work provided valuable insight into the production of qualified yarn-dyed fabrics from unqualified dyed yarns.