Underwater image super-resolution using multi-stage information distillation networks

Recently, single image super-resolution (SISR) has been widely applied in the fields of underwater robot vision and obtained remarkable performance. However, most current methods generally suffered from the problem of a heavy burden on computational resources with large model sizes, which limited their real-world underwater robotic applications. In this paper, we introduce and tackle the super resolution (SR) problem for underwater robot vision and provide an efficient solution for near real-time applications. We present a novel lightweight multi-stage information distillation network, named MSIDN, for better balancing performance against applicability, which aggregates the local distilled features from different stages for more powerful feature representation. Moreover, a novel recursive residual feature distillation (RRFD) module is constructed to progressively extract useful features with a modest number of parameters in each stage. We also propose a channel interaction & distillation (CI&D) module that employs channel split operation on the preceding features to produce two-part features and utilizes the inter channel-wise interaction information between them to generate the distilled features, which can effectively extract the useful information of current stage without extra parameters. Besides, we present USR-2K dataset, a collection of over 1.6K samples for large-scale underwater image SR training, and a testset with an additional 400 samples for benchmark evaluation. Extensive experiments on several standard benchmark datasets show that the proposed MSIDN can provide state-of-the-art or even better performance in both quantitative and qualitative measurements.     

Thiol-Functionalized Covalent Organic Frameworks as Thermal History Indictor for Temperature and Time History Monitoring

Various products, including foods and pharmaceuticals, are sensitive to temperature fluctuations. Thus, temperature monitoring during production, transportation, and storage is critical. Facile indicators are required to monitor temperature conditions via color changes in real time. This study aimed to prepare and apply thiol-functionalized covalent organic frameworks (COFs) as a novel indicator for monitoring thermal history and temperature abuse. The COFs underwent obvious color changes from bright yellow to purple after exposure to different temperatures for varying durations. The reaction kinetics are analyzed under isothermal conditions, which reveal that the order of reaction rates is k_−20°C < k_4°C < k_20°C < k_35°C < k_55°C. The activation energy (E_a) of the COFs is calculated using the Arrhenius equation as 50.71 kJ moL⁻¹. The COFs are capable of sensitive color changes and offer a broad temperature tracking range, thereby demonstrating their application potential for the monitoring of temperature and time exposure history during production, transportation, and storage. This excellent performance thermal history indicator also shows promise for expanding the application field of COFs.     

基于光刀图像的机器人示教纠偏方法

为了解决机器人辅助在线检测系统示教过程中效率低、人为干预多的问题,针对孔类特征,提出一种通过处理光刀图像获取机器人位姿纠正参数的方法。在该方法中,纠偏过程按照将图像光刀线调整为水平方向、将被测特征调整至图像中央、根据不同特征调整最优扫描方向3个步骤进行。根据光刀图像可以求出测量坐标系与被测特征的位姿关系,并得到该位姿与理想测量位姿的偏差。经过坐标变换即可得到在机器人基坐标系下的调整参数。另外,可利用电脑控制机器人运动,从而实现了纠偏过程的自动化。实验结果表明,该方法可将初始的示教位姿修正为理想位姿,且比传统方式效率更高。     

Mass transfer in polycrystalline ytterbium monosilicate under oxygen potential gradients at high temperatures

Mass transfer in polycrystalline Yb₂SiO₅ wafers with precise composition control was evaluated and analyzed by oxygen permeation experiments at high temperatures using an oxygen tracer. Oxygen permeation proceeded due to mutual grain boundary diffusion of oxide ions and Yb ions without synergistic effects such as acceleration or suppression. The oxygen shielding properties of Yb₂SiO₅ were compared with those of the other line compounds such as Yb₂Si₂O₇ and Al₂O₃ based on the determined mass transfer parameters. It was found that the more preferentially an oxide ion diffuses in the grain boundary compared to the interior of the grain, the greater the effect of suppressing the movement of the oxide ion by applying an oxygen potential gradient becomes.     

Sub-band coding of hexagonal images

According to the circle-packing theorem, the packing efficiency of a hexagonal lattice is higher than an equivalent square tessellation. Consequently, in several contexts, hexagonally sampled images compared to their Cartesian counterparts are better at preserving information content. In this paper, novel mapping techniques alongside the wavelet compression scheme are presented for hexagonal images. Specifically, we introduce two tree-based coding schemes, referred to as SBHex (spirally-mapped branch-coding for hexagonal images) and BBHex (breadth-first block-coding for hexagonal images). Both of these coding schemes respect the geometry of the hexagonal lattice and yield better compression results. Our empirical results show that the proposed algorithms for hexagonal images produce better reconstruction quality at low bits per pixel representations compared to the tree-based coding counterparts for the Cartesian grid.     

基于改进残差特征蒸馏的轻量级超分辨率网络

基于深度学习的图像超分辨率算法通常采用递归的方式或参数共享的策略来减少网络参数，这将增加网络的深度，使得运行网络花费大量的时间，从而很难将模型部署到现实生活中。为了解决上述问题，本文设计一种轻量级超分辨率网络，对中间特征的关联性及重要性进行学习，且在重建部分结合高分辨率图像的特征信息。首先，引入层间注意力模块，通过考虑层与层之间的相关性，自适应地分配重要层次特征的权重。其次，使用增强重建模块提取高分辨率图像中更精细的特征信息，以此得到更加清晰的重建图片。通过大量的对比实验表明，本文设计的网络与其他轻量级模型相比，有更小的网络参数量，并且在重建精度和视觉效果上都有一定的提升。     

Improving accuracy of automatic optical inspection with machine learning

Electronic devices require the printed circuit board(PCB)to support the whole structure,but the assembly of PCBs suffers from welding problem of the electronic components such as surface mounted devices(SMDs)resistors.The automated optical inspection(AOI)machine,widely used in industrial production,can take the image of PCBs and examine the welding issue.However,the AOI machine could commit false negative errors and dedicated technicians have to be employed to pick out those misjudged PCBs.This paper proposes a machine learning based method to improve the accuracy of AOI.In particular,we propose an adjacent pixel RGB value based method to pre-process the image from the AOI machine and build a customized deep learning model to classify the image.We present a practical scheme including two machine learning procedures to mitigate AOI errors.We conduct experiments with the real dataset from a production line for three months,the experimental results show that our method can reduce the rate of misjudgment from 0.3%–0.5%to 0.02%–0.03%,which is meaningful for thousands of PCBs each containing thousands of electronic components in practice.     

Accelerating BPC-PaCo through Visually Lossless Techniques

Fast image codecs are a current need in applications that deal with large amounts of images. Graphics Processing Units (GPUs) are suitable processors to speed up most kinds of algorithms, especially when they allow fine-grain parallelism. Bitplane Coding with Parallel Coefficient processing (BPC-PaCo) is a recently proposed algorithm for the core stage of wavelet-based image codecs tailored for the highly parallel architectures of GPUs. This algorithm provides complexity scalability to allow faster execution at the expense of coding efficiency. Its main drawback is that the speedup and loss in image quality is controlled only roughly, resulting in visible distortion at low and medium rates. This paper addresses this issue by integrating techniques of visually lossless coding into BPC-PaCo. The resulting method minimizes the visual distortion introduced in the compressed file, obtaining higher-quality images to a human observer. Experimental results also indicate 12% speedups with respect to BPC-PaCo.     

基于RGB颜色信息聚类的光谱反射率重建

针对光谱反射率研究中因训练样本数据量大造成的冗杂等问题，提出了一种基于RGB信息进行聚类的样本分类方法。首先对颜色进行聚类并确定聚类个数，后对每一类光谱反射率使用BP神经网络分别进行重建。对于实验结果，使用ΔE₀₀、均方根误差（RMSE）以及适应度系数等标准进行评价，同时与主成分分析算法进行对比。从实验分析可得出，在聚类数目为7时光谱反射率重建效果最好，这时的平均CIE2000的色差为0.836，平均RMSE为0.0149，平均适应度系数为99.82%，并且，在最后对重建色差较大的色块进行了优化处理。实验证明，颜色聚类方法可以很好的应用于光谱反射率重建。