Underwater image super-resolution using multi-stage information distillation networks

Recently, single image super-resolution (SISR) has been widely applied in the fields of underwater robot vision and obtained remarkable performance. However, most current methods generally suffered from the problem of a heavy burden on computational resources with large model sizes, which limited their real-world underwater robotic applications. In this paper, we introduce and tackle the super resolution (SR) problem for underwater robot vision and provide an efficient solution for near real-time applications. We present a novel lightweight multi-stage information distillation network, named MSIDN, for better balancing performance against applicability, which aggregates the local distilled features from different stages for more powerful feature representation. Moreover, a novel recursive residual feature distillation (RRFD) module is constructed to progressively extract useful features with a modest number of parameters in each stage. We also propose a channel interaction & distillation (CI&D) module that employs channel split operation on the preceding features to produce two-part features and utilizes the inter channel-wise interaction information between them to generate the distilled features, which can effectively extract the useful information of current stage without extra parameters. Besides, we present USR-2K dataset, a collection of over 1.6K samples for large-scale underwater image SR training, and a testset with an additional 400 samples for benchmark evaluation. Extensive experiments on several standard benchmark datasets show that the proposed MSIDN can provide state-of-the-art or even better performance in both quantitative and qualitative measurements.     

Targeted editing of intronic-splicing silencer enhancement of SMN2 Exon 7 inclusion by CRISPR/Case 9

Spinal muscular atrophy (SMA) is an autosomal recessive hereditary neuromuscular disease. Exon 7 and 8 of survival of motor neuron 1 (SMN1) gene or only exon 7 homology deletion leads to the failure to produce a full-length SMN gene. The copy number of SMN2 gene with high homology of SMN1 affects the degree of disease and was the target gene for targeting therapy, in which splicing silencer in intron 7 was the key to suppress the inclusion of exon 7. In this study, we projected to use CRISPR/Case 9 for the targeted editing of intronic-splicing silencer (ISS) sequence to promote the inclusion of SMN2 exon 7 and increase the production of SMN2 full-length (FL) gene expression. It happens that there was a protospacer adjacent motif (PAM) at one end of the ISS sequence according to the design of sgRNA. The recombinant vector of sgRNA HSMN2 CRISPR/Case 9 was constructed and transfected into HEK293 cells. Sequencing results showed that the ISS sequence could be edited accurately and targeting in the predicted direction, in which deleting small fragments, inserting small amounts and mutation. Quantitative analysis of RT-PCR products by restriction enzyme of DdeI digestion showed that the FL of SMN2 increased by 8% (P < 0.05). In the primary cultured chondrocytes of SMA mice, in which sgRNA HSMN2 CRISPR/Case9 recombinant vector transfection could increase the SMN2 FL gene by 23% (P < 0.05) and significantly improve SMN protein levels (P < 0.05). CRISPR/Case 9 is an effective tool for gene editing and therapy of hereditary diseases, but it is rarely reported in the treatment of SMA diseases. This study shows that CRISPR/Case 9 was first used for the precision target of ISS sequence editing, which can effectively promote the production of SMN2 FL gene expressions, in which there was an important clinical reference value.     

Exploration of GH94 Sequence Space for Enzyme Discovery Reveals a Novel Glucosylgalactose Phosphorylase Specificity

The substantial increase in DNA sequencing efforts has led to a rapid expansion of available sequences in glycoside hydrolase families. The ever-increasing sequence space presents considerable opportunities for the search for enzymes with novel functionalities. In this work, the sequence-function space of glycoside hydrolase family 94 (GH94) was explored in detail, using a combined approach of phylogenetic analysis and sequence similarity networks. The identification and experimental screening of unknown clusters led to the discovery of an enzyme from the soil bacterium Paenibacillus polymyxa that acts as a 4-O-β-d -glucosyl-d -galactose phosphorylase (GGalP), a specificity that has not been reported to date. Detailed characterization of GGalP revealed that its kinetic parameters were consistent with those of other known phosphorylases. Furthermore, the enzyme could be used for production of the rare disaccharides 4-O-β-d -glucosyl-d -galactose and 4-O-β-d -glucosyl-l -arabinose. Our current work highlights the power of rational sequence space exploration in the search for novel enzyme specificities, as well as the potential of phosphorylases for rare disaccharide synthesis.     

基于光刀图像的机器人示教纠偏方法

为了解决机器人辅助在线检测系统示教过程中效率低、人为干预多的问题,针对孔类特征,提出一种通过处理光刀图像获取机器人位姿纠正参数的方法。在该方法中,纠偏过程按照将图像光刀线调整为水平方向、将被测特征调整至图像中央、根据不同特征调整最优扫描方向3个步骤进行。根据光刀图像可以求出测量坐标系与被测特征的位姿关系,并得到该位姿与理想测量位姿的偏差。经过坐标变换即可得到在机器人基坐标系下的调整参数。另外,可利用电脑控制机器人运动,从而实现了纠偏过程的自动化。实验结果表明,该方法可将初始的示教位姿修正为理想位姿,且比传统方式效率更高。     

Sub-band coding of hexagonal images

According to the circle-packing theorem, the packing efficiency of a hexagonal lattice is higher than an equivalent square tessellation. Consequently, in several contexts, hexagonally sampled images compared to their Cartesian counterparts are better at preserving information content. In this paper, novel mapping techniques alongside the wavelet compression scheme are presented for hexagonal images. Specifically, we introduce two tree-based coding schemes, referred to as SBHex (spirally-mapped branch-coding for hexagonal images) and BBHex (breadth-first block-coding for hexagonal images). Both of these coding schemes respect the geometry of the hexagonal lattice and yield better compression results. Our empirical results show that the proposed algorithms for hexagonal images produce better reconstruction quality at low bits per pixel representations compared to the tree-based coding counterparts for the Cartesian grid.     

Image sequence-based risk behavior detection of power operation inspection personnel

A novel image sequence-based risk behavior detection method to achieve high-precision risk behavior detection for power maintenance personnel is proposed in this paper. In this method, the original image sequence data is first separated from the foreground and background. Then, the free anchor frame detection method is used in the foreground image to detect the personnel and correct their direction. Finally, human posture nodes are extracted from each frame of the image sequence, which are then used to identify the abnormal behavior of the human. Simulation experiment results demonstrate that the proposed algorithm has significant advantages in terms of the accuracy of human posture node detection and risk behavior identification.     

基于改进残差特征蒸馏的轻量级超分辨率网络

基于深度学习的图像超分辨率算法通常采用递归的方式或参数共享的策略来减少网络参数，这将增加网络的深度，使得运行网络花费大量的时间，从而很难将模型部署到现实生活中。为了解决上述问题，本文设计一种轻量级超分辨率网络，对中间特征的关联性及重要性进行学习，且在重建部分结合高分辨率图像的特征信息。首先，引入层间注意力模块，通过考虑层与层之间的相关性，自适应地分配重要层次特征的权重。其次，使用增强重建模块提取高分辨率图像中更精细的特征信息，以此得到更加清晰的重建图片。通过大量的对比实验表明，本文设计的网络与其他轻量级模型相比，有更小的网络参数量，并且在重建精度和视觉效果上都有一定的提升。     

Improving accuracy of automatic optical inspection with machine learning

Electronic devices require the printed circuit board(PCB)to support the whole structure,but the assembly of PCBs suffers from welding problem of the electronic components such as surface mounted devices(SMDs)resistors.The automated optical inspection(AOI)machine,widely used in industrial production,can take the image of PCBs and examine the welding issue.However,the AOI machine could commit false negative errors and dedicated technicians have to be employed to pick out those misjudged PCBs.This paper proposes a machine learning based method to improve the accuracy of AOI.In particular,we propose an adjacent pixel RGB value based method to pre-process the image from the AOI machine and build a customized deep learning model to classify the image.We present a practical scheme including two machine learning procedures to mitigate AOI errors.We conduct experiments with the real dataset from a production line for three months,the experimental results show that our method can reduce the rate of misjudgment from 0.3%–0.5%to 0.02%–0.03%,which is meaningful for thousands of PCBs each containing thousands of electronic components in practice.     

Accelerating BPC-PaCo through Visually Lossless Techniques

Fast image codecs are a current need in applications that deal with large amounts of images. Graphics Processing Units (GPUs) are suitable processors to speed up most kinds of algorithms, especially when they allow fine-grain parallelism. Bitplane Coding with Parallel Coefficient processing (BPC-PaCo) is a recently proposed algorithm for the core stage of wavelet-based image codecs tailored for the highly parallel architectures of GPUs. This algorithm provides complexity scalability to allow faster execution at the expense of coding efficiency. Its main drawback is that the speedup and loss in image quality is controlled only roughly, resulting in visible distortion at low and medium rates. This paper addresses this issue by integrating techniques of visually lossless coding into BPC-PaCo. The resulting method minimizes the visual distortion introduced in the compressed file, obtaining higher-quality images to a human observer. Experimental results also indicate 12% speedups with respect to BPC-PaCo.