Mutual information maximizing GAN inversion for real face with identity preservation

Recent generative adversarial networks (GANs) have yielded remarkable performance in face image synthesis. GAN inversion embeds an image into the latent space of a pretrained generator, enabling it to be used for real face manipulation. However, current inversion approaches for real faces suffer the dilemma of initialization collapse and identity loss. In this paper, we propose a hierarchical GAN inversion for real faces with identity preservation based on mutual information maximization. We first use a facial domain guaranteed initialization to avoid the initialization collapse. Furthermore, we prove that maximizing the mutual information between inverted faces and their identities is equivalent to minimizing the distance between identity features from inverted and original faces. Optimization for real face inversion with identity preservation is implemented on this mutual information-maximizing constraint. Extensive experimental results show that our approach outperforms state-of-the-art solutions for inverting and editing real faces, particularly in terms of face identity preservation.     

Neural Emotion Detection via Personal Attributes

There has been a recent line of work to automatically detect the emotions of posts in social media. In literature, studies treat posts independently and detect their emotions separately. Different from previous studies, we explore the dependence among relevant posts via authors' backgrounds, since the authors with similar backgrounds, e.g., "gender", "location", tend to express similar emotions. However, personal attributes are not easy to obtain in most social media websites. Accordingly, we propose two approaches to determine personal attributes and capture personal attributes between different posts for emotion detection: the Joint Model with Personal Attention Mechanism (JPA) model is used to detect emotion and personal attributes jointly, and capture the attributes-aware words to connect similar people; the Neural Personal Discrimination (NPD) model is employed to determine the personal attributes from posts and connect the relevant posts with similar attributes for emotion detection. Experimental results show the usefulness of personal attributes in emotion detection, and the effectiveness of the proposed JPA and NPD approaches in capturing personal attributes over the state-of-the-art statistic and neural models.     

A novel adaptive sampling based methodology for feasible region identification of compute intensive models using artificial neural network

Identification of feasible region of operations in multivariate processes is a problem of interest in several fields. This is particularly challenging when the process model is black-box in nature and/or is computationally expensive, as analytical solutions are not available and the number of possible model evaluations is limited. An efficient methodology is required to identify samples where the model is evaluated for developing a computationally efficient surrogate model. In this work, an artificial neural network based surrogate model is proposed which is integrated with a statistical-based approach (Jack-knifing) to estimate the variance of the surrogate model prediction. This allows implementation of an adaptive sampling approach where new samples are identified close to the feasible region boundary or in regions of high prediction uncertainty. The proposed approach performs better than a previously published kriging based method for different dimensionality case studies.     

改进的CAGAN在虚拟试衣中的应用

针对CAGAN（Conditional Analogy GAN）换衣后效果模糊，在目标衣服与原始衣服长短不一致时效果一般，相对目标衣服保留过少的细节等问题做了相关研究并对CAGAN进行了改进，提出了新的虚拟试衣方式。经过改进的CAGAN生成一个粗糙的结果，由该结果得到目标衣服穿在模特身上改变形状后的mask，接下来利用mask对目标衣服进行变形，综合变形的衣服和第一步的结果便得到最终的试衣图像。实验结果表明，该方法解决了前面存在的问题，而且取得了非常好的效果。     

Hybridization Networks of mRNA and Branched RNA Hybrids

Messenger RNA (mRNA) is emerging as an attractive biopolymer for therapy and vaccination. To become suitable for vaccination, mRNA is usually converted to a biomaterial, using cationic peptides, polymers or lipids. An alternative form of converting mRNA into a material is demonstrated that uses branched oligoribonucleotide hybrids with the ability to hybridize with one or more regions of the mRNA sequence. Two such hybrids with hexamer arms and adamantane tetraol as branching element were prepared by solution-phase synthesis. When a rabies mRNA was treated with the branched hybrids at 1 M NaCl concentration, biomaterials formed that contained both of the nucleic acids. These results show that branched oligoribonucleotides are an alternative to the often toxic reagents commonly used to formulate mRNA for medical applications.     

Transmission line detection in aerial images: An instance segmentation approach based on multitask neural networks

Camera-based transmission line detection (TLD) is a fundamental and crucial task for automatically patrolling powerlines by aircraft. Motivated by instance segmentation, a TLD algorithm is proposed in this paper with a novel deep neural network, i.e., CableNet. The network structure is designed based on fully convolutional networks (FCNs) with two major improvements, considering the specific appearance characteristics of transmission lines. First, overlaying dilated convolutional layers and spatial convolutional layers are configured to better represent continuous long and thin cable shapes. Second, two branches of outputs are arranged to generate multidimensional feature maps for instance segmentation. Thus, cable pixels can be detected and assigned cable IDs simultaneously. Multiple experiments are conducted on aerial images, and the results show that the proposed algorithm obtains reliable detection performance and is superior to traditional TLD methods. Meanwhile, segmented pixels can be accurately identified as cable instances, contributing to line fitting for further applications.     

基于K-means和SOM的水下传感器数据采集方法

随着海洋资源勘探和海洋污染物监控工作的开展，水文数据的监测和采集等已经成为重要的研究方向。其中，水下无线传感器网络在水文数据采集过程中起着举足轻重的作用。本文研究的是水下无线传感器二维监测网络模型中，传感器节点数据采集的问题，其设计方法是通过自组织映射（Self-organizing mapping，SOM）对传感器节点进行路径最优化处理，结合优化的路径图形和K-means算法找到路径内部聚合点，利用聚合点和传感器的节点得到传感器通信半径内的数据采集点，最后通过SOM得到水下机器人（Autonomous underwater vehicle，AUV）到各个数据采集点采集数据的最优路径。经过实验验证，在水下1 200 m×1 750 m范围内布置52个传感器节点的情景下，数据采集点相比于传感器节点路径规划采用相同的采集顺序得到的路径优化了6.7%；对数据采集点重新进行自组织路径规划得到的路径比传感器结点路径的最优解提高了12.2%。增加传感器节点的数量，其结果也大致相同，因此采用该方法可以提高水下机器人采集数据的效率。     

基于条件信息卷积生成对抗网络的图像识别

传统的图像识别方法需要大量有标签样本进行训练，且模型训练难以达到稳定。针对这些问题，结合条件生成网络和信息最大化生成网络的结构优势建立了条件信息卷积生成网络（C-Info-DCGAN）。模型增加图像的类别信息和潜在信息作为输入数据，然后利用Q网络去更好地发挥类别信息和潜在信息对训练的引导作用，并且利用深度卷积网络来加强对图像特征的提取能力。实验结果表明，该方法能够加快模型训练收敛速度，并有效提高图像识别的准确率。