结构细化的神经风格迁移

风格迁移过程中风格元素均匀分布在整个图像中会使风格化图像细节模糊，现有的迁移方法主要关注迁移风格的多样性，忽略了风格化图像的内容结构和细节信息。因此，该文提出结构细化的神经风格迁移方法，通过增加边缘检测网络对内容图像的轮廓边缘进行提取实现风格化图像内容结构的细化，凸显内容图像中的主要目标；通过对转换网络中的常规卷积层的较大卷积核进行替换，在具有相同的感受野的条件下，使网络模型参数更少，提升了迁移速度；通过对转换网络中的常规卷积层添加自适应归一化层，利用自适应归一化在特征通道中检测特定样式笔触产生较高的非线性同时保留内容图像的空间结构特性来细化生成图像的结构。该方法能够细化风格化图像的整体结构，使得风格化图像连贯性更好，解决了风格纹理均匀分布使得风格化图像细节模糊的问题，提高了图像风格迁移的质量。

Structural Refinement of Neural Style Transfer

In the process of style transfer, stylized image details are blurred when style elements are evenly distributed in the whole image. Besides, the existing style transfer methods mainly focus on the diversity of transferred styles, ignoring the content structure and details of the stylized images. To this end, a neural style transfer method of structure refinement is proposed, which refines the content structure of stylized image by adding edge detection network to extract the contour edge of the content image to highlight the main objectives in the content image. By replacing the larger convolution kernel of the conventional convolution layer in the transfer network, the model parameters of the transfer network are reduced, and the transfer speed is improved, while ensuring that the original receptive field is unchanged. Through the adaptive normalization of the conventional convolution layer, the structure of the generated image is refined by using the adaptive normalization to detect certain style of stroke in the feature channel to produce high nonlinearity while preserving the spatial structure of the content image. The method can refine the overall structure of the stylized image, make the stylized image more coherent, that the stylized image details are blurred due to the uniform distribution of style texture, and improve the quality of image style transfer.