[1]李学相,曹淇,刘成明.基于无配对生成对抗网络的图像超分辨率重建[J].郑州大学学报(工学版),2021,42(05):1-6.[doi:10.13705/j.issn.1671-6833.2021.05.018]
　Li Xuexiang,Cao Qi,Liu Chengming,et al.Image super-resolution ba＜x＞sed on no match generative adversarial network[J].Journal of Zhengzhou University (Engineering Science),2021,42(05):1-6.[doi:10.13705/j.issn.1671-6833.2021.05.018]
点击复制

基于无配对生成对抗网络的图像超分辨率重建()
分享到：

《郑州大学学报(工学版)》[ISSN:1671-6833/CN:41-1339/T]

卷:
42卷
期数:
2021年05期
页码:
1-6
栏目:
出版日期:
2021-09-10

文章信息/Info

Title:
Image super-resolution ba＜x＞sed on no match generative adversarial network
作者:
李学相; 曹淇; 刘成明
郑州大学软件学院;

Author(s):
Li Xuexiang; Cao Qi; Liu Chengming;
School of Software, Zhengzhou University;

关键词:
Keywords:
DOI:
10.13705/j.issn.1671-6833.2021.05.018
文献标志码:
A
摘要:
图像超分辨率重建一直是计算机图像处理领域的热门课题。近来，基于生成对抗网络的图像超分辨率重建方法能够感知高频的纹理细节，取得了良好的重建效果。但是，生成对抗网络图像重建在图像质量方面表现出高度的不稳定性。对此，我们在SRGAN基础上提出了一个新的基于无配对图像的模型NM-SRGAN。首先，我们利用循环生成对抗网络（Cycle-gan）作为预处理模块，用于训练无配对数据集并获得一个更好的输入图像，在保留残差块基础结构的同时删除了残差块中的BN层，解决了结果不稳定的问题。同时，我们基于二阶统计量比一阶统计量更能捕捉区域信息的原理，使用协方差矩阵捕捉图像的二阶信息，在感知损失的基础上增加了二阶损失函数，使模型更加注重于捕捉图像细节区域部分的变化。最后，我们将感知损失中的VGG网络的损失函数改为一阶梯度的VGG损失函数，专注于提升图像的边缘纹理细节。我们对提出的NM-SRGAN在4个标准数据集上进行测试评估并将部分结果图进行细节部分比较，使用客观评价标准峰值信噪比与结构化相似化度量对结果图进行测试，并与经典卷积方法及SRGAN进行比较。实验结果表明，我们的方法在稳定性及图像质量、细节方面较SRGAN及经典算法均有较好的改善。
Abstract:
Image super-resolution reconstruction has always been a hot topic in the field of computer image processing. Recently, the image super-resolution reconstruction method ba＜x＞sed on the generative adversarial network can perceive high-frequency texture details and achieved good reconstruction results.However, the generation adversarial network image reconstruction shows a high degree of instability in terms of image quality. In this regard, we propose a new model NM-SRGAN ba＜x＞sed on unpaired images ba＜x＞sed on SRGAN.First, we use Cycle-gan as the preprocessing module to train the unpaired data set and obtain a better input image. While retaining the basic structure of the residual block, we delete the residual block The BN la＜x＞yer solves the problem of unstable results.At the same time, ba＜x＞sed on the principle that the second-order statistics can capture regional information better than the first-order statistics, we use the covariance matrix to capture the second-order information of the image, and add the second-order loss function to the perceptual loss, making the model more focused on Capture the changes in the detail area of the image. Finally, we change the loss function of the VGG network in the perceptual loss to a one-step VGG loss function, focusing on improving the edge texture details of the image.We test and evaluate the proposed NM-SRGAN on 4 standard data sets and compare some of the result graphs in detail and part. Use the ob＜x＞jective evaluation standard peak signal-to-noise ratio and structured similarity measure to test the result graph, and compare it with the classic Convolution method and SRGAN are compared. Experimental results show that our method is better than SRGAN and classic algorithms in terms of stability, image quality, and details

相似文献/References:

[1]袁航,钟发海,聂上上,等.基于卷积神经网络的道路拥堵识别研究[J].郑州大学学报(工学版),2019,40(02):21.[doi:10.13705/j.issn.1671-6833.2019.02.008]
　LUO Ronghui,YUAN Hang,ZHONG Fahai,et al.The Research of Traffic Jam Detection Based on Convolutional Neural Network[J].Journal of Zhengzhou University (Engineering Science),2019,40(05):21.[doi:10.13705/j.issn.1671-6833.2019.02.008]
[2]朱俊丞,杨之乐,郭媛君,等.深度学习在电力负荷预测中的应用综述[J].郑州大学学报(工学版),2019,40(05):12.[doi:10.13705/j.issn.1671-6833.2019.05.005]
　Zhu Juncheng,Young Joy,Guo Yuanjun,et al.A review of the application of deep learning in power load forecasting[J].Journal of Zhengzhou University (Engineering Science),2019,40(05):12.[doi:10.13705/j.issn.1671-6833.2019.05.005]
[3]黄文锋,徐珊珊,孙燚,等.基于多分辨率卷积神经网络的火焰检测[J].郑州大学学报(工学版),2019,40(05):79.[doi:10.13705/j.issn.1671-6833.2019.05.022]
　Huang Wenfeng,Susan Hsu,Sun Yi,et al.Fire Detection Based on Multi-resolution Convolution Neural Network in Various Scenes[J].Journal of Zhengzhou University (Engineering Science),2019,40(05):79.[doi:10.13705/j.issn.1671-6833.2019.05.022]
[4]陈义飞、郭胜、潘文安、陆彦辉.基于多源传感器数据融合的三维场景重建[J].郑州大学学报(工学版),2021,42(02):81.[doi:10.13705/j.issn.1671-6833.2021.02.008]
　Chen Yifei,Guo Sheng,Pan Wenan,et al.3D Scene Reconstruction ba＜x＞sed On Multi-source Sensor Data Fusion[J].Journal of Zhengzhou University (Engineering Science),2021,42(05):81.[doi:10.13705/j.issn.1671-6833.2021.02.008]
[5]王希鹏,李永,李智,等.融合图像深度的抗遮挡目标跟踪算法[J].郑州大学学报(工学版),2021,42(05):19.[doi:10.13705/j.issn.1671-6833.2021.05.011]
　Wang Xipeng,Li Yong,Li Zhi,et al.Anti-occlusion target tracking algorithm ba＜x＞sed on image depth—ncig2020[J].Journal of Zhengzhou University (Engineering Science),2021,42(05):19.[doi:10.13705/j.issn.1671-6833.2021.05.011]
[6]卢晨辉,冯硕,易爱华,等.基于深度学习的加油站销量预测与营销策略应用研究[J].郑州大学学报(工学版),2022,43(01):1.[doi:10.13705/j.issn.1671-6833.2022.01.014]
　Lu Chenhui,Feng Shuo,Yi Aihua,et al.A Deep Learning ba＜x＞sed Gasoline Station Sales Prediction and its Application on Promotion Strategy[J].Journal of Zhengzhou University (Engineering Science),2022,43(05):1.[doi:10.13705/j.issn.1671-6833.2022.01.014]
[7]陈浩杰,黄锦,左兴权,等.基于宽度&深度学习的基站网络流量预测方法[J].郑州大学学报(工学版),2022,43(01):7.[doi:10.13705/j.issn.1671-6833.2022.01.011]
　Chen Haojie,Huang Jin,Zuo Xingquan,et al.ba＜x＞se Station Network Traffic Prediction Method ba＜x＞sed on Wide and Deep Learning[J].Journal of Zhengzhou University (Engineering Science),2022,43(05):7.[doi:10.13705/j.issn.1671-6833.2022.01.011]
[8]成科扬,荣兰,蒋森林,等.基于深度学习的遥感图像超分辨率重建技术综述[J].郑州大学学报(工学版),2022,43(05):8.[doi:10.13705/j.issn.1671-6833.2022.05.013]
　CHENG K Y,RONG L,JIANG S L,et al.CCFAI: Survey Of Deep-Learning Approaches For Remote Sensing Super-Resolution Reconstruction[J].Journal of Zhengzhou University (Engineering Science),2022,43(05):8.[doi:10.13705/j.issn.1671-6833.2022.05.013]
[9]院老虎,常玉坤,刘家夫.基于改进YOLOv5s的雾天场景车辆检测方法[J].郑州大学学报(工学版),2023,44(03):37.[doi:10.13705/j.issn.1671-6833.2023.03.005]
　YUAN Laohu,CHANG Yukun,LIU Jiafu.Vehicle Detection Method Based on Improved YOLOv5s in Foggy Scene[J].Journal of Zhengzhou University (Engineering Science),2023,44(05):37.[doi:10.13705/j.issn.1671-6833.2023.03.005]
[10]高宇飞,马自行,徐 静,等.基于卷积和可变形注意力的脑胶质瘤图像分割[J].郑州大学学报(工学版),2024,45(02):27.[doi:10.13705/j.issn.1671-6833.2023.05.007]
　GAO Yufei,MA Zixing,XU Jing,et al.Brain Glioma Image Segmentation Based on Convolution and Deformable Attention[J].Journal of Zhengzhou University (Engineering Science),2024,45(05):27.[doi:10.13705/j.issn.1671-6833.2023.05.007]

更新日期/Last Update: 2021-10-11