Learning to Zoom-In via Learning to Zoom-Out: Real-World Super-Resolution by Generating and Adapting Degradation

Wei Sun, Dong Gong, Qinfeng Shi, Anton Van Den Hengel, Yanning Zhang

科研成果: 期刊稿件文章同行评审

28 引用 (Scopus)

摘要

Most learning-based super-resolution (SR) methods aim to recover high-resolution (HR) image from a given low-resolution (LR) image via learning on LR-HR image pairs. The SR methods learned on synthetic data do not perform well in real-world, due to the domain gap between the artificially synthesized and real LR images. Some efforts are thus taken to capture real-world image pairs. However, the captured LR-HR image pairs usually suffer from unavoidable misalignment, which hampers the performance of end-to-end learning. Here, focusing on the real-world SR, we ask a different question: since misalignment is unavoidable, can we propose a method that does not need LR-HR image pairing and alignment at all and utilizes real images as they are? Hence we propose a framework to learn SR from an arbitrary set of unpaired LR and HR images and see how far a step can go in such a realistic and 'unsupervised' setting. To do so, we firstly train a degradation generation network to generate realistic LR images and, more importantly, to capture their distribution (i.e., learning to zoom out). Instead of assuming the domain gap has been eliminated, we minimize the discrepancy between the generated data and real data while learning a degradation adaptive SR network (i.e., learning to zoom in). The proposed unpaired method achieves state-of-the-Art SR results on real-world images, even in the datasets that favour the paired-learning methods more.

源语言英语
文章编号9329053
页(从-至)2947-2962
页数16
期刊IEEE Transactions on Image Processing
30
DOI
出版状态已出版 - 2021

指纹

探究 'Learning to Zoom-In via Learning to Zoom-Out: Real-World Super-Resolution by Generating and Adapting Degradation' 的科研主题。它们共同构成独一无二的指纹。

引用此