High-Resolution Projection Network combining High-Resolution Optical Flow Compensation for Video Super-Resolution

Yifei Sun, Zhengxia Chen, Yuying Jin, Xiaoyi Feng

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

The Super-Resolution (SR) task is to generate high-resolution (HR) images/videos using low-resolution (LR) ones. At present, the Single Image Super-Resolution (SISR) methods have achieved superior performance. However, Video Super-Resolution (VSR) methods still have some disadvantages such as edge blurring, high-frequency details missing and motion artifacts. This paper proposes an end-To-end HR feature projection VSR network HOF-HRPN, which consists of a High-Resolution Optical Flow (HOF) and a High-Resolution Projection Network (HRPN). The HOF network estimates the HR optical flow and compensates it to the neighboring frames to achieve accurate frame alignment. The HRPN is composed of a multi frame feature projection channel and a single frame SR channel in parallel. HRPN takes into account the advantages that single frame SR and VSR can extract missing high-frequency details from intra-frame and inter-frame, respectively. It fuses high-frequency details obtained from multi-scale LR projection learning and single frame SR results. A large number of comparative experiments based on public datasets verify that HOF-HRPN is robust and can recover accurate pixel values, clear edges and rich textures.

Original languageEnglish
Title of host publication2024 3rd International Conference on Image Processing and Media Computing, ICIPMC 2024
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages234-238
Number of pages5
ISBN (Electronic)9798350386660
DOIs
StatePublished - 2024
Event3rd International Conference on Image Processing and Media Computing, ICIPMC 2024 - Hefei, China
Duration: 17 May 202419 May 2024

Publication series

Name2024 3rd International Conference on Image Processing and Media Computing, ICIPMC 2024

Conference

Conference3rd International Conference on Image Processing and Media Computing, ICIPMC 2024
Country/TerritoryChina
CityHefei
Period17/05/2419/05/24

Keywords

  • feature projection and fusion
  • optical flow estimation and compensation
  • single image super-resolution
  • temporal-spatial feature
  • video super-resolution

Fingerprint

Dive into the research topics of 'High-Resolution Projection Network combining High-Resolution Optical Flow Compensation for Video Super-Resolution'. Together they form a unique fingerprint.

Cite this