Abstract

Single-image super-resolution (SISR) has experienced vigorous growth with the rapid development of deep learning. However, handling arbitrary scales (e.g., integers, nonintegers, or asymmetric) using a single model remains a challenging task. Existing super-resolution (SR) networks commonly employ static convolutions during feature extraction, which cannot
effectively perceive changes in scales. Moreover, these continuous scale upsampling modules only utilize the scale factors, without considering the diversity of local features. To activate more information for better reconstruction, two plug-in and compatible modules for fixed-scale networks are designed to perform arbitrary-scale SR tasks. Firstly, we design a Scale-aware Local Feature Adaptation Module (SLFAM), which adaptively adjusts the attention weights of dynamic filters based on the local features and scales. It enables the network to possess stronger representation capabilities. Then we propose a Local Feature Adaptation
Upsampling Module (LFAUM), which combines scales and local features to perform arbitrary-scale reconstruction. It allows the upsampling to adapt to local structures. Besides, deformable convolution is utilized letting more information to be activated in the reconstruction, enabling the network to better adapt to the texture features. Extensive experiments on various benchmark datasets demonstrate that integrating the proposed modules into a fixed-scale SR network enables it to achieve satisfactory results with non-integer or asymmetric scales while maintaining advanced performance with integer scales.
Original languageEnglish
Pages (from-to)7946-7961
Number of pages16
JournalIEEE Transactions on Multimedia
Volume26
Early online date8 Mar 2024
DOIs
Publication statusPublished - 8 Mar 2024

Keywords

  • Adaptation models
  • Feature extraction
  • Image reconstruction
  • Information filters
  • Kernel
  • Super-resolution
  • Superresolution
  • Task analysis
  • arbitrary-scale
  • deformable convolution
  • dynamic convolution
  • local feature adaptation
  • scale-aware

Fingerprint

Dive into the research topics of 'Activating More Information in Arbitrary-Scale Image Super-Resolution'. Together they form a unique fingerprint.

Cite this