23 March 2023 Video super-resolution via nonlocal deformable alignment and frame recursive progressive fusion network
Jian Zhao, Guangqian Kong, Xun Duan, Huiyun Long, Yun Wu
Author Affiliations +
Abstract

Video super-resolution (VSR) is a process of high-resolution reconstruction of low-resolution video. To address the problems of the previous VSR methods with poor temporal consistency and unsatisfactory SR results, we proposed a nonlocal deformable alignment and frame recursive progressive fusion (RPF) network combining sliding window and recursive methods, which uses nonlocal operations to align sequential frame features and later applies recursion to temporally model the hidden information and alignment features of the previous moment, thus improving temporal consistency. The RPF unit is used to fully fuse the hidden information with the currently aligned features, acquiring more supporting information to be obtained from adjacent frames, resulting in better SR results. The results were evaluated on the three public VSR datasets of Vid4, udm10, and Vimeo-90K, and the experimental results show that the proposed method can achieve state-of-the-art performance on VSR task.

© 2023 SPIE and IS&T
Jian Zhao, Guangqian Kong, Xun Duan, Huiyun Long, and Yun Wu "Video super-resolution via nonlocal deformable alignment and frame recursive progressive fusion network," Journal of Electronic Imaging 32(2), 023017 (23 March 2023). https://doi.org/10.1117/1.JEI.32.2.023017
Received: 1 October 2022; Accepted: 3 March 2023; Published: 23 March 2023
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Video

Deformation

Data hiding

Convolution

Super resolution

Feature extraction

Windows

RELATED CONTENT

RVSRT: real-time video super resolution transformer
Proceedings of SPIE (June 27 2023)
Integrated channel attention method for Siamese tracker
Proceedings of SPIE (April 03 2024)

Back to Top