2 December 2024 Feature-aligned pansharpening framework based on generative adversarial network: an unsupervised pansharpening network based on a model-driven paradigm
Chun Luo, Yixiao Liu, Xiaohai He, Tingrong Zhang, Linbo Qing, Chao Ren
Author Affiliations +
Abstract

Pansharpening aims to enhance the spatial resolution of low-resolution multi-spectral (LRMS) images by leveraging the high-resolution panchromatic images (PANs). Deep learning–based pansharpening technology provides a suite of sophisticated unsupervised algorithms. However, there are several challenges: (1) existing methods introduce more or less some kind of a priori information but lack explicit physical priori. (2) Existing methods often lack generalization capabilities and perform well only on some specific datasets. To address these issues, an unsupervised feature-aligned pansharpening framework based on a generative adversarial network (FaPGAN) is proposed. The proposed FaPGAN employs a single-generator dual-discriminator structure, divisible into the following two steps: (1) the generator adopts a pair of adaptive complementary normalization factors to weight the fusion of LRMS and PAN, which captures the successive transition from LRMS to PAN. The dual discriminator is responsible for preserving the spatial and spectral information. (2) A novel loss is introduced, which constrains the representations in the feature domain for feature alignment, essentially improving prediction accuracy. The experimental results show that the algorithm exhibits excellent spatial and spectral fidelity when fusing images from Gaofen-2 and WorldView-3 satellite datasets, and it can be well generalized to reduced-resolution images.

© 2024 SPIE and IS&T
Chun Luo, Yixiao Liu, Xiaohai He, Tingrong Zhang, Linbo Qing, and Chao Ren "Feature-aligned pansharpening framework based on generative adversarial network: an unsupervised pansharpening network based on a model-driven paradigm," Journal of Electronic Imaging 33(6), 063038 (2 December 2024). https://doi.org/10.1117/1.JEI.33.6.063038
Received: 10 May 2024; Accepted: 18 November 2024; Published: 2 December 2024
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
Back to Top