A novel semantic geo-localization approach with satellite images for GPS-free navigation of UAV

Yu-Cheng Cheng; Yung-Jhe Yan; Peng-Jie Chen; Cheng-Chuan Hsu; Chun-Yan Lo; Cong-Yuan Chou; Chi-Han Lin; Mang Ou-Yang

doi:10.1117/12.3033687

19 November 2024 A novel semantic geo-localization approach with satellite images for GPS-free navigation of UAV

Yu-Cheng Cheng, Yung-Jhe Yan, Peng-Jie Chen, Cheng-Chuan Hsu, Chun-Yan Lo, Cong-Yuan Chou, Chi-Han Lin, Mang Ou-Yang

Author Affiliations +

Proceedings Volume 13196, Artificial Intelligence and Image and Signal Processing for Remote Sensing XXX; 131960P (2024) https://doi.org/10.1117/12.3033687
Event: Remote Sensing, 2024, Edinburgh, United Kingdom

Abstract

Image geo-localization estimates an image's global position by comparing it with a large-scale image database containing known positions. This localization technology can serve as an alternative positioning method for unmanned aerial vehicles (UAV) in situations where a global position system is unavailable. Feature-based image-matching methods typically involve descriptors constructed from pixel-level key points in the images. The number of descriptors in one image can be substantial. Filtering and comparing these large quantities of descriptors for image matching would be quite time-consuming. Due to the large scale of satellite images, matching them with aerial images using this method can be challenging to achieve in real-time. Thus, this paper proposes a semantic matching-based approach for real-time image geo-localization. The types, quantities, and geometric information of objects in satellite images are extracted and used as sematic-level descriptors. The sematic-level descriptors of an aerial image captured by UAV are extracted by an object recognition model. The quantity of semantic-level descriptors is orders of magnitude less than pixel-level descriptors. The location of the aerial image can be rapidly determined by matching the semantic-level descriptors between the aerial image and satellite images. In the experiments, the speeds of matching an aerial image with satellite images using the semantic matching and a feature-based matching method were 0.194 seconds per image and 125.68 seconds per image, respectively. Using semantic matching methods is 648 times faster than using feature matching methods. The results demonstrate that the proposed semantic matching methods have the potential for real-time image geo-localization.

Citation Download Citation

Yu-Cheng Cheng, Yung-Jhe Yan, Peng-Jie Chen, Cheng-Chuan Hsu, Chun-Yan Lo, Cong-Yuan Chou, Chi-Han Lin, and Mang Ou-Yang "A novel semantic geo-localization approach with satellite images for GPS-free navigation of UAV", Proc. SPIE 13196, Artificial Intelligence and Image and Signal Processing for Remote Sensing XXX, 131960P (19 November 2024); https://doi.org/10.1117/12.3033687

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

;

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
7 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Earth observing sensors

Satellite imaging

Satellites

Semantics

Unmanned aerial vehicles

Satellite navigation systems

Image analysis

Show All Keywords

Keywords/Phrases

Search In:

Publication Years