Paper
3 January 2025 Fast video stitching algorithm based on adaptive key frames extraction
Man Deng, Fan Yang, Jupu Yang, Jian Wang, Siyang Yu, Bo Qi
Author Affiliations +
Proceedings Volume 13442, Fifth International Conference on Signal Processing and Computer Science (SPCS 2024); 134420K (2025) https://doi.org/10.1117/12.3052982
Event: Fifth International Conference on Signal Processing and Computer Science (SPCS 2024), 2024, Kaifeng, China
Abstract
Due to the mutual restriction between stitching effect and stitching time, which makes the video stitching algorithm unable to achieve low-time and high-quality stitching at the same time. To solve this problem, this paper proposes a new fast video stitching algorithm based on adaptive key frames extraction, which makes full use of the information redundancy of video sequence. Firstly, two methods based on fixed frame interval and based on global information are combined to extract video key frames to realize the similarity division between frames. The average optical flow of all past frames is used as the similarity threshold to achieve adaptive inter-frame similarity division. Furthermore, sparse optical flow estimation based on brightness compensation is used to track the feature point pairs of the inter-frame sequence, and a look-up table of feature point pairs is established. Finally, the matching point pairs of the past frame are directly propagated to the current frame by using the inheritance method of feature optical flow, and then stitched together. Experiments show that the algorithm proposed in this paper can reduce the time consumption by 31.8%, 24.4% and 24.1% compared with OpenCV in three different scenarios, and the PSNR can be improved by up to 13.27 compared with PTGUI in terms of stitching performance. Therefore, the algorithm achieves fast and high-quality video stitching, and is robust and stable to environmental and illumination changes.
(2025) Published by SPIE. Downloading of the abstract is permitted for personal use only.
Man Deng, Fan Yang, Jupu Yang, Jian Wang, Siyang Yu, and Bo Qi "Fast video stitching algorithm based on adaptive key frames extraction", Proc. SPIE 13442, Fifth International Conference on Signal Processing and Computer Science (SPCS 2024), 134420K (3 January 2025); https://doi.org/10.1117/12.3052982
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Optical flow

Optical tracking

Video processing

RELATED CONTENT


Back to Top