A disparity refinement framework for learning-based stereo matching methods in cross-domain setting for laparoscopic images

Zixin Yang; Richard Simon; Cristian Linte

doi:10.1117/12.2654804

3 April 2023 A disparity refinement framework for learning-based stereo matching methods in cross-domain setting for laparoscopic images

Zixin Yang, Richard Simon, Cristian Linte

Author Affiliations +

Proceedings Volume 12466, Medical Imaging 2023: Image-Guided Procedures, Robotic Interventions, and Modeling; 1246607 (2023) https://doi.org/10.1117/12.2654804
Event: SPIE Medical Imaging, 2023, San Diego, California, United States

Abstract

Stereo matching methods that enable depth estimation are crucial for visualization enhancement applications in Computer-Assisted Surgery (CAS). Learning-based stereo matching methods are promising to predict accurate results for applications involving video images. However, they require a large amount of training data, and their performance may be degraded due to domain shifts. Maintaining robustness and improving performance of learning-based methods are still open problems. To overcome the limitations of learning-based methods, we propose a disparity refinement framework consisting of a local disparity refinement method and a global disparity refinement method to improve the results of learning-based stereo matching methods in a cross-domain setting. Those learning-based stereo matching methods are pre-trained on a large public dataset of natural images and are tested on a dataset of laparoscopic images. Results from the SERV-CT dataset showed that our proposed framework can effectively refine disparity maps on an unseen dataset even when they are corrupted by noise, and without compromising correct prediction, provided the network can generalize well on unseen datasets. As such, our proposed disparity refinement framework has the potential to work with learning-based methods to achieve robust and accurate disparity prediction. Yet, as a large laparoscopic dataset for training learning-based methods does not exist and the generalization ability of networks remains to be improved, it will be beneficial to incorporate the proposed disparity refinement framework into existing networks for more accurate and robust depth estimation.

Conference Presentation

Citation Download Citation

Zixin Yang, Richard Simon, and Cristian Linte "A disparity refinement framework for learning-based stereo matching methods in cross-domain setting for laparoscopic images", Proc. SPIE 12466, Medical Imaging 2023: Image-Guided Procedures, Robotic Interventions, and Modeling, 1246607 (3 April 2023); https://doi.org/10.1117/12.2654804

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available