A convolutional neural network (CNN) with multimodal fusion options was developed for artery-vein (AV) segmentation in OCT angiography (OCTA). We quantitatively evaluated multimodal architectures with early and late OCT-OCTA fusions, compared to the unimodal architectures with OCT-only and OCTA-only inputs. OCT-only architecture is limited for segmentation of large AV branches. The OCTA-only architecture, early OCT-OCTA fusion architecture, and late OCT-OCTA fusion architecture provide competitive performances for AV segmentation with further details. Compared to OCTA-only architecture, the late fusion architecture is slightly better, while the early fusion architecture is slightly worse.
|