PurposeTraining and evaluation of the performance of a supervised deep-learning model for the segmentation of hepatic tumors from intraoperative US (iUS) images, with the purpose of improving the accuracy of tumor margin assessment during liver surgeries and the detection of lesions during colorectal surgeries.ApproachIn this retrospective study, a U-Net network was trained with the nnU-Net framework in different configurations for the segmentation of CRLM from iUS. The model was trained on B-mode intraoperative hepatic US images, hand-labeled by an expert clinician. The model was tested on an independent set of similar images. The average age of the study population was 61.9 ± 9.9 years. Ground truth for the test set was provided by a radiologist, and three extra delineation sets were used for the computation of inter-observer variability.ResultsThe presented model achieved a DSC of 0.84 (p=0.0037), which is comparable to the expert human raters scores. The model segmented hypoechoic and mixed lesions more accurately (DSC of 0.89 and 0.88, respectively) than hyper- and isoechoic ones (DSC of 0.70 and 0.60, respectively) only missing isoechoic or >20 mm in diameter (8% of the tumors) lesions. The inclusion of extra margins of probable tumor tissue around the lesions in the training ground truth resulted in lower DSCs of 0.75 (p=0.0022).ConclusionThe model can accurately segment hepatic tumors from iUS images and has the potential to speed up the resection margin definition during surgeries and the detection of lesion in screenings by automating iUS assessment.
Neoadjuvant radiotherapy, as part of the conventional treatment of rectal cancer, can induce fibrotic tissue formation around the tumor. This complicates the exact determination of the tumor borders during surgery, which might increase the chance of positive resection margins. In a previous ex vivo study, we distinguished tumor tissue from healthy rectal wall and fat with an accuracy of 0.95, using diffuse reflectance spectroscopy (DRS). Since this study did not include fibrosis, the aim of the current ex vivo study was to examine whether differentiation of tumor and fibrosis with DRS is possible.
DRS measurements from freshly resected specimen of 16 patients were obtained. In eight patients fibrosis was measured, in the other eight patients tumor was measured. The measurements were performed using a DRS probe with a source-detector distance of 2 mm. The spectra were obtained in the wavelength range of 450-1600 nm. Classification of the measurements was done using a support vector machine (SVM) and a set of features extracted from the spectra. The SVM was evaluated using an eight-fold cross-validation, which was repeated ten times.
For all repetitions, the area under the ROC curve was greater than 0.85 (mean = 0.87, STD = 0.02). The mean sensitivity and specificity were 0.85 (STD = 0.03) and 0.88 (STD = 0.01) respectively. It can be concluded that tumor tissue can be distinguished from fibrosis based on spectral features from DRS measurements. The next step will be to conduct an in vivo study, to verify these results during surgery.
In the last decades, laparoscopic surgery has become the gold standard in patients with colorectal cancer. To overcome the drawback of reduced tactile feedback, real-time tissue classification could be of great benefit. In this ex vivo study, hyperspectral imaging (HSI) was used to distinguish tumor tissue from healthy surrounding tissue. A sample of fat, healthy colorectal wall, and tumor tissue was collected per patient and imaged using two hyperspectral cameras, covering the wavelength range from 400 to 1700 nm. The data were randomly divided into a training (75%) and test (25%) set. After feature reduction, a quadratic classifier and support vector machine were used to distinguish the three tissue types. Tissue samples of 32 patients were imaged using both hyperspectral cameras. The accuracy to distinguish the three tissue types using both hyperspectral cameras was 0.88 (STD = 0.13) on the test dataset. When the accuracy was determined per patient, a mean accuracy of 0.93 (STD = 0.12) was obtained on the test dataset. This study shows the potential of using HSI in colorectal cancer surgery for fast tissue classification, which could improve clinical outcome. Future research should be focused on imaging entire colon/rectum specimen and the translation of the technique to an intraoperative setting.
KEYWORDS: Tissues, Tumors, Surgery, Colorectal cancer, Tissue optics, Diffuse reflectance spectroscopy, Pathology, In vivo imaging, RGB color model, Cancer
Colorectal surgery is the standard treatment for patients with colorectal cancer. To overcome two of the main challenges, the circumferential resection margin and postoperative complications, real-time tissue assessment could be of great benefit during surgery. In this ex vivo study, diffuse reflectance spectroscopy (DRS) was used to differentiate tumor tissue from healthy surrounding tissues in patients with colorectal neoplasia. DRS spectra were obtained from tumor tissue, healthy colon, or rectal wall and fat tissue, for every patient. Data were randomly divided into training (80%) and test (20%) sets. After spectral band selection, the spectra were classified using a quadratic classifier and a linear support vector machine. Of the 38 included patients, 36 had colorectal cancer and 2 had an adenoma. When the classifiers were applied to the test set, colorectal cancer could be discriminated from healthy tissue with an overall accuracy of 0.95 (±0.03). This study demonstrates the possibility to separate colorectal cancer from healthy surrounding tissue by applying DRS. High classification accuracies were obtained both in homogeneous and inhomogeneous tissues. This is a fundamental step toward the development of a tool for real-time in vivo tissue assessment during colorectal surgery.
Access to the requested content is limited to institutions that have purchased or subscribe to SPIE eBooks.
You are receiving this notice because your organization may not have SPIE eBooks access.*
*Shibboleth/Open Athens users─please
sign in
to access your institution's subscriptions.
To obtain this item, you may purchase the complete book in print or electronic format on
SPIE.org.
INSTITUTIONAL Select your institution to access the SPIE Digital Library.
PERSONAL Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.