In recent years, it was demonstrated that discrimination between white matter and tumor-infiltrated white matter based on optical coherence tomography (OCT) data is possible with high accuracy. However, gray matter is also present during the tumor resection and shows similar optical properties to tumor infiltration, which aggravates the tumor classification using optical coherence tomography. A semantic segmentation approach based on a convolutional neural network was applied to the problem in order to classify healthy brain tissue from tumor infiltrated brain tissue. A dataset was created, which consisted of ex vivo OCT B-scans, which were acquired by a swept-source OCT system with a central wavelength of 1300 nm. Each OCT B-scan was indirectly annotated by transforming histological labels from a corresponding H&E section onto it. The labels differentiate between white matter, gray matter and tumor infiltration. The output of the network was modeled to a Dirichlet prior distribution, which enabled the capturing of a prediction uncertainty. This approach achieved an intersection over union score of 0.72 for healthy brain tissue and 0.69 for highly tumor infiltrated brain tissue, when only confident predictions were considered.
Neuro-surgery is challenged by the difficulties of determining brain tumor boundaries during excisions. Optical coherence tomography is investigated as an imaging modality for providing a viable contrast channel. Our MHz-OCT technology enables rapid volumetric imaging, suitable for surgical workflows. We present a surgical microscope integrated MHz-OCT imaging system, which is used for the collection of in-vivo images of human brains, with the purpose of being used in machine learning systems that shall be trained to identify and classify tumorous tissue.
The ill-defined tumor borders of glioblastoma multiforme pose a major challenge for the surgeon during tumor resection, since the goal of the tumor resection is the complete removal, while saving as much healthy brain tissue as possible. In recent years, optical coherence tomography (OCT) was successfully used to classify white matter from tumor infiltrated white matter by several research groups. Motivated by these results, a dataset was created, which consisted of sets of corresponding ex vivo OCT images, which were acquired by two OCT-systems with different properties (e.g. wavelength and resolution). Each image was annotated with semantic labels. The labels differentiate between white and gray matter and three different stages of tumor infiltration. The data from both systems not only allowed a comparison of the ability of a system to identify the different tissue types present during the tumor resection, but also enable a multimodal tissue analysis evaluating corresponding OCT images of the two systems simultaneously. A convolutional neural network with dirichlet prior was trained, which allowed to capture the uncertainty of a prediction. The approach increased the sensitivity of identifying tumor infiltration from 58 % to 78 % for data with a low prediction uncertainty compared to a previous monomodal approach.
Access to the requested content is limited to institutions that have purchased or subscribe to SPIE eBooks.
You are receiving this notice because your organization may not have SPIE eBooks access.*
*Shibboleth/Open Athens users─please
sign in
to access your institution's subscriptions.
To obtain this item, you may purchase the complete book in print or electronic format on
SPIE.org.
INSTITUTIONAL Select your institution to access the SPIE Digital Library.
PERSONAL Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.