|
1.IntroductionMost retinal diseases are closely related to vasculopathy, such as diabetic retinopathy, retinal vascular occlusive disease, and choroidal neovascularization. Fundus fluorescein angiography (FFA) is widely used in clinical practice and is the gold standard for vascular imaging of the retina and choroid. However, it is an invasive procedure with an associated risk of complications which limits clinical applications.1 In addition, FFA can only provide two-dimensional (2-D) images of the fundus, and the deeper capillary network may not be visualized well by FFA.2 Optical coherence tomography (OCT) is a noninvasive, high-resolution biomedical imaging technology that can provide three-dimensional (3-D) images of the fundus. Doppler OCT (D-OCT) is a functional extension of OCT which can image not only structure but also blood flow.3–5 Compared to the absolute value of flow velocity, the microvascular networks in the retina are also important for diagnosing retinal diseases. A number of methods have been developed to visualize the microvascular networks. A phase-resolved Doppler variance method was first used to map vessels in human skin and brain.6,7 Since then, it has been used in imaging retinal flow.8–10 Yasuno et al.11 and Wang et al.12 used a modified Hilbert transform to achieve high-resolution images of blood flow. Several extensions of D-OCT based on amplitude variance have also demonstrated capabilities of microvascular imaging which are not sensitive to phase noise artifacts, including speckle variance,13,14 correlation mapping,15 split-spectrum amplitude-decorrelation angiography,16 intensity-based Doppler variance (IBDV).9,17,18 Compared with phase-resolved methods, amplitude variance methods do not depend on phase stability. The IBDV method has been demonstrated in a phase instable situation, and the human choroidal blood vessel network was also achieved.9 Compared with FFA which only shows 2-D images of the fundus, OCT can provide the 3-D structure of the fundus. The vascular morphology of intraretinal layers can be obtained by combining OCT angiography and 3-D segmentation of intraretinal layers. It may allow earlier diagnosis and more precise monitoring of some retinal diseases.19,20 There are several approaches that have successfully segmented intraretinal layers in 2-D images, such as the active contour model,21 Dijkstra algorithm,22 and dynamic programming.23 The 3-D surfaces of the retina can be obtained by applying these 2-D based algorithms independently on each image. Compared with 2-D-based methods, 3-D-based segmentation methods can make full use of the information from neighboring B-scans and help improve the accuracy and robustness of the algorithm. A graph cut-based segmentation method was proposed for simultaneous segmentation of multiple 3-D surfaces in the macula24 and optic nerve head.25 However, the minimum cut graph algorithm is computationally expensive which usually requires minutes to complete a 3-D data segmentation. Cheng and Lin26 proposed a fast 3-D dynamic programming expansion method for vessel boundary detection on magnetic resonance imaging sequences. Efficiency was significantly improved with good robustness, and this method can be used in retinal boundary detection. In this paper, we combine the 3-D dynamic programming method with intensity-based Doppler variance based on swept-source OCT (SS-OCT). The microvascular morphology of intraretinal layers is visualized in vivo in a normal subject by using this method. The microvascular network with the 3-D structure of the retina has potential for earlier diagnosis and precise monitoring in retinal vascular diseases. 2.MethodsIn this study, a 1050-nm SS-OCT system was used to acquire the 3-D data of the fundus. A commercially available swept-source laser (Axsun Technologies Inc., Billerica, Massachusetts) with a center wavelength of 1050 and 100 nm tuning range was used. The configuration of the system has already been described in previous reports.27 The axial resolution was , and the image range was 3.0 mm at the retina (). The interference signal was digitized by a 12 bit 500 MHz data acquisition board, ATS9350 (Alazar Technologies Inc., Pointe-Claire, QC, Canada), and the signal acquisition was triggered by an optical clock generated by the Axsun laser. The signal-to-noise ratio (SNR) of the system was 95 dB with 1.8 mW of sample arm power and a 100-kHz acquisition rate. A 3-dB sensitivity roll-off from 0.1-mm imaging depth to 1.5-mm imaging depth was measured. Three right eyes (two normal subjects and one high myopia patient) were used to demonstrate the feasibility of the method under the protocols approved by the Institutional Review Board. Each set of 3-D measurements was composed of 200 slices of 400 A-lines over an area of . Each slice was composed of eight sequential B-scans at the same position, which can achieve a high time difference () to improve the sensitivity of the IBDV method. The total acquisition time of a 3-D volumetric data was approximately 6.8 s including the flyback time. The subject was asked to fixate on an internal target during the acquisition. Custom-built OCT data acquisition and processing software was developed with Microsoft Visual C++ 2012. In order to achieve real-time preview of the acquired data, the graphics processing unit (GPU)-accelerated computing technique was used with NVIDIA’s compute unified device architecture (CUDA, 6.5) toolkit. The SS-OCT preprocessing, including fixed pattern noise removal, spectral shaping, zero-padding, and numerical dispersion compensation, was accelerated by the GPU. Figure 1 shows the flow diagram of the IBDV method combined with 3-D segmentation after obtaining the complex OCT data by preprocessing the interference signal. The intensity-based Doppler variance method9 was used to visualize the retinal vasculature. The time difference () was increased by using the interframe method. Although the motion artifacts were significantly attenuated because of the improvement of acquisition speed, the motion between the B-scans still cannot be ignored, especially the axis motion.28 A subpixel registration algorithm29 was used to alignment sequential B-scans in both the fast transverse direction, , and axial direction, . The variance value () between sequential B-scans in the same position is given by9,18 where is the number of the depth points that are averaged and is the number of the B-scans at the same position. The SNR can be increased by choosing a larger and . In this application, the is the set at 2 and the is the set at 8. denotes the amplitude value which is extracted from complex OCT data. Finally, a threshold based on the histogram analysis of the averaged intensity images is used to remove the noise.In order to obtain the vascular morphology of the intraretinal layers, the boundaries of each layer are required. We used a 3-D expansion of the dynamic programming method26 for automated boundaries detection. The basic idea of the method is to transform the boundary detection problem to an optimization problem that searches for an optimal path. In 2-D images, each pixel is treated as a node in the graph, and the links connecting the nodes are called edges. The values of the links are assigned based on the intensity of the pixels. The start node is a virtual node which connects to the nodes in the first column in the image and the weights are assigned to zero. Correspondingly, the end node is also a virtual node which connects to the nodes in last column. The boundaries can be found by searching the minimum cost of the path from start node to end node. For 3-D expansion, the surfaces of the layers were achieved by sequentially performing the search process in the fast scan plane and slow scan plane. The dynamic programming provides an efficient optimization method to find the minimum cost of the surface. Consider a volumetric image of size , where the and are the numbers of fast scan and slow scan, and denotes the depth. The iterative cost function in two directions is given by26 for and , where and are the accumulation costs in the plane and the plane, respectively. The initialization of and are assigned by . The parameters and constrain the searching range which can be used to control the smoothness of the surfaces. The parameters and are also used to control the smoothness of the surfaces. For retinal segmentation, the parameters and are set to zero. The volumetric image is the intensity gradient image along the vertical direction which is obtained by the dark-to-light or light-to-dark intensity transition. denotes the weights from node to node and the weights can be calculated as follows22 where is the gradient value of the node which is normalized to values between 0 and 1. The is the minimum weight for system stabilization, which is set at .Figure 1 outlines the core steps of the 3-D segmentation method for the retina. The averaged images were obtained from eight consecutive B-scans after registration. Before segmentation, a 3-D median filter is applied to the volumetric data using a window size of voxels. The initial location of the retina is determined by the inner limiting membrance (ILM) layer and retinal pigment epithelium (RPE) layer. The ILM layer is defined as the first high reflective increase from the inner side of the retina, and the RPE layer can be determined as the highest peak after the ILM layer. Therefore, the initial location of the ILM and RPE layer can be determined from the A-scan profile. After smoothing by using the polynomial method, the search area for the ILM layer can be reduced based on the rudimentary ILM boundary. Finally, the ILM layer is refined by finding the optimal path in a limited region. After obtaining the location of the retina, the limited search region can be determined based on the characteristics of the retinal structure. The OPL/ONL layer and IS/OS layer are the most obvious layers besides the ILM layer, and the intensity transition along the axis direction between two layers are in opposite directions. Therefore, these two layers can be determined first. The other surfaces can also be obtained by limiting the search region based on the previous layers. A 2-D average filter is applied to the segmentation results to obtain smooth surfaces. Finally, the surfaces of ILM, nerve fiber layer (NFL)/ganglion cell layer (GCL), inner plexiform layer (IPL)/inner nuclear layer (INL), INL/outer plexiform layer (OPL), OPL/outer nuclear layer (ONL), outer segment (IS)/outer segment (OS), and RPE/choroid [Fig. 2(c)] are detected by the automatic algorithm. Combined with the 3-D surfaces data, the volumetric microvascular signal of the retina can be segmented into different layers from the IBDV dataset. The en face projection view of the microvascular network for intraretinal layers is produced by using the maximum intensity projection (MIP) method. 3.Results and DiscussionThe 3-D OCT data of the retina from three right eyes was collected to test the feasibility of the method. The seven surfaces of the intraretinal layers were segmented automatically by the developed automated segmentation algorithm. The 3-D volume rendering of the retina centered on the macular fovea with an image area of is shown in Fig. 2(a). The seven segmented surfaces from the ILM layer to the RPE/choroid boundary are reconstructed [Fig. 2(b)] such that the retina from ILM layer to RPE/choroid boundary can be divided into six layers, including NFL, GCL + IPL, INL, OPL, ONL + IS, and OS. Figure 2(c) shows a cross-section image overlaid with the segmented boundaries, and the position of the image is indicated by the planes in Figs. 2(a) and 2(b). The flying view of the segmented layers along the axis is also shown in Video 1. The position of the segmented layers accurately fall on the corresponding boundaries of intraretinal layers [Fig. 2(c) and Video 1], and the six layers of the retina are successfully obtained. Compared with the 2-D image segmentation algorithm in the retina,22,23 the 3-D expansion dynamic programming method can use the information from neighboring B-scans to improve the accuracy and robustness of the algorithm. Garvin et al.24 proposed a graph cut-based method for simultaneous segmentation of multiple 3-D surfaces in the retina. However, the computational complexity was significantly increased in the 3-D data. Compared with the graph cut method, the computational complexity can be significantly reduced by using a dynamic programming method. The processing time for finding an optimal surface from volume data with voxels was with parallel techniques in a Quad-Core Intel i7 2.66GHz workstation. The total processing time for extracting all of the surfaces was and the most time-consuming step was the 3-D median filter processing. To evaluate the accuracy of the developed automated segmentation algorithm, the results of 27 slides from three sets of 3-D volume data were compared to those achieved by manual segmentation. Nine linear spaced slides (in the fast scan plane) from each dataset were selected, and the fifth slide was centered at the fovea. The manual boundary detections were obtained by three trained graders using ImageJ software [National Institutes of Health (NIH), Bethesda, Maryland]. The automatic detections were extracted from the corresponding positions of the seven segmented surfaces. The deviation of the difference in retinal boundary positions between the automated and manual detections was calculated.23 The boundaries of retinal layers detected by the automated algorithm were very close to the manual segmentation results in both normal and high-myopia eyes. The mean differences were within 2.18 pixels (Table 1) which are similar to 2-D-based segmentation algorithms.22,23 The differences between automatic segmentation and averaged manual segmentation were similar to the difference between manual graders. The layers were segmented based on the normal characteristics of retinal structure. The algorithm may fail with obvious abnormal structures, such as central serous chorioretinopathy (serous detachment of the neurosensory retina) and retinitis pigmentosa (disappearance of the OS layer).30 However, the 3-D expansion dynamic programming method is suitable for interactive segmentation in retinal disease because of a significant reduction in the computational complexity. Table 1Differences (mean±SD in pixels) in retinal boundary positions of 27 slides from three sets of 3-D volume data. Between-segmenter indicates the mean differences of M1 versus M2, M1 versus M3, and M2 versus M3; auto indicates the results from automated segmentation; M1, M2, and M3 indicate the results from three trained graders; Avg indicates the averaged results from graders. Each pixel is 2.83 μm.
The microvascular network of the macular retina was also obtained by using the IBDV method. Figure 3(a) shows en face retina vessels from the ILM layer to the RPE/choroid boundary by using the MIP method. The capillary network can clearly be visualized around the foveal avascular zone. Figures 3(b) and 3(c) are cross-sectional views of the vessels merged with the intensity images corresponding to the blue and green lines in Fig. 3(a). Video 2 shows the changes of the vessels along the y axis. Most of the vessel signals are located in the inner retina and choroid. There are also some Doppler variance signals in the outer retina which should be avascular. This should relate to the shadow artifact from the upper layers.10,31 Total processing for obtaining the IBDV images from the raw dataset is after acceleration by the GPU (NVIDIA, GeForce GTX 460). Combined with seven surfaces of the intraretinal data, the microvascular network of the macular retina can be divided into six layers. Figures 4(a)–4(f) present an en face MIP microvascular view of the six layers, including NFL, GCL + IPL, INL, OPL, ONL + IS, and OS + RPE. Most of the vessels in the macular region are located in the inner retina, which agree with the known anatomy.32 In Figs. 4(h) and 4(i), some deeper microvessels may be sheltered from upper vessels in the en face view of the total retina. Segmentation of the individual layers can help to separate these vessels. Microvascular images of individual layers may provide some essential information for early diagnosis of some retinal diseases. The shadow artifacts are also observed in the MIP view of the individual layers [Fig. 4(f)]. However, most of the shadow artifacts are generated from the relatively large vessels [Figs. 3(b) and 3(c)]. Compared with simply projecting the maximum values with a range of depth above the RPE/choroid boundary [Fig. 4(i)], the MIP view from the ILM layer to the RPE/choroid boundary [Fig. 4(h)] can help to improve the quality of an OCT angiography image. Because the retinal vessels are concentrated in the inner retinal layers (GCL, IPL, INL, OPL), the contrast of the microvascular images can be improved by projecting the maximum values from the NFL/GCL boundary to the OPL/ONL boundary [Fig. 4(g)] rather than the total retina [Fig. 4(h)]. 4.ConclusionIn summary, we have demonstrated a 3-D segmentation method with IBDV based on SS-OCT with a center wavelength of 1050 nm. The feasibility of the method was tested on 3-D data of a retina centered on the macular fovea with an image area of . The seven surfaces of the intraretinal layers were successfully segmented automatically by using a 3-D expansion of a dynamic programming method. The IBDV method was used to acquire the microvascular network of the macular retina. The en face MIP microvascular network images of six layers were obtained after combining the 3-D surfaces of the segmented layers. The morphology of the microvascular network for the individual intraretinal layers can be visualized, and the segmentation method can also be used to enhance the contrast of the vascular images. This method has potential for earlier diagnosis and precise monitoring in retinal vascular diseases. AcknowledgmentsThis work was supported by the National Institutes of Health under Grant Nos. R01EY-021529, R01HL-125084, R01HL-105215, and P41-EB015890; and the National Major Equipment Program from the Ministry of Science and Technology in Beijing, China, under Grant No. 2012YQ12008004. Dr. Zhongping Chen has a financial interest in OCT Medical Inc., which, however, did not support this work. ReferencesL. A. Yannuzzi et al.,
“Fluorescein angiography complication survey,”
Ophthalmology, 93
(5), 611
–617
(1986). http://dx.doi.org/10.1016/S0161-6420(86)33697-2 OPANEW 0743-751X Google Scholar
K. R. Mendis et al.,
“Correlation of histologic and clinical images to determine the diagnostic value of fluorescein angiography for studying retinal capillary detail,”
Invest. Ophthalmol. Vis. Sci., 51
(11), 5864
–5869
(2010). http://dx.doi.org/10.1167/iovs.10-5333 Google Scholar
Z. Chen et al.,
“Optical Doppler tomographic imaging of fluid flow velocity in highly scattering media,”
Opt. Lett., 22
(1), 64
–66
(1997). http://dx.doi.org/10.1364/OL.22.000064 Google Scholar
Z. Chen et al.,
“Noninvasive imaging of in vivo blood flow velocity using optical Doppler tomography,”
Opt. Lett., 22
(14), 1119
–1121
(1997). http://dx.doi.org/10.1364/OL.22.001119 Google Scholar
Y. Zhao et al.,
“Phase-resolved optical coherence tomography and optical Doppler tomography for imaging blood flow in human skin with fast scanning speed and high velocity sensitivity,”
Opt. Lett., 25
(2), 114
–116
(2000). http://dx.doi.org/10.1364/OL.25.000114 Google Scholar
Y. Zhao et al.,
“Doppler standard deviation imaging for clinical monitoring of in vivo human skin blood flow,”
Opt. Lett., 25
(18), 1358
–1360
(2000). http://dx.doi.org/10.1364/OL.25.001358 Google Scholar
L. Yu et al.,
“Spectral Doppler optical coherence tomography imaging of localized ischemic stroke in a mouse model,”
J. Biomed. Opt., 15
(6), 066006
(2010). http://dx.doi.org/10.1117/1.3505016 Google Scholar
L. Yu and Z. Chen,
“Doppler variance imaging for three-dimensional retina and choroid angiography,”
J. Biomed. Opt., 15
(1), 016029
(2010). http://dx.doi.org/10.1117/1.3302806 Google Scholar
G. Liu et al.,
“Intensity-based modified Doppler variance algorithm: application to phase instable and phase stable optical coherence tomography systems,”
Opt. Express, 19
(12), 11429
–11440
(2011). http://dx.doi.org/10.1364/OE.19.011429 OPEXFF 1094-4087 Google Scholar
D. Y. Kim et al.,
“In vivo volumetric imaging of human retinal circulation with phase-variance optical coherence tomography,”
Biomed. Opt. Express, 2
(6), 1504
–1513
(2011). http://dx.doi.org/10.1364/BOE.2.001504 Google Scholar
Y. Yasuno et al.,
“In vivo high-contrast imaging of deep posterior eye by 1-μm swept source optical coherence tomography andscattering optical coherence angiography,”
Opt. Express, 15
(10), 6121
–6139
(2007). http://dx.doi.org/10.1364/OE.15.006121 OPEXFF 1094-4087 Google Scholar
R. K. Wang et al.,
“Three dimensional optical angiography,”
Opt. Express, 15
(7), 4083
–4097
(2007). http://dx.doi.org/10.1364/OE.15.004083 Google Scholar
A. Mariampillai et al.,
“Speckle variance detection of microvasculature using swept-source optical coherence tomography,”
Opt. Lett., 33
(13), 1530
–1532
(2008). http://dx.doi.org/10.1364/OL.33.001530 Google Scholar
A. Mariampillai et al.,
“Optimized speckle variance OCT imaging of microvasculature,”
Opt. Lett., 35
(8), 1257
–1259
(2010). http://dx.doi.org/10.1364/OL.35.001257 Google Scholar
J. Enfield, E. Jonathan and M. Leahy,
“In vivo imaging of the microcirculation of the volar forearm using correlation mapping optical coherence tomography (cmOCT),”
Biomed. Opt. Express, 2
(5), 1184
–1193
(2011). http://dx.doi.org/10.1364/BOE.2.001184 Google Scholar
Y. L. Jia et al.,
“Split-spectrum amplitude-decorrelation angiography with optical coherence tomography,”
Opt. Express, 20
(4), 4710
–4725
(2012). http://dx.doi.org/10.1364/OE.20.004710 OPEXFF 1094-4087 Google Scholar
G. Liu et al.,
“High-resolution imaging of microvasculature in human skin in-vivo with optical coherence tomography,”
Opt. Express, 20
(7), 7694
–7705
(2012). http://dx.doi.org/10.1364/OE.20.007694 OPEXFF 1094-4087 Google Scholar
G. Liu et al.,
“A comparison of Doppler optical coherence tomography methods,”
Biomed. Opt. Express, 3
(10), 2669
–2680
(2012). http://dx.doi.org/10.1364/BOE.3.002669 Google Scholar
P. A. D’Amore,
“Mechanisms of retinal and choroidal neovascularization,”
Invest. Ophthalmol. Visual Sci., 35
(12), 3974
–3979
(1994). IOVSDA 0146-0404 Google Scholar
B. L. Sikorski et al.,
“The diagnostic function of OCT in diabetic maculopathy,”
Mediators Inflammation, 2013 434560
(2013). http://dx.doi.org/10.1155/2013/434560 MNFLEF Google Scholar
A. Mishra et al.,
“Intra-retinal layer segmentation in optical coherence tomography images,”
Opt. Express, 17
(26), 23719
–23728
(2009). http://dx.doi.org/10.1364/OE.17.023719 OPEXFF 1094-4087 Google Scholar
S. J. Chiu et al.,
“Automatic segmentation of seven retinal layers in SDOCT images congruent with expert manual segmentation,”
Opt. Express, 18
(18), 19413
–19428
(2010). http://dx.doi.org/10.1364/OE.18.019413 OPEXFF 1094-4087 Google Scholar
Q. Yang et al.,
“Automated layer segmentation of macular OCT images using dual-scale gradient information,”
Opt. Express, 18
(20), 21293
–21307
(2010). http://dx.doi.org/10.1364/OE.18.021293 OPEXFF 1094-4087 Google Scholar
M. K. Garvin et al.,
“Automated 3-D intraretinal layer segmentation of macular spectral-domain optical coherence tomography images,”
IEEE Trans. Med. Imaging, 28
(9), 1436
–1447
(2009). http://dx.doi.org/10.1109/TMI.2009.2016958 Google Scholar
B. J. Antony et al.,
“Automated 3D segmentation of multiple surfaces with a shared hole: segmentation of the neural canal opening in SD-OCT volumes,”
Med. Image Comput. Comput. Assist. Interv., 17
(Pt. 1), 739
–746
(2014). http://dx.doi.org/10.1007/978-3-319-10404-1_92 Google Scholar
D. C. Cheng and J. T. Lin,
“Three-dimensional expansion of a dynamic programming method for boundary detection and its application to sequential magnetic resonance imaging (MRI),”
Sensors, 12
(5), 5195
–5211
(2012). http://dx.doi.org/10.3390/s120505195 SNSRES 0746-9462 Google Scholar
B. Potsaid et al.,
“Ultrahigh speed 1050 nm swept source/Fourier domain OCT retinal and anterior segment imaging at 100,000 to 400,000 axial scans per second,”
Opt. Express, 18
(19), 20029
–20048
(2010). http://dx.doi.org/10.1364/OE.18.020029 Google Scholar
R. de Kinkelder et al.,
“Heartbeat-induced axial motion artifacts in optical coherence tomography measurements of the retina,”
Invest. Ophthalmol. Vis. Sci., 52
(6), 3908
–3913
(2011). http://dx.doi.org/10.1167/iovs.10-6738 Google Scholar
M. Guizar-Sicairos, S. T. Thurman and J. R. Fienup,
“Efficient subpixel image registration algorithms,”
Opt. Lett., 33
(2), 156
–158
(2008). http://dx.doi.org/10.1364/OL.33.000156 Google Scholar
P. Riordan-Eva and E. Cunningham, Vaughan and Asbury’s General Ophthalmology, 18th ed.McGraw-Hill, New York
(2011). Google Scholar
L. An, T. T. Shen and R. K. Wang,
“Using ultrahigh sensitive optical microangiography to achieve comprehensive depth resolved microvasculature mapping for human retina,”
J. Biomed. Opt., 16
(10), 106013
(2011). http://dx.doi.org/10.1117/1.3642638 Google Scholar
D. M. Snodderly, R. S. Weinhaus and J. Choi,
“Neural-vascular relationships in central retina of macaque monkeys (Macaca fascicularis),”
J. Neurosci., 12
(4), 1169
–1193
(1992). JNNUEF Google Scholar
BiographyZhongping Chen is a professor of biomedical engineering and the director of the F-OCT Laboratory at the University of California, Irvine. He is a co-founder and the board chairman of OCT Medical Imaging Inc. His research group has pioneered the development of Doppler optical coherence tomography. He has published more than 200 peer-reviewed papers. He is a fellow of the American Institute of Medical and Biological Engineering, a fellow of SPIE, and OSA. |