Automated cone photoreceptor cell identification in confocal adaptive optics scanning laser ophthalmoscope images based on object detection

[in Chinese]; [in Chinese]; [in Chinese]; [in Chinese]; [in Chinese]; [in Chinese]; [in Chinese]

doi:10.1142/s1793545822500018

[1] A. Sharma et al., "Smartphone-based fundus camera device (MII Ret Cam) and technique with ability to image peripheral retina," Eur. J. Ophthalmol. 26(2), 142–144 (2016).

[2] M. Monjur et al., "Smartphone based fundus camera for the diagnosis of retinopathy," Smart Health 19, 100177 (2021).

[3] R. H. Webb, G. W. Hughes, "Scanning laser ophthalmoscope," IEEE Trans. Biomed. Eng. 7, 488–492 (1981).

[4] R. H. Webb, G. W. Hughes, F. C. Delori, "Confocal scanning laser ophthalmoscope," Appl. Opt. 26(8), 1492–1499 (1987).

[5] W. Drexler, J. G. Fujimoto, "State-of-the-art retinal optical coherence tomography," Prog. Retin. Eye Res. 27(1), 45–88 (2008).

[6] A. Unterhuber et al., "In vivo retinal optical coherence tomography at 1040 nm-enhanced penetration into the choroid," Opt. Express 13(9), 3252–3258 (2005).

[7] B. Xue et al., "Photoreceptor counting and montaging of en-face retinal images from an adaptive optics fundus camera," J. Opt. Soc. Am. A, Opt. Image Sci. Vis. 24(5), 1364–1372 (2007).

[8] A. Roorda et al., "Adaptive optics scanning laser ophthalmoscopy," Opt. Express 10(9), 405–412 (2002).

[9] Y. Zhang et al., "High-speed volumetric imaging of cone photoreceptors with adaptive optics spectraldomain optical coherence tomography," Opt. Express 14(10), 4380–4394 (2006).

[10] S. A. Burns et al., "Large-field-of-view, modular, stabilized, adaptive-optics-based scanning laser ophthalmoscope," J. Opt. Soc. Am. A 24(5), 1313–1326 (2007).

[11] R. D. Ferguson et al., "Adaptive optics scanning laser ophthalmoscope with integrated wide-field retinal imaging and tracking," J. Opt. Soc. Am. A 27(11), A265–A277 (2010).

[12] D. X. Hammer et al., "Adaptive optics scanning laser ophthalmoscope for stabilized retinal imaging," Opt. Express 14(8), 3354–3367 (2006).

[13] D. C. Chen et al., "High-resolution adaptive optics scanning laser ophthalmoscope with dual deformable mirrors," J. Opt. Soc. Am. A 24(5), 1305–1312 (2007).

[14] J. Lammer et al., "Cone photoreceptor irregularity on adaptive optics scanning laser ophthalmoscopy correlates with severity of diabetic retinopathy and macular edema," Invest. Ophthalmol. Vis. Sci. 57(15), 6624–6632 (2016).

[15] S. P. Park et al., "Early structural anomalies observed by high-resolution imaging in two related cases of autosomal-dominant retinitis pigmentosa," Ophthalmic Surg. Lasers Imaging Retina 45(5), 469–473 (2014).

[16] S. Nakatake et al., "Early detection of cone photoreceptor cell loss in retinitis pigmentosa using adaptive optics scanning laser ophthalmoscopy," Graefe's Arch. Clin. Exp. Ophthalmol. 257(6), 1169–1181 (2019).

[17] Y. Chen et al., "Cone photoreceptor abnormalities correlate with vision loss in patients with Stargardt disease," Invest. Ophthalmol. Vis. Sci. 52(6), 3281–3292 (2011).

[18] K. Y. Li, A. Roorda, "Automated identification of cone photoreceptors in adaptive optics retinal images," J. Opt. Soc. Am. A 24(5), 1358–1363 (2007).

[19] A. Turpin et al., "Automated identification of photoreceptor cones using multi-scale modelling and normalized cross-correlation," ICIAP 2011: Image Analysis and Processing, G. Maino, G. L. Foresti, Eds., Lecture Notes in Computer Science, Vol. 6978, pp. 494–503, Springer, Berlin (2011).

[20] D. Cunefare et al., "Automatic detection of cone photoreceptors in split detector adaptive optics scanning light ophthalmoscope images," Biomed. Opt. Express 7(5), 2036–2050 (2016).

[21] J. Liu et al., "Automated photoreceptor cell identi-fication on nonconfocal adaptive optics images using multiscale circular voting," Invest. Ophthalmol. Vis. Sci. 58(11), 4477–4489 (2017).

[22] D. Cunefare et al., "Deep learning based detection of cone photoreceptors with multimodal adaptive optics scanning light ophthalmoscope images of achromatopsia," Biomed. Opt. Express 9(8), 3740–3756 (2018).

[23] C. Bergeles et al., "Unsupervised identification of cone photoreceptors in non-confocal adaptive optics scanning light ophthalmoscope images," Biomed. Opt. Express 8(6), 3081–3094 (2017).

[24] Y. Chen et al., "Automated cone photoreceptor cell segmentation and identification in adaptive optics scanning laser ophthalmoscope images using morphological processing and watershed algorithm," IEEE Access 8, 105786–105792 (2020).

[25] S. J. Chiu et al., "Automatic cone photoreceptor segmentation using graph theory and dynamic programming," Biomed. Opt. Express 4(6), 924–937 (2013).

[26] Y. Chen et al., "Automated superpixels-based identi fication and mosaicking of cone photoreceptor cells for adaptive optics scanning laser ophthalmoscope," Chin. Opt. Lett. 18(10), 101701 (2020).

[27] D. M. Bukowska et al., "Semi-automated identifi-cation of cones in the human retina using circle Hough transform," Biomed. Opt. Express 6(12), 4676–4693 (2015).

[28] J. Hamwood et al., "Automatic detection of cone photoreceptors with fully convolutional networks," Transl. Vis. Sci. Technol. 8(6), 10 (2019).

[29] D. Cunefare et al., "Open source software for automatic detection of cone photoreceptors in adaptive optics ophthalmoscopy using convolutional neural networks," Sci. Rep. 7(1), 6620 (2017).

[30] B. Davidson et al., "Automatic cone photoreceptor localisation in healthy and Stargardt afflicted retinas using deep learning," Sci. Rep. 8(1), 7911 (2018).

[31] Y. Chen et al., "DeepLab and bias field correction based automatic cone photoreceptor cell identification with adaptive optics scanning laser ophthalmoscope images," Wirel. Commun. Mob. Comput. 2021, 2034125 (2021).

[32] Y. Chen et al., "Automated cone cell identification on adaptive optics scanning laser ophthalmoscope images based on TV-L1 optical °ow registration and K-means clustering," Appl. Sci. 11(5), 2259 (2021).

[33] J. Redmon, A. Farhadi, "YOLOv3: An incremental improvement," preprint, arXiv:1804.02767 [cs.CV] (2018).

[34] R. Garrioch et al., "The repeatability of in vivo parafoveal cone density and spacing measurements," Optom. Vis. Sci. 89(5), 632–643 (2012).

[35] M. D. Buil, "Non-maxima suppression," Technical Report No. ICG-TR-xxx, Institute for Computer Graphics and Vision, Graz University of Technology, Austria (2011).

[36] T. Kanungo et al., "An e±cient k-means clustering algorithm: Analysis and implementation," IEEE Trans. Pattern Anal. Mach. Intell. 24(7), 881–892 (2002).

[37] COCO Consortium, "Common Objects in Context," http://cocodataset.org (2021).

[38] L. Prechelt, "Early stopping — but when?," Neural Networks: Tricks of the Trade, Lecture Notes in Computer Science, Vol. 7700, pp. 53–67, Springer, Berlin (1998).

[39] M. D. Zeiler, "ADADELTA: An adaptive learning rate method," preprint, arXiv:1212.5701 [cs.LG] (2012).