Automated diagnosis of age-related macular degeneration using multi-modal vertical plane feature fusion via deep learning
- PMID: 35172022
- DOI: 10.1002/mp.15541
Automated diagnosis of age-related macular degeneration using multi-modal vertical plane feature fusion via deep learning
Abstract
Purpose: To develop a computer-aided diagnostic (CADx) system of age-related macular degeneration (AMD) through feature fusion between infrared reflectance (IR) and optical coherence tomography (OCT) modalities in order to explore the superiority of multi-modality CADx system and the optimal feature fusion patterns between multi-modality inputs.
Methods: This is a dual center retrospective study. We retrospectively collected 2006 pairs of IR and OCT images to develop the algorithms. Two single-modality models and three multi-modality models were constructed for the comparison of the diagnostic efficacy. The multi-modality models were designed utilizing a novel feature fusion method, namely, vertical plane feature fusion (VPFF). The results were validated using an independent external validation dataset and compared by three ophthalmologists.
Results: In the test set of the ZJU dataset, our best model named OCT_MAIN demonstrated diagnostic efficiency with an overall accuracy of 0.9608 and area under the curve of 0.9944 for the normal category, 0.9659 for the dry AMD category, and 0.9930 for the wet AMD category. The external validation exhibited an overall accuracy of 0.9159. Its diagnostic efficiency was comparable to that of the senior ophthalmologist.
Conclusions: The VPFF method was successfully employed to develop a multi-modal intelligent diagnostic system for the AMD classification. This is a valuable complement and optimization to the existing CADx system, which reveals a wide application prospect and research potential.
Keywords: age-related macular degeneration; deep learning; feature fusion; multi-modality.
© 2022 American Association of Physicists in Medicine.
Similar articles
-
Deep Learning Applications to Classification and Detection of Age-Related Macular Degeneration on Optical Coherence Tomography Imaging: A Review.Ophthalmol Ther. 2023 Oct;12(5):2347-2359. doi: 10.1007/s40123-023-00775-0. Epub 2023 Jul 26. Ophthalmol Ther. 2023. PMID: 37493854 Free PMC article. Review.
-
Multimodal deep learning with feature level fusion for identification of choroidal neovascularization activity in age-related macular degeneration.Acta Ophthalmol. 2022 Mar;100(2):e512-e520. doi: 10.1111/aos.14928. Epub 2021 Jun 23. Acta Ophthalmol. 2022. PMID: 34159761
-
Development and validation of a deep-learning algorithm for the detection of neovascular age-related macular degeneration from colour fundus photographs.Clin Exp Ophthalmol. 2019 Nov;47(8):1009-1018. doi: 10.1111/ceo.13575. Epub 2019 Jul 25. Clin Exp Ophthalmol. 2019. PMID: 31215760
-
Automated diagnoses of age-related macular degeneration and polypoidal choroidal vasculopathy using bi-modal deep convolutional neural networks.Br J Ophthalmol. 2021 Apr;105(4):561-566. doi: 10.1136/bjophthalmol-2020-315817. Epub 2020 Jun 4. Br J Ophthalmol. 2021. PMID: 32499330
-
Morphologic features of large choroidal vessel layer: age-related macular degeneration, polypoidal choroidal vasculopathy, and central serous chorioretinopathy.Graefes Arch Clin Exp Ophthalmol. 2018 Dec;256(12):2309-2317. doi: 10.1007/s00417-018-4143-1. Epub 2018 Sep 27. Graefes Arch Clin Exp Ophthalmol. 2018. PMID: 30259090 Review.
Cited by
-
Advances and prospects of multi-modal ophthalmic artificial intelligence based on deep learning: a review.Eye Vis (Lond). 2024 Oct 1;11(1):38. doi: 10.1186/s40662-024-00405-1. Eye Vis (Lond). 2024. PMID: 39350240 Free PMC article. Review.
-
Cross-modal attention network for retinal disease classification based on multi-modal images.Biomed Opt Express. 2024 May 14;15(6):3699-3714. doi: 10.1364/BOE.516764. eCollection 2024 Jun 1. Biomed Opt Express. 2024. PMID: 38867787 Free PMC article.
-
Artificial intelligence for diagnosing exudative age-related macular degeneration.Cochrane Database Syst Rev. 2024 Oct 17;10(10):CD015522. doi: 10.1002/14651858.CD015522.pub2. Cochrane Database Syst Rev. 2024. PMID: 39417312 Review.
-
Deep Learning Applications to Classification and Detection of Age-Related Macular Degeneration on Optical Coherence Tomography Imaging: A Review.Ophthalmol Ther. 2023 Oct;12(5):2347-2359. doi: 10.1007/s40123-023-00775-0. Epub 2023 Jul 26. Ophthalmol Ther. 2023. PMID: 37493854 Free PMC article. Review.
-
Artificial intelligence in assessing progression of age-related macular degeneration.Eye (Lond). 2024 Nov 18. doi: 10.1038/s41433-024-03460-z. Online ahead of print. Eye (Lond). 2024. PMID: 39558093 Review.
References
REFERENCES
-
- Blindness GBD, Vision Impairment C, Vision Loss Expert Group of the Global Burden of Disease S. Causes of blindness and vision impairment in 2020 and trends over 30 years, and prevalence of avoidable blindness in relation to VISION 2020: the Right to Sight: an analysis for the Global Burden of Disease Study. Lancet Glob Health. 2021;9(2):e144-e160.
-
- Mitchell P, Liew G, Gopinath B, Wong TY. Age-related macular degeneration. Lancet. 2018;392(10153):1147-1159.
-
- Stahl A. The diagnosis and treatment of age-related macular degeneration. Dtsch Arztebl Int. 2020;117(29-30):513-520.
-
- Ferris FL 3rd, Wilkinson CP, Bird A, et al. Clinical classification of age-related macular degeneration. Ophthalmology. 2013;120(4):844-851.
-
- Schmidt-Erfurth U, Klimscha S, Waldstein SM, Bogunovic H. A view of the current and future role of optical coherence tomography in the management of age-related macular degeneration. Eye (Lond). 2017;31(1):26-44.
MeSH terms
Grants and funding
- 2019YFC0118401/National Key Research and Development Program of China
- 2019C03020/Zhejiang Provincial Key Research and Development Plan
- LQ21H120002/Natural Science Foundation of Zhejiang Province
- 2021RC064/Medical and Health Science and Technology Program of Zhejiang Province
- 81670888/the Natural Science Foundation of China
LinkOut - more resources
Full Text Sources