Referral for disease-related visual impairment using retinal photograph-based deep learning: a proof-of-concept, model development study

Abstract

Background: In current approaches to vision screening in the community, a simple and efficient process is needed to identify individuals who should be referred to tertiary eye care centres for vision loss related to eye diseases. The emergence of deep learning technology offers new opportunities to revolutionise this clinical referral pathway. We aimed to assess the performance of a newly developed deep learning algorithm for detection of disease-related visual impairment. Methods: In this proof-of-concept study, using retinal fundus images from 15 175 eyes with complete data related to best-corrected visual acuity or pinhole visual acuity from the Singapore Epidemiology of Eye Diseases Study, we first developed a single-modality deep learning algorithm based on retinal photographs alone for detection of any disease-related visual impairment (defined as eyes from patients with major eye diseases and best-corrected visual acuity of <20/40), and moderate or worse disease-related visual impairment (eyes with disease and best-corrected visual acuity of <20/60). After development of the algorithm, we tested it internally, using a new set of 3803 eyes from the Singapore Epidemiology of Eye Diseases Study. We then tested it externally using three population-based studies (the Beijing Eye study [6239 eyes], Central India Eye and Medical study [6526 eyes], and Blue Mountains Eye Study [2002 eyes]), and two clinical studies (the Chinese University of Hong Kong's Sight Threatening Diabetic Retinopathy study [971 eyes] and the Outram Polyclinic Study [1225 eyes]). The algorithm's performance in each dataset was assessed on the basis of the area under the receiver operating characteristic curve (AUC). Findings: In the internal test dataset, the AUC for detection of any disease-related visual impairment was 94·2% (95% CI 93·0–95·3; sensitivity 90·7% [87·0–93·6]; specificity 86·8% [85·6–87·9]). The AUC for moderate or worse disease-related visual impairment was 93·9% (95% CI 92·2–95·6; sensitivity 94·6% [89·6–97·6]; specificity 81·3% [80·0–82·5]). Across the five external test datasets (16 993 eyes), the algorithm achieved AUCs ranging between 86·6% (83·4–89·7; sensitivity 87·5% [80·7–92·5]; specificity 70·0% [66·7–73·1]) and 93·6% (92·4–94·8; sensitivity 87·8% [84·1–90·9]; specificity 87·1% [86·2–88·0]) for any disease-related visual impairment, and the AUCs for moderate or worse disease-related visual impairment ranged between 85·9% (81·8–90·1; sensitivity 84·7% [73·0–92·8]; specificity 74·4% [71·4–77·2]) and 93·5% (91·7–95·3; sensitivity 90·3% [84·2–94·6]; specificity 84·2% [83·2–85·1]). Interpretation: This proof-of-concept study shows the potential of a single-modality, function-focused tool in identifying visual impairment related to major eye diseases, providing more timely and pinpointed referral of patients with disease-related visual impairment from the community to tertiary eye hospitals. Funding: National Medical Research Council, Singapore. © 2021 The Author(s). Published by Elsevier Ltd. This is an Open Access article under the CC BY 4.0 license