This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Research Protocols, is properly cited. The complete bibliographic information, a link to the original publication on http://www.researchprotocols.org, as well as this copyright and license information must be included.
Background
Visual impairment and blindness from diabetic retinopathy (DR), which can be reduced by early screening and treatment, is an emerging public health concern in low-income and middle-income countries (LMICs) owing to the increasing prevalence of diabetes mellitus (DM). However, no systematic screening exists in most LMIC settings. The Western province of Sri Lanka has the highest prevalence of DM (18.6%) in the country. A situational analysis identified a marked gap in DR screening (DRS) and treatment services uptake in this region; only opportunistic screening is practiced currently.
Objective
The aim of this protocol is to describe the methods of development and validation of a DRS intervention using a hand-held nonmydriatic digital camera by physician graders in a non-ophthalmological setting at a tertiary-level medical clinic to propose a valid and feasible modality to improve uptake.
Methods
DRS modality was developed after assessing barriers and identifying the most appropriate personnel, methods, and location for screening services, following formative research work. The validation will be conducted in a public sector tertiary care center in the Western province of Sri Lanka. The selected physicians will be trained on capturing and grading images according to a valid locally adopted protocol. Two physicians rated high on training will screen a sample of 506 people with DM at a medical clinic. They will use nonmydriatic and mydriatic 2-field imaging strategy. The validity of the proposed screening procedure will be assessed and compared with the mydriatic indirect biomicroscopic examination by a senior retinologist.
Results
The validity of screening by physician graders will be analyzed and the sensitivity, specificity, and predictive values (with 95% CIs) calculated by the dilation status and for each grader. The diagnostic accuracy at each level of severity of DR will be assessed to define the most appropriate referable criteria. Data is currently being collected.
Conclusions
The outcome of this study will be useful for the detection of a defined level of DR at non-ophthalmological setting to filter the people with DM before referral to an eye clinic. This will be helpful to improve the uptake and identify risk groups in advance to prevent sight-threatening DR. Furthermore, evidence from this study will be useful for the implementation of a DRS program in this region and in similar communities.
International Registered Report Identifier (IRRID)
The prevalence of diabetes mellitus (DM) and the number of people affected by DM is increasing rapidly in all regions. The International Diabetes Federation estimated that 425 million people had diabetes in 2017, which will increase to 629 million in 2045 globally [1]. This increase is expected to be the highest in low-income and middle-income countries (LMICs) compared with high-income countries (HIC) [2]. Diabetic retinopathy (DR) is a common microvascular complication of DM, which can lead to visual impairment and blindness if not detected early and treated [3]. Many studies have reported that visual loss from DR can be largely prevented by early screening and appropriate treatment [4-6]. Diabetic retinopathy screening (DRS) can be done in 2 ways, systematic screening similar to national-level programs in HIC versus opportunistic screening and case detection, which is common in low-income settings. Most LMICs are unlikely to have full population-based screening program owing to resources constraints. The current method of DRS in most LMICs is direct ophthalmoscopy, which has a lower diagnostic accuracy and found to be ineffective even after training [7]. The mydriatic biomicroscopic examination by an ophthalmologist is practically not possible in these countries owing to a low number of ophthalmologists, and eye clinics are overburdened with highly prevalent blinding conditions such as cataract [8].
The reasons for the unavailability of DRS programs (DRSPs) in LMIC settings are mostly attributed to the lack of skilled human resources, financial resources, and evidence of what works in the local system [9-11]. Therefore, it would be important to understand the approaches for screening, especially in non-ophthalmological settings. Conventional digital cameras need a larger space, skilled photographers, and large image storage devices. In addition, systematic screening using sophisticated table-top imaging systems incur high capital investment though they are cost-effective [12]. Hand-held digital cameras are easy to move, require minimum space, minimum power consumption, and are user-friendly [13]. In addition, nonmydriatic hand-held cameras are less discomforting to participants and can be used while people with DM are waiting in front of a physician for consultation. The usage of a camera without pupil dilatation is comfortable to people with DM, as well as easy for providers. However, the latter depends on the quality of the image available for grading [14].
Various photographic studies have looked at the diagnostic test accuracy of DRS using digital imaging. Most of these studies used static table-top imaging systems and were conducted in HICs. These studies have shown a sensitivity of 68%-97% and a specificity of 71%-100% in nonmydriatic imaging using ophthalmic human resources as index graders [15-18]. Similarly, in mydriatic imaging, most of the studies have used table-top imaging systems, ophthalmic human resources as index test graders, and were conducted in HICs. These studies have shown a sensitivity of 77%-97% and a specificity of 76%-98% in mydriatic digital imaging [19-22]. There is a gap in evidence in digital retinal imaging in LMICs using non-ophthalmic human resources. In addition, the usage of context-specific imaging systems, such as hand-held digital retinal camera, in non-ophthalmic setting was not reported in the current literature.
Sri Lanka has achieved remarkable development in the health sector; however, there are public health concerns such as DR which have not been addressed to date [23]. The crude prevalence of DM in Sri Lanka was 12.6% (>20 years), being highest in the Western province (18.6%, 95% CI 15.8%-21.5%) [24]. In the Western province, there are approximately 750,000 (age>18 years) people with DM, 20% (150,000/750,000) of whom are likely to have nonproliferative DR (NPDR). A situational analysis conducted in this region has shown that the number of people undergoing opportunistic screening and free treatment in the public sector was far lower than the estimated need [25]. There is no systematic DRS in the Western province despite the high prevalence of DM [25]. In addition, there is no published data on this topic from Sri Lanka. The aim of this protocol is to describe the methods of validation of a DRS approach using digital imaging by physician graders in a tertiary-level public sector medical clinic. This study will demonstrate the functional and technical feasibility of using a hand-held digital camera in an LMIC non-ophthalmological setting and assess the diagnostic accuracy.
MethodsEthics Approval
Ethics review committees of National Eye Hospital (Colombo, Sri Lanka) and London School of Hygiene & Tropical Medicine (United Kingdom) granted ethics approval.
Development of the Diabetic Retinopathy Screening Modality and Training
The initial formative research showed that nonmydriatic digital retinal imaging at medical clinics by general physicians was a potential option for the local setting. We selected 9 general physicians from a tertiary-level institution following informed consent, and they underwent a competency-based training by 2 retinologists from a tertiary center, which included the following: capturing retinal fields using a hand-held fundus camera, identification of signs of DR (including macular signs) using images, and DR grading according to an adapted classification system (Table 1). DR signs are graded at 4 levels as follows: none=R0, mild NPDR=R1, moderate NPDR=R2, severe NPDR=R3, and proliferative DR and above=R4. Macular changes are graded as follows: none=M0 (maculopathy absent) and exudate(s) or blot hemorrhage(s) within 2-disc diameters from the center of the fovea=M1 (maculopathy present). Guidelines were used to standardize reporting of image quality, which included ungradable images based on the proportion of the retina visible for grading (Figure 1). After the training, physicians were tested using a set of standard images of DR, and the two physicians who reached the required level of agreement with the retinologists (κ=.8-.9) were selected as graders in the validation study.
Adapted diabetic retinopathy classification for the validation study.
Signs
No DRa (R0)
Mild BDRb or NPDRc (R1)
Moderate BDR or NPDR (R2)
Severe NPDR (R3)
PDRd (R4)
Microaneurysms
No
Few
Multiple
Multiple
Present
Hard exudatese
No
Few
Multiple
Multiple
Present
Cotton wool spots
No
Occasional
Multiple
Multiple
Present
Intraretinal hemorrhagee
No
Few
>20 in 1-3 quadrants
>20 in 4 quadrants
Present
Venous beading
No
Occasional
Present in 1-2 quadrants
Present in >2 quadrants
Present
IRMAf
No
No
Present ~1 quadrant
Prominent >1 quadrant
Present
NVDg
No
No
No
No
Present
NVEh
No
No
No
No
Present
Vitreous or preretinal hemorrhage
No
No
No
No
Present—advanced PDR
Traction
No
No
No
No
Present—advanced PDR
Fibrosis
No
No
No
No
Present—advanced PDR
aDR: diabetic retinopathy.
bBDR: Background DR.
cNPDR: nonproliferative DR.
dPDR: proliferative DR.
eNot within the definition of maculopathy.
f IRMA: Intraretinal microvascular abnormalities.
gNVD: Neovascularizations over the disc.
hNVE: Neovascularizations elsewhere.
Evaluation of image quality-levels of gradeability based on the proportion of the image that can be graded.
Sample Calculation and Recruitment
The sample size (n=405) was calculated on the basis of 95% CIs, 10% margin of error, expected sensitivity 70%, and the prevalence of moderate NPDR among people with DM of 20%. Then, we inflated the sample size by an additional 25% (n=101, total n=506) to take account of ungradable images. An interim analysis will be undertaken to ascertain the level of ungradable images (ie, <50% of the retina visible) and the sample size increased, if required.
This study is a prospective observational study by design. A consecutive sample of diagnosed people with DM (age >18 years) without previous DRS at an eye clinic will be eligible to participate, after giving written informed consent. Eligible participants will be recruited by trained research assistants when people with DM present for routine medical care at the main tertiary center in Colombo. People with DM with previous retinal screening, DR-related treatment (laser treatment, intravitreal injections, and pars plana vitrectomy), and those who were currently under any DRSP or treatment will be excluded from the study. Figure 2 shows the participants’ flow diagram. Participants’ characteristics will be documented in a questionnaire schedule by research assistants on recruitment.
Participants' flow diagram in the validation.
Two retinal fields captured.
Imaging System, Capturing Images, and Grading
Two-field nonmydriatic and mydriatic retinal images will be captured and stored (Figure 3). Participants will undergo digital retinal imaging (using VISUSCOUT100 hand-held nonmydriatic fundus camera-2017; Carl Zeiss, Germany) by the physician graders at the time of presentation. This imaging system has a 40° field-of-view with 5 megapixels (type of camera sensor: complementary metal-oxide semiconductor; resolution 800×480) and captures color and red-free images in a focus range of −20 D (diopters) to +20D. The minimum pupil size required is 3.5 mm, and 9 light-emitting diodes are available for internal fixation.
First, 2-field (first field-macula centered, second field-disc centered; Figure 3), 40° retinal images will be captured in each eye by each physician grader without pupillary dilatation. Subsequently, participants’ pupils will be dilated using 2.5% phenylephrine, and the same fields will be captured, following adequate mydriasis (5-6 mm).
Each set of images will be coded and stored by research assistants after capturing. The coded image sets will be given back to the same physician graders for grading. During grading, nonmydriatic images will be graded first. The graders will be masked to the history and clinical examination findings. The retinopathy and macular signs will be identified and entered by physician graders into a hardcopy data table. Finally, it will be entered into a Microsoft Excel datasheet by research assistants. The grading data consistency checks and cleaning will be done by an independent statistician.
Reference Test
The reference test will entail a detailed, dilated fundus examination by an experienced retinologist using slit-lamp biomicroscopy with a 90D lens and indirect ophthalmoscopy using a 20D lens. After imaging, this examination will take place as early as possible. The retinologist will be masked to the clinical status and physician graders’ findings. In addition, a detailed anterior segment examination (clarity of cornea and status of the lens) and media (vitreous) examination will be done by the reference test grader. The lens opacity will be graded according to the lens opacity classification system, version 111.
Quality Assurance and Agreement Analysis
For quality assurance, 15% of each nonmydriatic and mydriatic image sets will be evaluated by the retinologist for technique, ability to image the required field, and gradeability. Then, 15% of each hundred image sets will be given back to physician graders for double grading to assess the repeatability and intragrader agreement in the first and second attempts of grading images. A sample of the same image sets (n=200) will be graded by the retinologist to calculate the intergrader agreement.
Data Analysis
We will analyze the validity of screening by physician graders and calculate the sensitivity, specificity, and predictive values with 95% CIs for each method of screening and by the grader. The analysis will be conducted by including and excluding ungradable images and considering each eye as a unit of analysis and by a person considering the worst eye. Intragrader and intergrader agreement (kappa) for both mydriatic and nonmydriatic index tests will be calculated and compared with the findings by the retinologist. A subgroup analysis will be conducted for the identification of the presence or absence of DR (any DR), moderate NPDR, and above with or without macular signs to make recommendations for a referable criterion for the local context in DRS by physician graders.
Results
The physician graders have been trained, and currently, validation is being done in the Western province of Sri Lanka. The results of this study will be published in detail according to the Quality Assessment of Diagnostic Accuracy Study guidelines [26]. Data will be entered using a Microsoft Excel (2016) worksheet and transferred into STATA/IC-v14.2 analytical package following cleaning, consistency checks, and analysis. The sensitivity, specificity, and predictive values for each strategy and each level of DR will be presented using the same variables of 2 physician graders (nonmydriatic and mydriatic separately) compared with the reference standard, along with 95% CIs.
Discussion
The level of skills acquired by physician graders is an important factor in the screening outcome. Different non-ophthalmologist graders have successfully conducted DRS in some settings [27-29]. We will describe the diagnostic accuracy of the detection of DR by physician graders. In addition, we will be able to study the effect of a range of population characteristics on the validity of detecting DR using imaging and understand the role of non-ophthalmic personnel to make recommendations for a systematic DRSP. In addition, we will describe the referral criterion applicable to this local context based on the validation study results. Defining a referable level DR at a non-ophthalmological setting, in a context where there is no systematic DRS, will filter out those not needing a referral and therefore reduce the workload at an ophthalmologist’s clinic. The 7-field imaging strategy used in early treatment diabetic retinopathy study is considered as the gold standard in DRS [30]. However, this technique is practically not feasible in this context owing to resources constraints. Therefore, we proposed to use the locally accepted reference standard of retinologists’ examination as the suitable reference standard. Digital retinal imaging has previously shown diagnostic accuracy levels that would comply with the accepted standards of established national-level screening programs [15,22,31].
A few studies (conducted in HICs) have used non-ophthalmologist human resources in DRS, with which we could compare our results. In Singapore, a nonmydriatic fundus camera showed a sensitivity of 69.8% (95% CI 61.3%-77.2%) and a specificity of 94.4% (95% CI 92.3%-96.1%) for nonphysician graders using a single field [32]. A study in the United Kingdom on DRS by general practitioners using 35-mm color images showed that detecting any level of DR increased from 62.6% (95% CI 55.9%-69.4%) with direct ophthalmoscopy to 79.2% (95% CI 73.6%-84.9%) using retinal photographs, and specificity remained unchanged (direct ophthalmoscopy 75.0% [95% CI 69.5%-80.5%] vs 73.5% [95% CI 68.0%-79.1%]) [33]. They concluded that retinal photography by trained general practitioners in primary care settings could attain an acceptable level of detection of sight-threatening DR (87%) [33]. In Thailand, the use of single-field digital nonmydriatic imaging showed a sensitivity of 80% and a specificity of 96% in a sample of people with DM, where 54.7% people with DM were aged 41-60 years and 45.3% people with DM had diabetes since 1-5 years [34].
Another important consideration in this study would be the gradeability of images. The image gradeability will depend on the lens opacity, media opacity, pupil size, and reflectivity of the fundus. We envisaged poor gradeability in nonmydriatic imaging considering the high prevalence of cataract in this local setting. Furthermore, iris color, age, and other population characteristics may affect the quality of images [14]. Scanlon et al showed that in the >80-years age group, the technical failure rates reduced from 41.6% to 16.9% following mydriasis. This study concluded that the odds of having one eye ungradable increases by 2.6% (95% CI 1.6%-3.7%) for each extra year since the diagnosis of DM and major cause of ungradability was having central cataract (57%) [35]. We will describe the factors affecting gradeability of images in addition to the diagnostic test accuracy results.
In this study, we will demonstrate the diagnostic accuracy of physician graders compared with the retinologist to make recommendations for developing an integrated DRSP in LMICs where there is no systematic DRS. The outcome of this study will be useful for the implementation of a systematic DRSP in this region and similar communities.
AbbreviationsDM
diabetes mellitus
DR
diabetic retinopathy
DRS
diabetic retinopathy screening
DRSP
diabetic retinopathy screening program
HIC
high-income country
LMICs
low-income and middle-income countries
NPDR
nonproliferative diabetic retinopathy
Investigators thank the Association of Vitreo Retina Specialists of Sri Lanka for the logistical and operational support provided in conducting this study. We also have a research degree student project grant awarded to MMPNP from Queen Elizabeth Diamond Jubilee Trust, United Kingdom, coordinated through Commonwealth Eye Consortium, UK.
MMPNP conceived the project idea. MMPNP is coordinating and conducting this research project in the Western province as a fulfillment of a research degree. GVSM and JLYY supervised the student work. GVSM, CG, JLYY, TP, and DM made substantial contributions for the concept development, methodology, and study design. CF is the Principal Investigator of the project from collaborating institution and supervised the project work locally. AK will supervise the project-related work of DRS at the medical unit. MD and KB conducted the training of physician graders and KB will conduct the reference standard clinical examination of participants. MD and KB will involve in managing those study participants who require further investigations and treatment. LP and HD will conduct the validation of DRS intervention at present in the Western province.
None declared.
IDF2018-07-05International Diabetes Federation-Diabetes Atlas - 08th Edition - 2017
https://www.idf.org/e-library/epidemiology-research/diabetes-atlas.htmlShawJESicreeRAZimmetPZGlobal estimates of the prevalence of diabetes for 2010 and 203020100187141410.1016/j.diabres.2009.10.00719896746S0168-8227(09)00432-XWilliamsRAireyMBaxterHForresterJKennedy-MartinTGirachAEpidemiology of diabetic retinopathy and macular oedema: a systematic review20041018109638310.1038/sj.eye.6701476152326006701476Intensive blood-glucose control with sulphonylureas or insulin compared with conventional treatment and risk of complications in patients with type 2 diabetes (UKPDS 33). UK Prospective Diabetes Study (UKPDS) Group199809123529131837539742976S0140673698070196KleinRKnudtsonMDLeeKEGangnonRKleinBEKThe Wisconsin Epidemiologic Study of Diabetic Retinopathy: XXII the twenty-five-year progression of retinopathy in persons with type 1 diabetes2008111151118596810.1016/j.ophtha.2008.08.02319068374S0161-6420(08)00817-8PMC2761813The Diabetic Retinopathy Study Research GroupIndications for photocoagulation treatment of diabetic retinopathy: Diabetic Retinopathy Study Report no. 14.1987274239532447027GerhsKChongLGusmanGStreetDCan we educate primary care physicians about diabetic retinopathy after graduation? Preliminary results of the diabetic retinopathy education study1993345BamashmusMAGunaidAAKhandekarRRegular visits to a diabetes clinic were associated with lower magnitude of visual disability and diabetic retinopathy-a hospital-based historical cohort study in yemen2009111455010.1089/dia.2007.029919132855AdrionoGWangDOctavianusCCongdonNUse of eye care services among diabetic patients in urban Indonesia2011071297930510.1001/archophthalmol.2011.14721746983129/7/930BurgessPIMsukwaGBeareNA VDiabetic retinopathy in Sub-Saharan Africa: meeting the challenges of an epidemic2013111MueckeJSNewlandHSRyanPRamsayEAungMMyintSEsmail-ZadehRZborowskaBSelvaDAwareness of diabetic eye disease among general practitioners and diabetic patients in Yangon, Myanmar2008043632657310.1111/j.1442-9071.2008.01724.x18412597CEO1724JamesMTurnerDABroadbentDMVoraJHardingSPCost effectiveness analysis of screening for sight threatening diabetic eye disease20000617320725016273110856062PMC27406TranKMendelTAHolbrookKLYatesPAConstruction of an inexpensive, hand-held fundus camera through modification of a consumer “point-and-shoot” camera2012110953127600710.1167/iovs.12-1044923049089iovs.12-10449PMC3495602BanaeeTAnsari-AstanehMPourrezaHFaalHFVatanparastMShoeibiNUtility of 1% Tropicamide in Improving the Quality of Images for Tele-Screening of Diabetic Retinopathy in Patients with Dark Irides201724421721BaezaMOrozco-BeltránDGil-GuillenVFPedreraVRiberaMCPertusaSMerinoJScreening for sight threatening diabetic retinopathy using non-mydriatic retinal camera in a primary care setting: to dilate or not to dilate?200903633433810.1111/j.1742-1241.2008.01921.x19222628IJCP1921AptelFDenisPRouberolFThivoletCScreening of diabetic retinopathy: effect of field number and mydriasis on sensitivity and specificity of digital fundus photography200806343290310.1016/j.diabet.2007.12.00718406188S1262-3636(08)00053-0ScanlonPMalhotraRThomasGFoyCKirkpatrickJLewis-BarnedNHarneyBAldingtonS JThe effectiveness of screening for diabetic retinopathy by digital imaging photography and technician ophthalmoscopy2003062064677412786681954Lopez-BastidaJCabrera-LopezFSerrano-AguilarPSensitivity and specificity of digital retinal imaging for screening diabetic retinopathy200704244403710.1111/j.1464-5491.2007.02074.x17298591DME2074MaberleyDCruessAFBarileGSlakterJDigital photographic screening for diabetic retinopathy in the James Bay Cree200207931697812045884MurgatroydHEllingfordACoxABinnieMEllisJDMacEwenCJLeeseGPEffect of mydriasis and different field strategies on digital image screening of diabetic eye disease200407887920410.1136/bjo.2003.0263851520523888/7/920PMC1772219Al SabtiKhalidRaizadaSWaniVBAl AjmiMubarakGayedISugathanTNEfficacy and reliability of fundus digital camera as a screening tool for diabetic retinopathy in Kuwait20031742293312810247S1056872703000072HansenABHartvigNVJensenMSBorch-JohnsenKLund-AndersenHLarsenMDiabetic retinopathy screening using digital non-mydriatic fundus photography and automated image analysis2004128266667210.1111/j.1600-0420.2004.00350.x15606461AOS350UNDP20152018-07-05UNDP's role and leadership on achieving the MDGs in Sri Lanka
http://www.lk.undp.org/content/srilanka/en/home/post-2015/mdgoverview.htmlKatulandaPRathnapalaDSheriffRMatthewsDProvince and ethnic specific prevalence of diabetes among Sri Lankan adults20121127PiyasenaPMurthyGA situation analysis of diabetic eye care service delivery in health care institutions of the Western Province of Sri Lanka20176232056WhitingPFRutjesAWSWestwoodMEMallettSDeeksJJReitsmaJBLeeflangMMGSterneJACBossuytPMMQUADAS-2GQUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies2011101815585293610.7326/0003-4819-155-8-201110180-0000922007046155/8/529HenricssonMKarlssonCEkholmLKaikkonenPSellmanASteffertETyrbergMColour slides or digital photography in diabetes screening--a comparison200004782164810794249SundlingVGulbrandsenPStraandJSensitivity and specificity of Norwegian optometrists? evaluation of diabetic retinopathy in single-field retinal images - a cross-sectional experimental study20131317KuoHHsiehHLiuRScreening for diabetic retinopathy by one-field, non-mydriatic, 45 degrees digital photography is inadequate20052195292610.1159/0000861141612355686114Early Treatment Diabetic Retinopathy Study Research GroupGrading diabetic retinopathy from stereoscopic color fundus photographs--an extension of the modified Airlie House classification. ETDRS report number 10.199105985 Suppl7868062062513S0161-6420(13)38012-9PerrierMBoucherMCAngioiKGressetJAOlivierSComparison of two, three and four 45 degrees image fields obtained with the Topcon CRW6 nonmydriatic camera for screening for diabetic retinopathy2003123875697414740798S0008-4182(03)80110-2BhargavaMCheungCYSabanayagamCKawasakiRHarperCALamoureuxELChowWLEeAHamzahHHoMWongWWongTYAccuracy of diabetic retinopathy screening by trained non-physician graders using non-mydriatic fundus camera2012115311715923192497OwensDRGibbinsRLLewisPAWallSAllenJCMortonRScreening for diabetic retinopathy by general practitioners: ophthalmoscopy or retinal photography as 35 mm colour transparencies?199802152170510.1002/(SICI)1096-9136(199802)15:2<170::AID-DIA518>3.0.CO;2-H9507921RuamviboonsukPWongcumchangNSurawongsinPPanyawatananukulETiensuwanMScreening for diabetic retinopathy in rural area using single-field, digital fundus images2005028821768015962667ScanlonPHFoyCMalhotraRAldingtonSJThe influence of age, duration of diabetes, cataract, and pupil size on image quality in digital photographic retinal screening20051028102448531618627828/10/2448