Receiver operating characteristic (ROC) curves for the mean tortuosity of the 3 most tortuous vessels (area under the ROC curve = 0.818) (A) and the mean width of the 3 widest vessels (area under the ROC curve = 0.723) (B) in preplus retinopathy of prematurity eyes that regress spontaneously vs progress to treatment.
Ghodasra DH, Karp KA, Ying G, Mills MD, Wilson C, Fielder AR, Ng J, Quinn GE. Risk Stratification of Preplus Retinopathy of Prematurity by Semiautomated Analysis of Digital Images. Arch Ophthalmol. 2010;128(6):719-723. doi:10.1001/archophthalmol.2010.91
To determine whether quantitative analysis of retinal vessel width and tortuosity from digital images discriminates which eyes with preplus retinopathy of prematurity (ROP) progress to treatment severity.
Posterior pole images of eyes at first clinical diagnosis of preplus ROP were obtained using a 30°-field, noncontact fundus camera. Width and tortuosity of retinal vessels were analyzed from digital images using computer-assisted image analysis software. Mean width and tortuosity of venules and arterioles were compared in 19 preplus eyes that regressed spontaneously and 11 preplus eyes that progressed to treatment severity. Receiver operating characteristic curve analysis was performed to assess whether width and tortuosity discriminated between groups.
Mean widths of venules alone, arterioles alone, and the 3 widest vessels were higher in preplus progressed eyes (P < .04). Mean tortuosity of the 3 most tortuous vessels was higher in preplus progressed than in preplus regressed eyes (P = .01). Most vessel width and tortuosity variables predicted which eyes with preplus progressed to treatment moderately well, with an area under the receiver operating characteristic curve of 0.72 to 0.82.
Digital image analysis of retinal vessel width and tortuosity may be useful in predicting which preplus ROP eyes will require treatment. Because vascular abnormalities are a continuum and clinical diagnosis is subjective, quantitative analysis may improve risk stratification for ROP.
Retinopathy of prematurity (ROP) is a disorder of abnormal development of retinal vessels in premature low-birth-weight babies. Abnormal dilatation and tortuosity of posterior pole retinal vessels, or plus disease, is a primary driver in the decision to treat ROP.1 Carefully timed ablation of the peripheral retina is necessary to decrease the likelihood of retinal detachment and blindness.2- 4
The diagnosis of plus disease, however, is subjective given that it is based on comparison with a “reference” photograph from more than 20 years ago and relies on the individual physician's overall interpretation.5 Interexpert agreement regarding the diagnosis of plus disease is poor.6,7 Reflecting the fact that vascular changes in ROP are on a continuum, Wallace et al8 determined that early vascular dilatation and tortuosity insufficient for plus disease had prognostic significance for ROP. They proposed that such “mild” dilatation and tortuosity, or “preplus” vascular changes, may have clinical and research relevance. In “The International Classification of Retinopathy of Prematurity Revisited,”5 preplus ROP was defined as vascular abnormalities insufficient for the diagnosis of plus disease but that present with more arterial tortuosity and more venous dilatation than expected in the normal preterm eye.
The diagnosis of this intermediate state of vascular abnormalities in ROP also remains subjective. Similar to plus disease, the diagnosis of preplus ROP shows interobserver variability among pediatric ophthalmologists in the judgment of presence or absence of disease from cropped clinical photographs of premature retinas.7 For this reason, the development of a quantitative method for grading vascular changes in ROP may be helpful. One such approach, computer-assisted analysis of digital images obtained from infants at risk for ROP, has achieved promising results.9- 17 Computer-Assisted Image Analysis of the Retina is a recently described technique that semiautomatically detects retinal vessels and measures dilatation and tortuosity from digital images of the posterior pole.15 Herein, we report on the ability of computer-assis ted digital image analysis of retinal vessel width and tortuosity to discriminate which eyes having an initial diagnosis of preplus ROP will progress to treatment severity.
A database of digital images was established as part of a larger longitudinal project examining digital fundus photography in neonates at risk for ROP at the neonatal intensive care units of the Children's Hospital of Philadelphia and the Hospital of the University of Pennsylvania, Philadelphia. Institutional review board approval was obtained from both hospitals, and the parents of all study participants provided informed consent. Eyes were dilated using a combination of tropicamide, 1%, and phenylephrine, 2.5%, and the posterior poles were imaged using a 30°-field, noncontact fundus camera (NM-200D; Nidek Inc, Aichi, Japan). After image acquisition, each infant underwent dilated fundus examination using indirect ophthalmoscopy by an expert pediatric ophthalmologist (M.D.M. or G.E.Q.). Infants were followed up clinically until the eye was treated with panretinal photocoagulation or showed regression of ROP.
The database was reviewed for infants who were diagnosed as having preplus ROP on clinical examination between March 1, 2005, and August 31, 2008. Infants with zone 1 (the center of which is the optic nerve) ROP and infants whose preplus eye was treated before type 1 ROP severity were excluded from this study.1 An image from the date of earliest diagnosis of preplus ROP was selected for each participant. The single highest-quality image from the right eye was chosen. In cases of asymmetrical ROP, the left eye was chosen only if the right eye never received a diagnosis of preplus disease. Digital image quality was assessed on the following variables: (1) centering of the optic disc, (2) contrast between retina and vessels (focus), and (3) image brightness. For perspective, images from 2 other groups of infants were selected: (1) eyes that never developed ROP and (2) eyes that received a diagnosis of plus ROP without previous diagnosis of preplus ROP. Images from eyes without ROP were postmenstrual age matched to the average postmenstrual age of patients at the earliest diagnosis of preplus ROP. The research nurse (K.A.K.) who selected images was not involved in image analysis.
Computer-Assisted Image Analysis of the Retina is a semiautomated digital image vessel analysis package developed by Owen et al18 and clinically validated in RetCam (Clarity Medical Systems, Pleasanton, California) images by Wilson et al.15 The grader (D.H.G.) defined the center of the optic disc on each image. The optic disc and the peripapillary areas were automatically excluded from analysis. Each image was analyzed out to 350 pixels from the center of the optic disc or approximately 1.5 disc diameters. Computer-Assisted Image Analysis of the Retina automatically detected retinal vessels, after which the grader removed choroidal and other minor vessels that may have been incorrectly selected. For each vessel, vessel width is measured in pixels and vessel tortuosity is measured in arbitrary units, as described by Wilson et al.15 The version of Computer-Assisted Image Analysis of the Retina used in this analysis was the “updated width-measurement” version used by Owen et al.18 The grader was masked to patient identity and ROP outcome. An ophthalmologist experienced in ROP (G.E.Q.) was masked to patient identity and ROP outcome and designated whether each vessel analyzed was an arteriole or a venule.
Vessel variables (width and tortuosity) were examined in several ways to present an exploratory descriptive analysis of vessel changes in preplus ROP that progresses vs regresses. First, mean width and tortuosity based on all vessels were calculated for each eye. Second, to determine whether overall vessel changes depended on vessel type or on the most abnormal vessels only, 2 subanalyses were conducted. Vessel type subanalysis involved the calculation of mean width and tortuosity for arterioles alone and venules alone for each eye. Another subanalysis identifying the most abnormal eye involved calculation of the mean width of the 3 widest vessels from all analyzable vessels and the mean tortuosity of the 3 most tortuous vessels from all analyzable vessels from each eye. Each vessel variable was compared between preplus ROP eyes that regressed spontaneously and preplus ROP eyes that progressed to treatment using 2-sample t tests. Owing to the exploratory nature of the analysis, multiplicity adjustments on P values were not made, and all comparisons performed were presented.
For perspective on the clinical diagnosis of preplus, mean width, mean tortuosity, and the proportion of each vessel type (arteriole and venule) composing the 3 widest and the 3 most tortuous vessels were compared with 2 other groups: (1) eyes that never developed ROP and (2) eyes that developed plus ROP without an initial diagnosis of preplus. In addition, nonparametric receiver operating characteristic (ROC) curve analysis was performed to assess whether vessel width and tortuosity could discriminate between preplus eyes that regressed and preplus eyes that progressed. Comparison of means and proportions was performed using SAS version 9.1 (SAS Institute Inc, Cary, North Carolina), and calculations of the area under the ROC curve and its 95% confidence interval were performed using STATA version 10.0 (StataCorp LP, College Station, Texas).
Of the 142 infants in the larger longitudinal project, 39 had a clinical diagnosis of preplus ROP. Two infants with preplus ROP were excluded because there were no images for the day of initial diagnosis of preplus ROP. Five infants were excluded because they received early treatment before regressing spontaneously or reaching commonly accepted treatment severity. Two infants were excluded because they had zone 1 ROP. Thus, there were 30 eligible infants who had a clinical diagnosis of preplus ROP in zone 2 (a doughnut-shaped area surrounding zone 1) in 1 or both eyes. Images from 30 eyes of 30 infants (28 right eyes and 2 left eyes) were selected for analysis. Of the 30 eyes with preplus ROP, 19 regressed spontaneously and 11 progressed to treatment. The mean (SE) interval between the initial diagnosis of preplus and treatment was 7.91 (1.28) days. Mean gestational age, birth weight, sex, race, postmenstrual age, and weight when preplus was first diagnosed were not significantly different between groups.
Vessel type subanalysis is given in Table 1. The mean widths of venules alone and arterioles alone were significantly higher in the sample of eyes in which preplus progressed than in eyes in which preplus regressed (P = .02 and P = .04, respectively). The subanalysis of the most ab normal vessels is also given in Table 1. The mean width of the 3 widest vessels from all vessels identified by the program was also significantly greater for preplus progressed eyes than for preplus regressed eyes (P = .03). Mean tortuosity of all vessels, arterioles alone, and venules alone was higher, but not significantly different (P > .05), in eyes with preplus that progressed than in eyes with preplus that regressed. However, the mean tortuosity of the 3 most tortuous vessels from all vessels identified by the program was significantly greater for preplus progressed eyes than for preplus regressed eyes (P = .01).
Arterioles were a higher proportion of the 3 most tortuous vessels in the preplus progressed group vs the preplus regressed group (76% vs 48%, P = .01) (Table 2). In the preplus regressed and preplus progressed groups, veins were a higher proportion of the 3 widest vessels (84% and 85%, respectively).
For perspective, 8 eyes from 8 infants who never developed ROP and 13 eyes from 13 infants who developed plus ROP without initial diagnosis of preplus were analyzed. For eyes without ROP, the mean (SE) width of the 3 widest vessels was 5.61 (0.28) and the mean (SE) tortuosity of the 3 most tortuous vessels was 21.03 (1.03). For eyes with plus ROP, the mean (SE) width of the 3 widest vessels was 7.62 (0.22) and the mean (SE) tortuosity of the 3 most tortuous vessels was 78.53 (14.12). In addition, eyes without ROP had a similar proportion of arteries as the 3 most tortuous vessels as did preplus eyes that regressed spontaneously (54% vs 48%, P = .63). Plus ROP eyes had a similar proportion of arteries as the 3 most tortuous vessels as did preplus eyes that progressed to treatment (74% vs 76%, P = .89). In all 4 groups, veins were a higher proportion of the 3 widest vessels (79%-90%).
We created ROC curve plots of the mean width and tortuosity of all vessels, arterioles alone, venules alone, the 3 most tortuous vessels, and the 3 widest vessels. Table 3 summarizes the area under the ROC curve and its 95% confidence interval for each vessel variable. The area under the ROC curve was greater than 0.72 for most vessel variables, suggesting moderately good prediction of preplus progression. The mean width of the 3 widest vessels and the mean tortuosity of the 3 most tortuous vessels had areas under the ROC curve of 0.72 and 0.82, respectively (Figure).
The abnormal dilatation and tortuosity of retinal vessels in eyes with acute-phase ROP, or plus disease, is a valuable indicator of the severity of ROP. Plus disease is graded as present or absent. The binary nature of the diagnosis does not allow for inclusion of the important information that could be obtained from examining the spectrum of possible vascular changes in the developing retina. The utility of an intermediate diagnosis, such as preplus disease, has been incompletely studied. Wallace et al8 showed that early vascular dilatation and tortuosity not meeting the criteria for plus disease had prognostic significance in the early course of ROP. Despite introduction of the term and its progressive incorporation into diagnostic vernacular, the diagnosis of preplus ROP is a subjective determination of the physician, and agreement among pediatric ophthalmologists regarding the diagnosis of preplus and plus disease is poor.6,7 Consequently, the Cryotherapy for Retinopathy of Prematurity Study19 recommended the development of a quantitative way to grade vascular abnormalities of the posterior pole.
Advances in practical digital cameras for acquiring retinal images of at-risk infants and computer-assisted analysis of images may allow the application of quantitative analysis in ROP. Several studies9- 17 have examined the validity, reliability, and feasibility of digital image analysis in detecting plus disease in ROP. Heneghan et al11 and Wallace et al12,16,17 established sensitive and specific thresholds for plus disease in ROP using semiautomated vessel analysis systems. To our knowledge, however, no studies have applied computer-assisted retinal analysis to examine the progression of preplus ROP. The objective of this study was to evaluate whether computer-assisted digital image analysis of retinal vessels is useful in predicting which eyes with preplus will progress to plus ROP requiring treatment.
These results indicate that computer-assisted analysis of retinal vessel width and tortuosity discriminates groups of eyes with an initial diagnosis of preplus ROP that will progress to treatment severity. As a group, preplus eyes that progress to treatment have greater width and tortuosity of retinal vessels than do preplus eyes that regress. Mirroring accepted clinical observations, quantitative measurements of venular width and arteriolar tortuosity were higher for more severe disease.
Most abnormal vessel subanalysis showed that the most dilated vessels and the most tortuous vessels were best able to highlight differences between the 2 groups of eyes. The selection of vessels for analysis by the operator is one of the most variable aspects of semiautomated analysis. Wallace et al12,16,17 explained how ROPtool was unable to choose consistently the most important vessels for each quadrant without operator input. Because it is debatable whether the smallest vessels on an image are actually choroidal vessels, comparing only the most abnormal vessels from all vessels identified by the program may improve the accuracy and reliability of retinal vessel measurements. Even without this adjustment, vessel width, but not tortuosity, was significantly different between groups. The decision to average the 3 most abnormal vessels vs selecting a different number of vessels to average is arbitrary and is based on our impression that in most cases, at least 3 vessels can be clearly identified as retinal vessels. A quadrant-based subanalysis is not presented because such labeling requires extensive grader input, introducing a greater possibility of selection bias. In addition, such input may not be practical for eventual clinical implementation of an automated image analysis system. Nevertheless, as software algorithms and vessel detection systems improve, we expect that other subanalyses, such as tortuosity of arterioles alone, may aid in the evaluation of which eyes with preplus disease are at risk for vision-threatening ROP.
In addition to width and tortuosity, the present results indicate that the distribution of vessel type that composes the most tortuous vessels may help with risk stratification. The proportion of arteries composing the 3 most tortuous vessels of preplus regressed eyes was similar to that of eyes that never developed ROP. Both groups had approximately the same percentage of arterioles as the 3 most tortuous vessels. The vessel type distribution of preplus progressed eyes was similar to that of eyes having an initial diagnosis of plus disease. In these 3 groups, arterioles were approximately three-quarters of the 3 most tortuous vessels. In other words, as preplus progressed, arterioles became more tortuous than venules. For all 4 groups, venules were most of the 3 widest vessels. These quantitative findings validate clinical observations regarding the development and progression of plus disease.
In this small study, quantitative analysis identified group differences in width and tortuosity between eyes with preplus ROP that regressed spontaneously and eyes with preplus ROP that progressed to treatment. The areas under the ROC curve, however, were not high. Thus, these data cannot be used at this juncture to predict the development of vision-threatening ROP in individual infants with high sensitivity and specificity. Owing to the possible disastrous visual consequences of untreated ROP, high sensitivity in the detection of severe ROP is arguably more important than is high specificity. Accordingly, computer-assisted analysis of digital images may be informative when used in concert with subjective clinical evaluation rather than when used for stand-alone screening. Quantitative criteria for preplus and plus ROP could be used as an adjunct to the current gold standard of clinical evaluation to reduce the number of unnecessary examinations in low-risk infants. Finally, software algorithms and digital imaging modalities are undergoing rapid advancements. Although this makes it difficult to compare results between published data, one can also be assured that quantitative analysis of ROP will only improve with updated iterations of digital cameras and image analysis software.
The subjective nature of the diagnosis of preplus and plus disease is a significant obstacle in the evaluation of ROP. Computer-assisted analysis of vascular changes in ROP has several potential advantages. In addition to increased reliability and accuracy, digital imaging analysis may be useful in telemedicine approaches to ROP screening. An objective classification system could be more easily applied to clinical research than is the subjective gold standard. Ultimately, quantitative analysis of vascular changes in ROP may improve the timely assessment and treatment of ROP and reduce lifelong consequences that may result from sight-threatening disease.
Correspondence: Graham E. Quinn, MD, MSCE, Division of Ophthalmology, Children's Hospital of Philadelphia, Main Bldg, Room 9NW27, 34th Street and Civic Center Boulevard, Philadelphia, PA 19104-4399.
Submitted for Publication: June 1, 2009; final revision received October 30, 2009; accepted November 5, 2009.
Author Contributions: Dr Quinn had full access to all the data in the study and takes responsibility for the integrity of the data and the accuracy of the data analysis as well as the decision to submit for publication.
Financial Disclosure: None reported.
Funding/Support: This study was supported by the Doris Duke Charitable Foundation (Mr Ghodasra), the Paul and Evanina Bell Mackall Foundation Trust (Dr Ying), the Mabel E. Leslie Endowed Chair (Dr Mills), and Action Medical Research (Ms Wilson).
Role of the Sponsor: The funders had no role in the design and conduct of the study; in the collection, analysis, and interpretation of the data; or in the preparation, review, or approval of the manuscript.
Additional Contributions: This study was performed under a larger study examining digital imaging analysis software from the institutional review board at the Children's Hospital of Philadelphia Protocol 4000.