Objective
To establish the relative risk of progressive visual field loss in a sample of glaucomatous eyes enrolled in a prospective longitudinal study vs a matched sample of eyes not enrolled in a study.
Methods
The first visual field records of 66 glaucomatous eyes enrolled in a prospective longitudinal study (mean follow-up time, 3.4 years; mean number of visual field tests, 8.3) were matched to 66 eyes from patients not enrolled in a study (mean follow-up time, 3 years; mean number of visual field tests, 3.7). Eyes were matched on the basis of (1) time of enrollment, (2) length of follow-up, and (3) the extent and spatial pattern of visual field loss. Linear regression of global visual field indexes was used to measure change and the relative risk of progression was calculated for a series of progression criteria sample.
Results
The relative risk of progressive visual field loss was on average 368% (range, 209%-673%) higher in the eyes not enrolled in a prospective longitudinal study.
Conclusion
Selection bias may reduce the risk of progressive visual field loss in patients enrolled in longitudinal studies.
There have been a number of prospective longitudinal studies involving patients with glaucoma that have reported on the proportion of eyes showing progressive visual field loss.1-12 The majority report incidence rates of between 2.5% and 7.5% per year in treated eyes, although this figure is sensitive to a number of factors, including the definition of progression.4 This relatively low incidence rate has led some researchers to suggest that there may be some biases in prospective longitudinal studies that act to reduce the proportion of patients with progressive loss.
The reported incidence rate of progression in retrospective studies is often larger than that of prospective studies.13-15 Again, this suggests that the recruitment into prospective longitudinal studies might in some way be biased toward those patients less likely to show progression or in some way create an atmosphere where progression becomes less likely. To our knowledge, the existence of a selection bias has not been systematically investigated or quantified.
This article compares a sample of eyes from patients enrolled in a prospective longitudinal glaucoma study with a matched sample of eyes from patients not enrolled in a study, to quantify the extent of any selection bias. Eyes in both samples were treated by the same health care professionals.
Data for this study were retrospectively collected from 66 eyes of 66 patients enrolled in a prospective longitudinal study investigating the role of optic nerve head and nerve fiber layer imaging in the management of glaucoma16 and from a matched sample of patients attending the outpatient department of Manchester Royal Eye Hospital (MREH). Ethical approval was obtained from the Central Manchester Research Ethics Committee and the study followed the principles of the Declaration of Helsinki.
Longitudinal regression analyses of 2 global indexes were used to measure progression. The first index, mean defect, gives a measure of the depth of loss. This index was generated by the Peridata software package (Peridata Software GmbH, Hürth, Germany) and is slightly different from the index mean deviation generated by the Humphrey Visual Field Analyzer (Carl Zeiss Meditec Inc, Dublin, Calif). We chose to use the Peridata mean defect because (1) both mean defect and mean deviation give good measures of overall sensitivity loss17 and (2) the Humphrey Visual Field Analyzer does not export mean deviation values or provide the means to calculate these values from the exported data. The second index, number of test locations with pattern deviation probability less than 0.05, gives a measure of the spatial extent of loss. This index was generated from custom software.16 All visual field data were collected with the SITA (31%) or full-threshold (69%) programs of the Humphrey Visual Field Analyzer. Both programs give similar threshold values.18 All patients were required to have prior experience of threshold perimetry at MREH to ensure that the data were less dependent on learning effects.19 Data on the length of time that patients were aware that they had glaucoma were not collected. Patients were not included or excluded on the basis of reliability indexes because we did not wish to bias the samples in favor of those who give reliable results. The study eyes were initially selected from patients attending the outpatient clinics of MREH (ie, both samples were selected from the same population of National Health Service patients). All eyes had a clinical diagnosis of open-angle glaucoma based on the appearance of the optic nerve head and visual field loss. The longitudinal study sample was selected to give a wide range of functional loss, extending from early defects to advanced loss. Patients in the longitudinal study attended every 6 months for a period of 3.5 years. At each visit, visual field and imaging (Heidelberg Retinal Tomograph [Heidelberg Engineering, Heidelberg, Germany] and Nerve Fiber Analyzer [Laser Diagnostic Technologies Inc, San Diego, Calif]) data were collected.
The matching of the nonstudy eyes to the study eyes involved several stages: (1) they were matched on the basis of both the period of follow-up (within 150 days) and time of follow-up (first record in the same year); (2) they were matched on the basis of the mean defect (± 3 dB) and pattern standard deviation (± 3 dB) of the first visual field record; and (3) they were matched on the basis of the pattern of visual field loss. Matching on the basis of the pattern of visual field loss was done by 3 health care professionals who viewed the first visual field record of each study eye and the first visual field record of 5 nonstudy eyes, which matched on criteria 1 and 2. The 3 health care professionals were asked to rank the nonstudy eyes according to the closeness of the spatial match to the study eye. A simple scoring system was then used to select the best spatial match. All patients were older than 38 years at the time of the first included visual field record.
All patients, study and nonstudy, were treated by the same health care professionals within the outpatient department of MREH. The imaging data from the study patients were not made available to the health care professionals treating the patients, and no patients underwent any ophthalmic surgical procedure during the follow-up period.
Figure 1 and Figure 2 show that there is good agreement between the study and nonstudy eyes for the indexes mean defect and pattern standard deviation from the first included visual field test record.
Figure 3 and Figure 4 compare the rates of change for each matched pair of eyes. In Figure 3, far more nonstudy eyes show a more rapid rate of deterioration in the global index mean defect (fall below the diagonal line) than do study eyes. In Figure 4, far more nonstudy eyes show a higher rate of increase in the number of damaged test locations (fall above the diagonal line) than do study eyes.
There are 2 important differences between the data collected from the study and nonstudy eyes. First, the mean number of visual field tests during the follow-up period was larger for patients enrolled in the study than those not enrolled (8.3 vs 3.7). Second, the visual field test results of the study patients were collected by postgraduate researchers working within the Clinical Research Facility rather than visual field technicians working within the more pressured environment of the MREH outpatient department. These 2 differences led to a broader distribution of gradients within the nonstudy sample. When eyes are classified as progressing on the basis of the gradient of the best-fitting line being more negative than a given negative cutoff value, the width of the distribution becomes an important parameter. As the distribution gets wider, for example because of more variability, more eyes will exceed the cutoff value. To overcome this problem, rather than simply look at the number of eyes with gradients lower than the given negative cutoff value, we looked at the ratio of eyes with gradients lower than this value to those with a gradient higher than the reverse gradient (ie, apparent improvers). This ratio will be independent of the distribution width, providing the values are symmetrically distributed (Table). As can be seen from the Table, this ratio is much greater, for all cutoff values, in the nonstudy eyes. The relative risk of progressive loss in nonstudy vs study eyes is calculated by dividing the ratio of deteriorating to improving nonstudy eyes by the same ratio for study eyes.
The relative risk is dependent on the cutoff gradient. As the cutoff gradient is reduced, an increasing number of eyes will be classified as progressing/deteriorating and any differences between the 2 samples will gradually reduce. Choosing a very steep cutoff will, however, reduce the number of progressing eyes and make the ratio more sensitive to single events. Choosing a cutoff where there is a reasonable number of apparent improvers in both samples (4< × <9; 0.60-0.45 dB/y; 1.8-1.3 defects/y) gives average relative risk values of 4.35 for the depth index and 3.27 for the size index.
For some time, a number of researchers have recognized that progressive visual field loss in patients enrolled in prospective longitudinal glaucoma studies is a relatively rare event when compared with data collected in routine clinics. This article presents data that, for the first time, to our knowledge, quantify this effect.
There are 2 likely causes for the differences between the study and nonstudy patients. The first is selection bias. Patients willing to enroll in longitudinal studies are generally more concerned about their condition and are likely to be more attentive, demanding, and compliant with their therapy. Recent reports have shown that compliance/persistence with hypotensive medical therapy is a major problem in glaucoma, with some patients omitting a significant number of doses.20,21 Chen22 has shown that those patients who miss lots of visits or refuse surgery (ie, less compliant) tend to do worse, while the results from the Early Manifest Glaucoma Trial1 have demonstrated that lower intraocular pressure is protective and that noncompliance is likely to result in higher rates of progression.
The second likely cause of the differences in number of eyes showing progressive loss is different management. While patients enrolled in the longitudinal study were clinically treated outside of the study, in the same way and by the same staff as the nonstudy patients, there were a number of differences in treatment that may have led to some bias. Study patients were required to attend every 6 months (ie, more frequently than the nonstudy patients), and visual field data collected at these visits were made available to the treating health care professional. Treating health care professionals were aware of the patient being involved in this study, and any sudden changes in the patient's condition detected at the study visits would have initiated a prompt review by the treating health care professional. Finally, study patients were, as part of the study, asked if they were experiencing any problems with their medication. Any problems, such as getting repeat prescriptions or insertion of the drops, would have been acted on.
The proportion of progressing eyes within the study sample ranged from 2.6% to 8.5% per year for the selected range of cutoff values. These figures agree with those reported in other trials. Katz et al,4 when investigating the effect of different definitions of change, reported rates of between 1.75% and 3.65% per year, while Heijl et al1 reported a rate of 7.5% per year for the treated arm and 10.33% per year for the untreated arm of the Early Manifest Glaucoma Trial. Further study and identification of the differences between the 2 groups could highlight specific risk factors for visual field progression and enable a minimization of visual field loss.
This study has a number of implications for future longitudinal studies. The first is that when estimating sample sizes for studies that seek to investigate changes in the visual field, allowance should be made for the relatively low occurrence of progressive loss in patients who agree to participate. Second, when generalizing from the results of prospective longitudinal studies, account needs to be taken of the likely disparities between study and nonstudy patients.
Correspondence: David B. Henson, PhD, University of Manchester, Manchester Royal Eye Hospital, Oxford Road, Manchester SK6 6PD, England (david.henson@manchester.ac.uk).
Submitted for Publication: November 29, 2005; final revision received June 7, 2006; accepted June 17, 2006.
Author Contributions: Dr Henson had full access to all the data in the study and takes responsibility for the integrity of the data and the accuracy of the data analysis.
Financial Disclosure: None reported.
1.Heijl
ALeske
MCBengtsson
BHyman
LBengtsson
BHussein
MEarly Manifest Glaucoma Trial Group, Reduction of intraocular pressure and glaucoma progression: results from the Early Manifest Glaucoma Trial.
Arch Ophthalmol 2002;1201268- 1279
PubMedGoogle ScholarCrossref 2.Lichter
PRMusch
DCGillespie
BW
et al. CIGTS Study Group, Interim clinical outcomes in the Collaborative Initial Glaucoma Treatment Study comparing initial treatment randomized to medications or surgery.
Ophthalmology 2001;1081943- 1953
PubMedGoogle ScholarCrossref 3.Martus
PStroux
ABudde
WMMardin
CYKorth
MJonas
JB Predictive factors for progressive optic nerve damage in various types of chronic open-angle glaucoma.
Am J Ophthalmol 2005;139999- 1009
PubMedGoogle ScholarCrossref 4.Katz
JCongdon
NFriedman
DS Methodological variations in estimating apparent progressive visual field loss in clinical trials of glaucoma treatment.
Arch Ophthalmol 1999;1171137- 1142
PubMedGoogle ScholarCrossref 5.Nouri-Mahdavi
KCaprioli
JColeman
ALHoffman
DGaasterland
D Pointwise linear regression for evaluation of visual field outcomes and comparison with the advanced glaucoma intervention study methods.
Arch Ophthalmol 2005;123193- 199
PubMedGoogle ScholarCrossref 6.Boden
CBlumenthal
EZPascual
J
et al. Patterns of glaucomatous visual field progression identified by three progression criteria.
Am J Ophthalmol 2004;1381029- 1036
PubMedGoogle ScholarCrossref 7.Jonas
JBMartus
PHorn
FKJunemann
AKorth
MBudde
WM Predictive factors of the optic nerve head for development or progression of glaucomatous visual field loss.
Invest Ophthalmol Vis Sci 2004;452613- 2618
Google ScholarCrossref 8.Nicolela
MTMcCormick
TADrance
SMFerrier
SNLeBlanc
RPChauhan
BC Visual field and optic disc progression in patients with different types of optic disc damage—a longitudinal prospective study.
Ophthalmology 2003;1102178- 2184
PubMedGoogle ScholarCrossref 9.Chauhan
BCMcCormick
TANicolela
MTLeBlanc
RP Optic disc and visual field changes in a prospective longitudinal study of patients with glaucoma—comparison of scanning laser tomography with conventional perimetry and optic disc photography.
Arch Ophthalmol 2001;1191492- 1499
PubMedGoogle ScholarCrossref 10.The AGIS Investigators, The Advanced Glaucoma Intervention Study (AGIS), 4: comparison of treatment outcomes within race.
Ophthalmology 1998;1051146- 1164
PubMedGoogle ScholarCrossref 11. The Glaucoma Laser Trial (GLT) and glaucoma laser trial follow-up-study, 7: results. Glaucoma Laser Trial Research Group.
Am J Ophthalmol 1995;120718- 731
PubMedGoogle Scholar 12.Collaborative Normal-Tension Glaucoma Study Group, The effectiveness of intraocular pressure reduction in the treatment of normal-tension glaucoma.
Am J Ophthalmol 1998;126498- 505
PubMedGoogle ScholarCrossref 13.Susanna
RVessani
RMSakata
LZacarias
LCHatanaka
M The relation between intraocular pressure peak in the water drinking test and visual field progression in glaucoma.
Br J Ophthalmol 2005;891298- 1301
PubMedGoogle ScholarCrossref 14.Spry
PGDSparrow
JMDiamond
JPHarris
HS Risk factors for progressive visual field loss in primary open angle glaucoma.
Eye 2005;19643- 651
PubMedGoogle ScholarCrossref 15.Kwon
YHKim
CSZimmerman
EAlward
WLHayreh
SS Rate of visual field loss and long-term visual outcome in primary open-angle glaucoma.
Am J Ophthalmol 2001;13247- 56
PubMedGoogle ScholarCrossref 16.Kwartz
AJHenson
DBHarper
RASpencer
AFMcLeod
D The effectiveness of the Heidelberg Retinal Tomograph and laser diagnostic glaucoma scanning system (GDx) in detecting and monitoring glaucoma.
Health Technol Assess 2005;
(9)
46
http://www.ncchta.org/index.htmAccessed August 11, 2006
Google Scholar 17.Anderson
DRPatella
VM Automated Static Perimetry. 2nd St Louis, Mo Mosby Inc1999;
18.Artes
PHIwase
AOhno
YKitazawa
YChauhan
BC Properties of perimetric threshold estimates from full threshold, SITA standard, and SITA fast strategies.
Invest Ophthalmol Vis Sci 2002;432654- 2659
PubMedGoogle Scholar 19.Wood
JMWild
JMHussey
MKCrews
SJ Serial examination of the normal visual field using Octopus automated projection perimetry evidence for a learning effect.
Acta Ophthalmol (Copenh) 1987;65326- 333
PubMedGoogle ScholarCrossref 20.Reardon
GSchwartz
GFMozaffari
E Patient persistency with topical ocular hypotensive therapy in a managed care population.
Am J Ophthalmol 2004;137S3- S12
PubMedGoogle ScholarCrossref