AF indicates atrial fibrillation; ICD-9-CM, International Classification of Diseases, Ninth Revision, Clinical Modification. The severe sepsis primary analysis group is a subset of the severe sepsis secondary analysis group defined by infection and organ dysfunction.
Customize your JAMA Network experience by selecting one or more topics from the list below.
Walkey AJ, Wiener RS, Ghobrial JM, Curtis LH, Benjamin EJ. Incident Stroke and Mortality Associated With New-Onset Atrial Fibrillation in Patients Hospitalized With Severe Sepsis. JAMA. 2011;306(20):2248–2254. doi:10.1001/jama.2011.1615
Author Affiliations: The Pulmonary Center, Division of Pulmonary and Critical Care Medicine (Drs Walkey and Wiener), Department of Medicine (Drs Walkey, Wiener, and Benjamin), and Cardiology and Preventive Medicine, Whitaker Cardiovascular Institute (Dr Benjamin), Boston University School of Medicine, and Epidemiology Department, Boston University School of Public Health (Dr Benjamin), Boston, Massachusetts; Center for Health Quality, Outcomes, and Economic Research, Edith Nourse Rogers Memorial VA Hospital, Bedford, Massachusetts (Dr Wiener); Dartmouth Institute for Health Policy and Clinical Practice, Dartmouth Medical School, Hanover, New Hampshire (Dr Wiener); Department of Medicine, Division of Cardiology, University of Washington School of Medicine, Seattle (Dr Ghobrial); Duke Clinical Research Institute and Department of Medicine, Duke University School of Medicine, Durham, North Carolina (Dr Curtis); and National Heart, Lung, and Blood Institute's and Boston University's Framingham Heart Study, Framingham, Massachusetts (Dr Benjamin).
Context New-onset atrial fibrillation (AF) has been reported in 6% to 20% of patients with severe sepsis. Chronic AF is a known risk factor for stroke and death, but the clinical significance of new-onset AF in the setting of severe sepsis is uncertain.
Objective To determine the in-hospital stroke and in-hospital mortality risks associated with new-onset AF in patients with severe sepsis.
Design and Setting Retrospective population-based cohort of California State Inpatient Database administrative claims data from nonfederal acute care hospitals for January 1 through December 31, 2007.
Patients Data were available for 3 144 787 hospitalized adults. Severe sepsis (n = 49 082 [1.56%]) was defined by validated International Classification of Diseases, Ninth Revision, Clinical Modification (ICD-9-CM) code 995.92. New-onset AF was defined as AF that occurred during the hospital stay, after excluding AF cases present at admission.
Main Outcome Measures A priori outcome measures were in-hospital ischemic stroke (ICD-9-CM codes 433, 434, or 436) and mortality.
Results Patients with severe sepsis were a mean age of 69 (SD, 16) years and 48% were women. New-onset AF occurred in 5.9% of patients with severe sepsis vs 0.65% of patients without severe sepsis (multivariable-adjusted odds ratio [OR], 6.82; 95% CI, 6.54-7.11; P < .001). Severe sepsis was present in 14% of all new-onset AF in hospitalized adults. Compared with severe sepsis patients without new-onset AF, patients with new-onset AF during severe sepsis had greater risks of in-hospital stroke (75/2896 [2.6%] vs 306/46 186 [0.6%] strokes; adjusted OR, 2.70; 95% CI, 2.05-3.57; P < .001) and in-hospital mortality (1629 [56%] vs 18 027 [39%] deaths; adjusted relative risk, 1.07; 95% CI, 1.04-1.11; P < .001). Findings were robust across 2 definitions of severe sepsis, multiple methods of addressing confounding, and multiple sensitivity analyses.
Conclusion Among patients with severe sepsis, patients with new-onset AF were at increased risk of in-hospital stroke and death compared with patients with no AF and patients with preexisting AF.
Atrial fibrillation (AF) is one of the most common arrhythmias among critically ill patients.1,2 Previous studies have demonstrated that 6% to 20% of patients with severe sepsis develop new-onset AF, suggesting that severe sepsis may be a predisposing factor for new-onset AF.2-5 Although chronic AF is a major contributor to long-term disability and mortality,6 the relationship of new-onset AF in severe sepsis to prognosis is unknown.
Although new-onset AF appears to be relatively common in individuals with severe sepsis, data are sparse to risk stratify or prognosticate these often complicated and critically ill patients. Small, single-center studies suggest that new-onset AF is associated with higher mortality and prolonged hospitalization during severe sepsis.5,7,8 However, a population-based assessment of the adverse outcomes associated with new-onset AF that occurs in the context of severe sepsis has not yet been undertaken.
Using a database of individuals hospitalized with severe sepsis identified via California State Inpatient Database claims, we sought to determine the association of new-onset AF with adverse outcomes of in-hospital mortality and in-hospital ischemic stroke. We hypothesized that new-onset AF during severe sepsis would be associated with increased risks of in-hospital stroke and in-hospital mortality.
We examined hospitalizations from adults (aged ≥18 years) using 2007 discharge data from the California State Inpatient Database, Healthcare Cost and Utilization Project, Agency for Healthcare Research and Quality (AHRQ).9 The California State Inpatient Database contains data for all patients hospitalized in nonfederal acute care California hospitals during 2007. Data elements included demographics, admission and discharge status, length of stay, up to 25 International Classification of Diseases, Ninth Revision, Clinical Modification (ICD-9-CM) diagnoses, and up to 21 ICD-9-CM procedure codes. Each diagnosis was coded with a separate identifier denoting whether it was present on admission, allowing discrimination between preexisting diagnoses and complications occurring after hospital admission.10-12 All study procedures were approved by the Boston University Medical Campus Institutional Review Board, which waived informed consent for this study.
The primary severe sepsis analytic cohort was defined by the presence of the ICD-9-CM code for severe sepsis (ICD-9-CM code 995.92).
Atrial fibrillation was defined by the presence of ICD-9-CM code 427.3x.13 New-onset AF was defined as AF or atrial flutter that occurred during the hospital stay, excluding cases that were present on admission. In-hospital ischemic stroke was defined with ICD-9-CM codes 433, 434, or 43614 that were not present on admission.
Demographic data collected in the California State Inpatient Database included age, sex, and race/ethnicity (coded as white, black, Hispanic, or other). Previously described AF risk factors15-18 were defined by ICD-9-CM codes19,20 present on admission for heart failure, myocardial infarction, hypertension, obesity, diabetes mellitus, and chronic obstructive pulmonary disease (COPD). Acute factors were obtained from ICD-9-CM codes for acute organ dysfunction diagnoses,21,22 electrolyte abnormalities, right heart catheterization, infectious pathogen type (gram-positive vs gram-negative bacteria vs fungal vs none reported), and infection source. The ICD-9-CM coding strategies are shown in eTable 1.
We performed sensitivity and exploratory analyses to explore the temporality of severe sepsis, AF, and ischemic stroke events. We analyzed a cohort with severe sepsis (ICD-9-CM code 995.92) coded as “present on admission,” in whom new-onset AF that was not “present on admission” occurred after the onset of severe sepsis. We performed 3 sensitivity analyses using increasingly narrow ICD-9-CM codes for embolic stroke, the putative mechanism for stroke associated with AF6 (ICD-9-CM code 434 or 436 [cerebral artery occlusion or acute but ill-defined cerebrovascular disease]; ICD-9-CM code 434 [cerebral artery occlusion]; and ICD-9-CM code 434.1 [embolic stroke]). Because temporality between new-onset AF and new-onset stroke claims could not be established within the severe sepsis hospitalization, we performed an exploratory analysis investigating the risk of rehospitalization with a new ischemic stroke following the severe sepsis hospitalization (e Appendix).
We repeated mortality and stroke outcome analyses in an alternative severe sepsis cohort defined by the presence of ICD-9-CM codes for both infection and acute organ dysfunction, as previously described by Angus et al22 (eTable 1). In addition, we investigated stroke and mortality risks adjusted for potential readmissions using the AHRQ Healthcare Cost and Utilization Project Supplemental Variables for Revisit Analyses to classify individual, deidentified patients as random effects. Because septic embolic disease may result in stroke, we performed a sensitivity analysis excluding all patients with septic emboli claims (ICD-9-CM code 449). Finally, indicators of intensive care unit admission are not available in the California State Inpatient Database. As a proxy for intensive care, we performed a subgroup analysis in patients with claims for mechanical ventilation.
Validation of the severe sepsis ICD-9-CM code 995.92 at our institution (eAppendix) demonstrated moderate sensitivity (52%; 95% CI, 39%-65%) and high specificity (98%; 95% CI, 92%-100%), similar to validation findings in other hospitals.23 Previous studies have demonstrated 95% sensitivity and 99% specificity for AF ICD-9-CM code 427.3x claims.13 We validated present-on-admission modifiers (eAppendix) for severe sepsis and AF claims; agreement between severe sepsis present-on-admission status and blinded chart review was 91% (κ = 0.77) and agreement between AF present-on-admission status and blinded chart review was 90% (κ = 0.74), similar to previous findings.24
Prior validation of ischemic stroke ICD-9-CM codes has shown variable accuracy14,25-27; however, a strategy using ICD-9-CM codes 433, 434, and 436 at any diagnostic position previously demonstrated 86% sensitivity and 95% specificity (κ = 0.82).14 The ICD-9-CM code 434.11, used to indicate embolic stroke, has been demonstrated to be accurate in 73% of patients; patients with code 434.11 who did not have a clear embolic stroke on chart review were characterized as having ischemic stroke of atherothrombotic or uncertain etiology.26
Severe Sepsis, New-Onset AF, and In-Hospital Stroke. Multivariable logistic regression models were used to determine the association between the presence of severe sepsis and new-onset AF or in-hospital stroke, adjusting for demographics (age, sex, and race/ethnicity) and claims for preexisting comorbidities (heart failure, stroke, myocardial infarction, diabetes, obesity, hypertension, and COPD).
Factors Associated With New-Onset AF During Severe Sepsis. We performed multivariable logistic regression models with forward stepwise selection to determine the factors associated with new-onset AF during severe sepsis. Because patients with preexisting AF are not at risk of new-onset AF, we excluded patients with preexisting AF from this model.
New-Onset AF During Severe Sepsis and Adverse Outcomes. We constructed 4 regression models to evaluate the association of new-onset AF during severe sepsis with in-hospital stroke and in-hospital mortality. Model 1 included demographics and comorbidities as model covariates (prior claims for history of heart failure, myocardial infarction, stroke, diabetes, obesity, hypertension, metastatic or hematologic malignancy, or COPD); model 2 included demographics and acute factors (number and type of organ dysfunction claims, electrolyte abnormality, right heart catheterization, sources of infection, and pathogen type); and model 3 was a combination of all covariates in model 1 and model 2.
Regression model 4 was performed on a separate cohort matched on the probability of new-onset AF. To construct the matched cohort, we calculated the probability of new-onset AF via multivariable logistic regression including measured covariates as independent variables. Nearest-neighbor matching to 4 decimal places28 was used to match patients with new-onset AF with those without new-onset AF based on the calculated probability of new-onset AF.
We used generalized estimating equations to calculate odds ratios for stroke in all models. Individual hospitals were defined as random effects due to potentially correlated physician coding practices and patient characteristics within a single hospital. Differences in per-patient stroke rates according to AF status were analyzed with Wilcoxon-Mann-Whitney tests. We used Poisson regression with robust estimates29,30 to calculate relative risks for mortality associated with AF status.
A 2-sided α = .05 was selected for statistical significance for analyses of outcomes. SAS software, version 9.0 (SAS Institute Inc) was used for all analyses.
The 2007 California State Inpatient Database contained claims data from 3 144 787 hospitalized adults who had a mean age of 55 (SD, 21) years and of whom 62% were women, with a racial/ethnic composition of 57% white, 26% Hispanic, 8% black, and 9% other. The Figure demonstrates the number of patients with or without severe sepsis and outcomes associated with each severe sepsis classification category.
Severe sepsis was present during 49 082 hospitalizations (1.56%; 95% CI, 1.55%-1.57%). Patients with severe sepsis were a mean of 69 (SD, 16) years old and 48% were women, with a racial/ethnic composition of 56% white, 20% Hispanic, 9% black, and 15% other/missing. Table 1 displays the characteristics of the severe sepsis cohort stratified by AF status. eTable 2 demonstrates that imbalances in measured covariates between AF groups were substantially attenuated in the cohort matched on the calculated probability of new-onset AF.
New-onset AF occurred during 20 608 hospitalizations (0.65%; 95% CI, 0.65%-0.66%) (including sepsis and nonsepsis) and during 2896 hospitalizations (5.9%; 95% CI, 5.7%-6.1%) of patients with severe sepsis. Therefore, 14% (95% CI, 13.6%-14.5%) of all hospital-associated new-onset AF occurred in the context of severe sepsis. Compared with hospitalized patients without severe sepsis, patients with severe sepsis had an increased risk of new-onset AF (demographics- and comorbidity-adjusted odds ratio, 6.82; 95% CI, 6.54-7.11; P < .001).
Results of the multivariable analysis of factors associated with new-onset AF during severe sepsis are shown in Table 2. Factors associated with increased risk of new-onset AF during severe sepsis included demographics (increasing age, male sex, and white race), comorbidities (history of heart failure, obesity, malignancy, and stroke), and acute factors (increasing number of organ failures, respiratory failure, hematologic failure, renal failure, use of right heart catheter, pulmonary or abdominal source of infection, and gram-positive or fungal organisms).
In-hospital stroke claims occurred during 3310 adult hospitalizations (0.11%; 95% CI, 0.10%-0.11%) (both sepsis and nonsepsis) and 381 hospitalizations (0.78%; 95% CI, 0.70%-0.86%) of patients with severe sepsis. Thus, 11% (95% CI, 10%-13%) of in-hospital strokes occurred in patients with severe sepsis. Compared with hospitalized patients without severe sepsis, patients with severe sepsis had an increased risk of in-hospital ischemic stroke (demographic and comorbidity-adjusted odds ratio, 6.0; 95% CI, 5.38-6.69; P < .001).
In patients with severe sepsis, in-hospital ischemic stroke occurred in 75 of 2896 individuals (2.6%; 95% CI, 2.0%-3.2%) with new-onset AF compared with 57 of 9986 (0.57%; 95% CI, 0.43%-0.74%) with preexisting AF and 249 of 36 200 (0.69%; 95% CI, 0.61%-0.78%) without AF. The average stroke rate was 0.15% (SD, 1.21%) per hospital day for patients with new-onset AF compared with 0.05% (1.01%) for patients with no AF or preexisting AF (P < .001).
Among individuals with severe sepsis, new-onset AF was associated with increased adjusted risks of in-hospital ischemic stroke (Table 3). In contrast, patients with severe sepsis and preexisting AF did not have an increased risk of in-hospital ischemic stroke compared with those with severe sepsis and no AF (multivariable-adjusted odds ratio, 0.74; 95% CI, 0.55-1.01; P = .054). Furthermore, individuals with new-onset AF had greater stroke risk than those with preexisting AF (multivariable-adjusted odds ratio, 3.63; 95% CI, 2.51-5.25; P < .001). A sensitivity analysis using different ischemic stroke ICD-9-CM definitions demonstrated increasing strength of association between new-onset AF and in-hospital stroke in severe sepsis as ICD-9-CM codes increased in specificity for embolic stroke (Table 4). Additional sensitivity analyses in patients meeting the alternative severe sepsis definition, in patients with severe sepsis present on admission, in patients without septic emboli claims, and in patients who required mechanical ventilation did not result in substantially different estimates of stroke risk associated with new-onset AF (Table 4).
To establish a temporal relationship between new-onset AF during severe sepsis and new stroke, we performed an exploratory analysis investigating the risk of incident stroke occurring after the severe sepsis hospitalization. We identified 27 325 severe sepsis survivors without a prior stroke claim. Rehospitalization with a new ischemic stroke occurred in 23 of 1171 (2.0%) with new-onset AF during severe sepsis, 81 of 5300 (1.5%) with preexisting AF during sepsis, and 261 of 20 854 (1.3%) without AF during severe sepsis. Compared with patients with no AF, patients with new-onset AF during the severe sepsis hospitalization had a nonsignificantly increased risk of rehospitalization with incident ischemic stroke (multivariable-adjusted hazard ratio, 1.51; 95% CI, 0.98-2.33; P = .06).
In patients with severe sepsis, 1629 (56.3%; 95% CI, 54.4%-58.1%) with new-onset AF died in the hospital compared with 4375 (43.8%; 95% CI, 42.8%-44.8%) with preexisting AF and 13 652 (37.7%; 95% CI, 37.2%-38.2%) without AF. Thus, compared with patients without new-onset AF, individuals with new-onset AF during severe sepsis experienced increased in-hospital mortality (Table 3). Sensitivity analyses did not show substantially different effect estimates for mortality (eTable 3). The eFigure demonstrates that the increased mortality risk for patients with severe sepsis and new-onset AF persisted regardless of the number of severe sepsis–associated organ failures.
Our investigation of new-onset AF during severe sepsis presents a number of clinically relevant findings. First, severe sepsis was associated with increased risk of both new-onset AF and in-hospital ischemic stroke. In addition, we identified multiple demographic and clinical factors associated with new-onset AF during severe sepsis. Importantly, patients with new-onset AF during severe sepsis had increased risks of both in-hospital ischemic stroke and mortality. The increased stroke and mortality risks observed with new-onset AF were robust across 2 definitions of severe sepsis, multiple methods of addressing confounding, and multiple sensitivity analyses.
Consistent with previous reports of increased stroke risk following infection,31-35 our study demonstrates that patients with severe sepsis had a 6-fold increased risk of in-hospital stroke compared with hospitalized patients without severe sepsis. Importantly, patients with severe sepsis who developed new-onset AF had a greater risk of in-hospital stroke than patients with preexisting AF and individuals without a history of AF. As far as we are aware, the increased risk of ischemic stroke in patients with severe sepsis and new-onset AF has not been previously reported.
Several potential mechanisms might explain the increased ischemic stroke risk in patients with severe sepsis and new-onset AF. Severe sepsis alone may be associated with an increased risk of stroke through hemodynamic collapse, increased systemic inflammation, and coagulopathy.36,37 New-onset AF may simply be a marker for greater severity of illness and, thus, greater stroke risk. However, within the limitations of claims data, adjustment for clinical and demographic factors associated with severity of illness did not eliminate the strong associations of new-onset AF claims with incident stroke claims.
Alternatively, new-onset AF may be a potential source of cardioembolic stroke. In fact, we identified an almost 4-fold increased risk of in-hospital embolic stroke claims associated with new-onset AF during the severe sepsis hospitalization. Although new-onset AF in critically ill patients is often transient,2 prior studies have shown that atrial thrombi may form within 2 days of the onset of AF.38 Of note, individuals with severe sepsis and preexisting AF did not have an increased stroke risk compared with patients without AF. Potential differences in anticoagulation practice patterns between patients with preexisting and new-onset AF could not be ascertained from the California administrative data. Whether anticoagulation practices differ between patients with preexisting AF and new-onset AF and whether benefits of systemic anticoagulation for AF during severe sepsis outweigh risks cannot be ascertained from our data source and warrant further investigation.
New-onset AF was associated with a 7% increase in the adjusted risk of in-hospital death. The hospital mortality of patients with new-onset AF during severe sepsis was similar to the mortality of those without AF, but with 1 additional acute organ failure. Whether new-onset AF functions as a marker for increased illness severity and poor prognosis (eg, new-onset AF represents an additional “organ dysfunction”) or directly contributes to mortality (eg, through refractory hypotension, stroke, or heart failure) cannot be elucidated from observational claims data and also warrants further investigation.
Our results expand on those of prior studies2-4 demonstrating severe sepsis to be strongly associated with new-onset AF. Severe sepsis was associated with 14% of all episodes of new-onset AF occurring in hospitalized adults. Standard demographic risk factors for community-acquired AF such as older age, male sex, and white race15,16 and previously described AF-associated comorbidities such as heart failure, obesity,15,16 and malignancy39-41 were also associated with new-onset AF during severe sepsis. In addition, prevalent stroke was associated with new-onset AF, a finding that suggests that some patients with new-onset AF may have had undiagnosed paroxysmal AF.42 Our seemingly paradoxical findings that hypertension and diabetes were associated with reduced risk of new-onset AF in severe sepsis may be an artifact of less frequent coding of chronic comorbid conditions such as hypertension and diabetes in patients with critical illness and warrant prospective study. Multiple acute factors were also associated with increased risk of first-diagnosed AF during severe sepsis. Whether these acute factors serve as markers of illness severity or represent other potential mechanisms for AF is unclear, though the increased risk of arrhythmias associated with use of right heart catheters in critically ill patients has been previously reported.43,44
Our study has several limitations. First, the incidence of severe sepsis−associated, new-onset AF in our study (5.9%) was on the lower end of previously reported rates (6%-20%).2-5 Incidence of AF in our study may be lower because claims data are less sensitive for detecting new-onset AF compared with the chart abstraction or prospective identification used in prior studies. Additionally, new-onset AF that occurred on hospital admission in the setting of severe sepsis may be classified as “preexisting AF” by the “present on admission” coding strategy used in our study, which might falsely lower the observed incidence of AF or bias outcome analyses.
Second, because new-onset AF during critical illness is often self-limited,2 clinicians may not record episodes of AF that are deemed clinically insignificant. Thus, “circular coding” may be present in which new-onset AF is preferentially coded when it is thought to be associated with an adverse outcome such as stroke. However, we did not find associations between stroke and preexisting AF, which would theoretically be susceptible to a similar circular coding bias.
Third, because our definition of new-onset AF necessitated that AF occur after hospital admission, an “immortal time” bias45 may exist in which patients had to survive long enough to be diagnosed as having AF. Immortal time bias may have falsely lowered the risk of mortality associated with new-onset AF; thus, the mortality risk associated with new-onset AF during severe sepsis may actually be greater than reported in our study. Death may be considered as a competing risk for in-hospital stroke; however, we could not ascertain time to in-hospital stroke, which would be necessary to perform competing risk analyses. The composite vector of these potential biases is not clear.
Fourth, though sensitivity analyses suggest a temporal order among severe sepsis, AF, and in-hospital stroke, the administrative data used for the present study are limited in ascertaining the timing of clinical events. However, an exploratory analysis of incident ischemic stroke occurring after the severe sepsis hospitalization suggests that stroke risks may remain elevated up to 1 year following severe sepsis. Finally, because of the observational nature of our study and the possibility for unmeasured confounding, we cannot prove a causal relation between new-onset AF in the setting of severe sepsis and increased risk of stroke and death.
Given projected estimates of severe sepsis incidence in 1 million Americans in 2011,22 it is likely that new-onset AF occurs in more than 60 000 patients with severe sepsis in the United States each year. Our findings suggest that new-onset AF during severe sepsis is associated with especially high short-term nosocomial stroke and mortality risks; most patients with new-onset AF during a hospitalization with severe sepsis did not survive. Current guidelines do not address AF that occurs in the setting of severe sepsis or acute infection,6,46 suggesting that new-onset AF that occurs during severe sepsis is an underrecognized public health problem. If our findings of increased stroke and death in the setting of AF and severe sepsis are replicated in other data sets, then it will be important to examine management strategies that might diminish the risk of adverse outcomes associated with AF during severe sepsis.
Corresponding Author: Allan J. Walkey, MD, MSc, the Pulmonary Center, Boston University School of Medicine, R-304, Boston, MA 02118 (firstname.lastname@example.org).
Published Online: November 13, 2011. doi:10.1001/jama.2011.1615
Author Contributions: Dr Walkey had full access to all of the data in the study and takes responsibility for the integrity of the data and the accuracy of the data analysis.
Study concept and design: Walkey, Benjamin.
Acquisition of data: Walkey, Ghobrial.
Analysis and interpretation of data: Walkey, Wiener, Curtis.
Drafting of the manuscript: Walkey.
Critical revision of the manuscript for important intellectual content: Walkey, Wiener, Ghobrial, Curtis, Benjamin.
Statistical analysis: Walkey.
Administrative, technical, or material support: Walkey.
Study supervision: Benjamin.
Conflict of Interest Disclosures: All authors have completed and submitted the ICMJE Form for Disclosure of Potential Conflicts of Interest and none were reported.
Funding/Support: This study was funded by grant UL1RR025771 from the Boston University Clinical Translational Research Institute (Dr Walkey); by the Evans Center for Interdisciplinary Biomedical Research ARC on Atrial Fibrillation at Boston University (http://www.bumc.bu.edu/evanscenteribr/) (Drs Walkey, Curtis, and Benjamin); by National Heart, Lung, and Blood Institute grants 1R01HL092577 and 1RC1HL101056 (Dr Benjamin) and 1R01 HL102214 (Drs Curtis and Benjamin); by National Cancer Institute grant K07 CA138772 (Dr Wiener); and by the Department of Veterans Affairs (Dr Wiener).
Role of the Sponsors: No funding organization had a role in the design and conduct of the study; in the collection, analysis, and interpretation of the data; or in the preparation, review, or approval of the manuscript.