Antipsychotic Treatment Among Youths With Attention-Deficit/Hyperactivity Disorder

Key Points español 中文 (chinese)

Question  How commonly are youths with attention-deficit/hyperactivity disorder treated with antipsychotic medications and what factors are associated with their use of antipsychotic treatment?

Findings  In this cohort study of 187 563 commercially insured youths with new episodes of attention-deficit/hyperactivity disorder, 2.6% were treated with an antipsychotic medication, among whom 52.7% had a potential clinical diagnostic rationale for antipsychotic treatment. Factors for antipsychotic medication use included older patient age, male sex, recent inpatient and other pharmacologic mental health treatments, self-harm/suicidal ideation; and oppositional defiant, substance use, depressive, and anxiety disorders.

Meaning  Approximately 1 in 40 commercially insured youths were treated with an antipsychotic medication without an approved indication in the year following a new attention-deficit/hyperactivity disorder diagnosis; mental health comorbidities may be associated with antipsychotic treatment in this group.

Importance  Significant concern exists over treating youths with attention-deficit/hyperactivity disorder (ADHD) with antipsychotic medications, yet little is known about the factors associated with antipsychotic treatment.

Objectives  To describe the percentage of youths who fill antipsychotic prescriptions in the year following a new diagnosis of ADHD and characterize the clinical and demographic factors associated with antipsychotic initiation.

Design, Setting, and Participants  A retrospective longitudinal cohort analysis of antipsychotic treatment was performed in 187 563 youths, aged 3 to 24 years, with a new diagnosis of ADHD (without recent diagnosis of any US Food and Drug Administration [FDA]–indicated conditions for antipsychotic treatment). The sample was derived from the 2010 to 2015 MarketScan Commercial Database, with the analysis completed between November 1, 2018, and May 30, 2019.

Main Outcomes and Measures  The percentage of youths prescribed an antipsychotic in the first year following a new diagnosis of ADHD. Among those prescribed antipsychotic medications, the percentage who received a diagnosis of conduct disorder, oppositional defiant disorder, or a disorder for which 1 or more antipsychotic medication has received an indication for use in youths from the FDA (schizophrenia, bipolar disorder, and Tourette disorder) and the percentage that filled an antipsychotic prescription before filling a stimulant prescription (methylphenidate or amphetamine derivative).

Results  Of the 187 563 youths included in the study, 114 305 (60.9%) were male with a mean (SD) age of 13.74 (5.61) years. In the year following a new ADHD diagnosis, 4869 youths (2.6%; 95% CI, 2.5%-2.7%) with ADHD were prescribed an antipsychotic. Youths treated with antipsychotics with ADHD were more likely than their peers who were not receiving an antipsychotic to have recently received diagnoses of self-harm and/or suicidal ideation (adjusted odds ratio [aOR], 7.5; 95% CI, 5.9-9.6), oppositional defiant disorder (aOR, 4.4; 95% CI, 3.9-4.9), and substance use disorder (aOR, 4.0; 95% CI, 3.6-4.5). The youths who received antipsychotics were also more likely to have received inpatient treatment (aOR, 7.9; 95% CI, 6.7-9.3). During the year following the new ADHD diagnosis, 52.7% (95% CI, 51.3%-54.1%) of youths treated with antipsychotics received a diagnosis for which antipsychotics have either an FDA or evidence-supported indication for their use. Among youths who initiated antipsychotic medications, 47.9% (95% CI, 46.5%-49.3%) did not receive a stimulant prescription between their ADHD diagnosis and antipsychotic initiation. Antipsychotic prescribing was proportionally highest for preschool-aged children (4.3%) and associated with neurodevelopmental disorders (aOR, 3.9; 95% CI, 1.3-11.2) and recent inpatient mental health treatment (aOR, 8.9; 95% CI, 1.7-45.8).

Conclusions and Relevance  Approximately half of youths with a new ADHD diagnosis may have an evidence-supported indication for an antipsychotic medication. Less than half of these youths received a stimulant; the evidence-supported first line treatment for ADHD, before the antipsychotic was initiated. Use of antipsychotic prescribing appears to be associated with high levels of psychiatric comorbidity.

In the past decade, there has been an increase in the prescription of antipsychotic medications to children and adolescents.^1-4 Between 1999 and 2014, antipsychotic prescribing for young people in the United States increased by 50%.⁴ Some of the increase in antipsychotic medication use in youths was for clinical indications that have been approved by the US Food and Drug Administration (FDA), including schizophrenia, bipolar disorder, irritability associated with autistic disorder, and Tourette disorder.^5-9 However, much of the increase has been associated with non–FDA-indicated prescribing, most commonly, attention-deficit/hyperactivity disorder (ADHD).^2,3,10,11

Antipsychotic medications can have significant adverse effects in youths. With prolonged exposure, these medications frequently cause adverse metabolic effects, including weight gain, hyperlipidemia, and increased risk of type 2 diabetes.^2,12,13 Recent evidence further suggests that antipsychotic treatment in youths is associated with an increased risk of unexpected death.¹⁴

Public and professional concern over the safety of antipsychotic use in young people has led to policies aimed at reducing use of these medications. Policy interventions have targeted absolute reductions in antipsychotic prescribing with less consideration of the clinical characteristics of patients treated with antipsychotics. As of 2014, most states had implemented prior authorization policies for use of antipsychotics in children in their Medicaid programs,^15,16 with varying age limitations. These policies have lowered overall antipsychotic use in young children,¹⁷ although little is known about the clinical characteristics of young patients who are treated with antipsychotics in community practice.

Nearly half of all non–FDA-indicated antipsychotic medication use in young people is for individuals with ADHD diagnoses, with or without other mental health diagnoses.^2,18 Yet, ADHD alone is not an evidence-supported indication for antipsychotic medications. Furthermore, little is known about which youths with ADHD are most likely to be treated with antipsychotic medications. Mental health comorbidity is one potential factor associated with antipsychotic treatment in youths with ADHD. Among Medicaid beneficiaries, youths treated with antipsychotics are often diagnosed with depression, oppositional defiant disorder (ODD), or conduct disorder (CD).¹⁹ Although depression is not an evidence-supported indication for antipsychotic treatment in youths, some evidence supports the effectiveness of risperidone for treatment of ODD or CD in stimulant-resistant youths with ADHD.^19-27

The prevalence of antipsychotic use in youths following a new ADHD diagnosis is not known. Questions also exist regarding the extent to which comorbid mental disorders are associated with antipsychotic treatment in youths with ADHD. In addition, the frequency with which young people with ADHD receive antipsychotic medications before a trial of stimulants is not known. Closing these knowledge gaps will help to focus quality-of-care efforts aimed at safe and judicious antipsychotic prescribing.

We analyzed claims records of commercially insured youths, aged 3 to 24 years, with a new diagnosis of ADHD. Patients recently diagnosed with conditions for which antipsychotics have an FDA-approved indication (schizophrenia, bipolar disorder, autism spectrum disorder, and Tourette disorder) were excluded from the cohort. To better understand antipsychotic prescribing in this population, this study (1) determined the prevalence of antipsychotic use over the following year, (2) evaluated the associations between clinical and demographic factors and antipsychotic prescribing, and (3) examined the frequency with which stimulant treatment preceded antipsychotic treatment in the first year following a new ADHD diagnosis. Before conducting the analyses, we hypothesized that males and older youths would have higher rates of antipsychotic treatment. We further anticipated that most youths with ADHD who initiated antipsychotic medications would be diagnosed with comorbid, evidence-supported clinical diagnoses (ie, ODD or CD), and would fill stimulant prescriptions before initiating antipsychotic medications.

Data were obtained from the Truven Health MarketScan database of commercially insured individuals from January 1, 2010, to December 31, 2015. This database comprises medical and prescription drug data for more than 115 million enrollees, including demographic characteristics, outpatient and inpatient service codes, diagnostic codes, and detailed pharmacy files.²⁸ The data were deidentified and the study was determined to be exempt from human subjects review by the Rutgers University Institutional Review Board. This study followed the Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) reporting guideline for cohort studies.

We examined records for youths with a new ADHD diagnosis (International Classification of Diseases, Ninth Revision (code 314.xx), and International Statistical Classification of Diseases, 10th Revision (code F90.xx), aged 3 to 24 years, after at least 120 days without an ADHD diagnosis. This 4-month period was chosen because youths with ADHD often are not seen by clinicians during summer months.²⁹ Youths were excluded if they had been prescribed an antipsychotic or stimulant or had received a diagnosis with an indication for an antipsychotic medication (schizophrenia, bipolar disorder, autistic spectrum disorder, and Tourette disorder) in the previous 6 months. This process excluded 4555 youths (2.4% of the total sample). In addition, we required 12 months of continuous health care enrollment following the initial ADHD diagnosis.

Youths were characterized by sex, age at ADHD diagnosis (3-5, 6-12, 13-18, 19-24 years), other mental health clinical diagnoses (depression, substance use, anxiety, self-harm and/or suicidal ideation, developmental disability, ODD, and CD) and recent mental health treatment, including inpatient care, being seen by a psychiatrist, and other psychopharmacologic treatments during the 180 days before the initial ADHD diagnosis (eTable in the Supplement).

Bipolar disorder, schizophrenia, and psychotic/delusional disorders, autism spectrum disorder, tic disorders, and Tourette disorder were considered as FDA-indicated diagnoses for antipsychotic treatment (eTable in the Supplement). Given the evidence of efficacy for risperidone in the treatment of ODD and CD, we considered these disorders to be evidence-supported diagnoses.^20-27

The analysis was conducted in 5 stages between November 1, 2018, and May 30, 2019. We first examined the background (pre-ADHD diagnosis), clinical, and demographic characteristics of youths who did and did not receive an antipsychotic medication during the 12 months following the initial ADHD diagnosis. We examined the incidence of antipsychotic treatment in the year following a new ADHD diagnosis. Unadjusted and age- and sex-adjusted logistic regressions evaluated the associations of each clinical and demographic characteristic with antipsychotic treatment during the 12-month follow-up period.

Second, to characterize stimulant treatment before antipsychotic initiation, we calculated the percentages of youths who received stimulant prescriptions before antipsychotic initiation among youths initiating antipsychotic medications overall and stratified by sex and age group. Stimulant treatment was defined as no stimulant, only 1 stimulant class (methylphenidate or amphetamine derivative), or both classes (methylphenidate and amphetamine derivative) during the period between new a ADHD diagnosis and antipsychotic initiation.

Third, we examined the first antipsychotic initiated for the cohort who received treatment with antipsychotics. We calculated percentages for each agent and mean (SD) number of antipsychotic prescriptions during the 180-day follow-up period.

Fourth, restricted to the antipsychotic-treated cohort, we examined percentages of youths who received an FDA-indicated diagnosis in the year following new ADHD diagnosis (post-ADHD diagnosis) and percentages of youths who received evidence-supported diagnoses in the 6 months before and 12 months after the new ADHD diagnosis. These results were then stratified by age group.

Fifth, we performed a subgroup analysis of preschool or very young children (aged 3-5 years) from the initial cohort, using the same variables and adding neurodevelopmental disorders (eTable in the Supplement). Sixth, to assess time to antipsychotic treatment after a new ADHD diagnosis, a Kaplan-Meier survival analysis was performed for each age group (eFigure in the Supplement). Findings were considered significant at 2-tailed unpaired P < .05. All analyses were completed with SAS, version 7.15 HF7 (SAS Institute Inc).

Of the 187 563 youths included in the study, 114 305 (60.9%) were male, with a mean (SD) age of 13.74 (5.61) years. Within 1 year of a new ADHD diagnosis, antipsychotic medications were initiated by 4869 of 187 563 youths (2.6%; 95% CI, 2.5%-2.7%). The prevalence of antipsychotic treatment was 4.3% (95% CI, 3.9%-4.7%) for very young children (3-5 years), 2.0% (95% CI, 1.9%-2.1%) for older children (6-12 years), 3.2% (95% CI, 3.0%-3.3%) for adolescents (13-18 years), and 2.4% (95% CI, 2.3%-2.6%) for young adults (19-24 years). Overall, antipsychotic initiators were more likely to be male (114 305 [60.9%]); adolescent (13-18 years); recently diagnosed with comorbid mental health conditions, with the most frequent being anxiety (5.8%; 95% CI, 5.5%-6.2%); and recent admission for inpatient mental health treatment (17.6%; 95% CI, 15.3%-20.0%). Antipsychotic initiation was associated with self-harm and/or suicidal ideation (adjusted odds ratio [aOR], 7.5; 95% CI, 5.9-9.6), ODD diagnosis (aOR, 4.4; 95% CI, 3.9-4.9), substance use disorder (aOR, 4.0; 95% CI, 3.6-4.5), and inpatient mental health care (aOR, 7.9; 95% CI, 6.7-9.3) in the preceding 6 months (Table 1 and eFigure in the Supplement).

Among youths who initiated antipsychotic medications, 47.9% (95% CI, 46.5%-49.3%) did not receive a stimulant prescription between their ADHD diagnosis and antipsychotic initiation. Approximately half of the youths (43.8%; 95% CI, 42.4%- 45.1%) who were treated with antipsychotics were prescribed 1 stimulant and 8.4% (95% CI, 7.6%-9.1%) were prescribed methylphenidate or a methylphenidate derivative and an amphetamine derivative before antipsychotic initiation (Table 2).

Table 3 presents the percentage of initial antipsychotic agents prescribed and the mean (SD) number of prescriptions. Risperidone (37.8%; mean [SD], 4.0 [3.5]), aripiprazole (32.0%; 3.6 [2.9]), and quetiapine (20.7%; 3.3 [3.0]) were the most commonly prescribed agents.

By the end of the follow-up year, 2565 of 19 990 youths (52.7%; 95% CI, 51.3%-54.1%) treated with antipsychotics had received either a diagnosis for which antipsychotics are FDA indicated in youths (35.1%; 95% CI, 33.8%-36.5%) or had received a clinical diagnosis for which there is evidence of antipsychotic efficacy in youths (26.9%; 95% CI, 25.6%-28.1%) (Table 4).

A total of 432 of 10 125 (4.3%) very young children (aged 3-5 years) with ADHD were treated with an antipsychotic medication. Compared with those who were not treated with an antipsychotic, those who received an antipsychotic were more likely to have been diagnosed with a neurodevelopment disorder (aOR, 3.9; 95% CI, 1.3-11.2), received inpatient mental health care (aOR, 8.9; 95% CI, 1.7-45.8), and received care from a psychiatrist (aOR, 3.3; 95% CI, 2.7-4.2) (Table 5). The likelihood of antipsychotic treatment in the very young cohort increased with the number of mental health and neurodevelopmental diagnoses they received (1 diagnosis: aOR, 1.9; 95% CI, 1.5-2.4; 2 diagnoses: aOR, 3.7; 95% CI, 2.4-5.7; ≥3 diagnoses: aOR, 6.8; 95% CI, 1.9-24.1).

The eFigure in the Supplement displays the time to antipsychotic initiation for ADHD youths by age group, with the most rapid increase occurring during the first 30 days.

Antipsychotic medications were prescribed for 2.6% of commercially insured youths in the year following a new clinical diagnosis of ADHD without a recent diagnosis that has an FDA indication for antipsychotic treatment. Factors for antipsychotic treatment included a wide range of comorbid psychiatric diagnoses. Conduct disorder and ODD were factors associated with antipsychotic treatment. However, only approximately half of the antipsychotic treated patients received diagnoses (FDA-indicated, CD or ODD) with evidence of clinical benefits from antipsychotics during the pre- or post-ADHD diagnosis period. These data reveal the extent to which antipsychotics are prescribed to young people with ADHD and raise concerns regarding potential non–evidence-based antipsychotic use and underuse of stimulant medications.

The percentage of youths with a new ADHD diagnosis who were treated with an antipsychotic without an FDA indication (2.6%) was greater than the overall annual prevalence of antipsychotic treatment among youths in the general population (0.6%).^4,30,31 Despite public policies and interventions aimed at reducing off-label antipsychotic medication prescriptions for youths,^32,33 young people diagnosed with ADHD appear to have an increased likelihood of filling antipsychotic prescriptions. Professional statements and practice guidelines released by the American Psychiatric Association and the American Academy of Child and Adolescent Psychiatry have encouraged clinicians to reduce use of antipsychotic medications in youths without an approved or evidence-supported indication.^23,34 Although these efforts may have reduced off-label prescription of antipsychotic medications to young people overall, their use among young people with ADHD remains significant.

The demographic profile of antipsychotic prescribing among youths with ADHD diagnoses is consistent with patterns observed in the general population of young people. Within the general population, the likelihood of antipsychotic use is also higher among male than female individuals and adolescents than children.² This pattern may be associated with the use of antipsychotics in the management of impulsive and aggressive behaviors in youths with ADHD.^18,20 After adolescence, decreases in the fraction of antipsychotic prescribing for young adults with ADHD have previously been described and are consistent with treatment of conduct problems that peak in adolescence.³⁵ This decline is potentially associated with suppression of aggressive behaviors and improved impulse control in late adolescence from maturation of prefrontal gray matter and proliferation of white matter tracts.^36,37

The flattest antipsychotic initiation curve occurs in school-aged youths (6-12 years). Based on new incidence, this is the age group at highest risk for initial ADHD presentations and when most medications are first used.¹⁸ A possible explanation of a flat curve is that symptoms are being addressed through the availability of nonpharmacologic, school-based interventions available to elementary school children.³⁸ However, because these interventions are not recorded through insurance databases, we are unable to measure this.

Among youths with ADHD, several clinically diagnosed mental disorder comorbidities have been associated with an elevated likelihood for antipsychotic treatment. In youths with ADHD, many of these comorbidities are related to poorer response to stimulant treatment and adverse outcomes.^39-41 Although antipsychotics could be prescribed because of incomplete response to other treatments, many of these conditions do not have empirical evidence supporting antipsychotic treatment. Outside of FDA indications, only ODD, CD, and aggression in ADHD have clinical experimental evidence to support the use of antipsychotics and only approximately half of the cohort of youths with ADHD who received antipsychotics had 1 or more of these clinical diagnoses.^20-27

Recent inpatient mental health care was associated with antipsychotic treatment. Symptom severity thresholds for receiving acute inpatient mental health care are often high, particularly for severe ADHD.^42-44 Young people whose symptoms have led to hospitalization likely have more complex clinical presentations than their peers who are not receiving antipsychotics. However, the effectiveness of antipsychotics for the treatment of severe uncomplicated ADHD has not been established. The youths with ADHD who were prescribed an antipsychotic but lacked an ODD or CD diagnosis could also have aggression or represent poor community pharmacologic management of ADHD.

Antipsychotic treatment was proportionately highest among very young children (4.3%). This group accounts for approximately a quarter of a percent of the total ADHD cohort, with very young children accounting for a small percentage of ADHD-treated youths. These children were more likely to have neurodevelopmental disorders than their age-matched peers who were not treated with antipsychotic medications and received high rates of inpatient mental health care. Antipsychotic treatment may be reserved for children with greater symptom severity. While ADHD uncommonly presents in very young children, those with ADHD tend to have severe symptoms and relatively poor response rates to stimulants.^45,46 Furthermore, although nonpharmacologic treatment is generally regarded as first line in this age group, evidence-based psychosocial interventions, such as parenting training and parent-child interaction therapy, are not widely available.⁴⁷

Fewer than half of the youths received a stimulant before their antipsychotic and fewer than 1 in 10 received a methylphenidate and amphetamine derivative. Antipsychotics are only potentially indicated in youths with ADHD after treatment trials of both methylphenidate and mixed amphetamine salts.^21,48 This treatment pattern raises concerns that some youths with ADHD may be treated with antipsychotics prematurely, before receiving trials of adequate dose and duration of both classes of stimulants, potentially unnecessarily exposing them to antipsychotic treatment.

Risperidone was the most commonly first prescribed antipsychotic for youths with ADHD. This practice is consistent with recommendations. Risperidone has the strongest evidence base for off-label use in youths, particularly in ODD, CD, and aggression.^21-27 However, nearly two-thirds of the antipsychotic-treated sample initially were treated with other antipsychotics that either have negative trials or lack trials to support their use in ADHD.^25-27

A wide range of clinical characteristics, including mental disorder comorbidities, and inpatient mental health care are associated with antipsychotic treatment in youths with ADHD. Aggression, which is common in ADHD and not always responsive to stimulant medications, has been hypothesized to account for much of the off-label use of antipsychotics in youths with ADHD.^2,49,50 Consistent with this hypothesis, antipsychotic-treated youths with ADHD had clinical characteristics commonly associated with aggression in ADHD, such as inpatient hospitalization and a higher prevalence of comorbid disorders.^42-44,51-53 However, few youths treated with antipsychotics with ADHD received the evidence-indicated trials of 2 stimulants before an antipsychotic.

Current therapy management efforts in both private and publicly insured populations have been focused on curbing antipsychotic use in youths with less attention devoted to the clinical rationale for use. These policies have been particularly widely applied to Medicaid populations,¹⁵ including telephone consultations with psychiatrists, letters to prescribers, and age-related prior authorization policies.¹⁵ A greater understanding of the clinical rationale and timing of antipsychotic treatment of youths with ADHD might help to guide more clinically sensitive policies to regulate antipsychotic use.

This analysis was limited to commercially insured children. Much of the prior work on antipsychotic use in children has focused on Medicaid populations. Important socioeconomic and health differences exist between commercially insured and Medicaid-insured populations.^54,55 Yet some aspects of our sample resemble those in antipsychotic-treated Medicaid youths. For example, similar to analyses of Medicaid samples, our sample was predominantly male and had similar rates of CD, anxiety, and depression diagnoses.^14,19,56,57

This analysis has several limitations. First, diagnoses were based on clinical judgment—not structured interviews. Second, we were unable to examine antipsychotic treatment following the first lifetime diagnosis of ADHD. Patterns of antipsychotic treatment may be different following initial and new episodes of clinical ADHD diagnosis. Third, we examined commercially insured individuals; different results might be obtained from Medicaid beneficiaries in whom antipsychotic treatment is more common.⁵⁷ Although Medicaid programs have implemented management programs to limit antipsychotic use, few commercial insurance programs have followed suit. Nevertheless, these programs, along with medical society guidelines,⁴⁸ may be associated with diagnostic and prescribing practices for commercially insured patients. Fourth, several potentially important factors to understanding antipsychotic treatment patterns, such as race/ethnicity, family circumstances, and home environment, were unavailable in the data set. Furthermore, we were unable to measure symptoms that might have provided a clinical rationale, such as severe aggression, for antipsychotic treatment. In addition, data on medication use were based on filled prescriptions rather than observed medication consumption.

Among diagnostic groups in young people, ADHD may account for the largest share of antipsychotic treatment.^2,3,10,11 Our results suggest associations between comorbid psychiatric diagnoses and the use of antipsychotic treatment in youths with ADHD. While some of these young people were diagnosed with conditions for which antipsychotics have some evidence of clinical effectiveness, many others were not. In view of the serious safety risks posed by antipsychotic treatment of young people, these patterns highlight the importance of remaining vigilant concerning antipsychotic medication prescribing patterns in the community treatment of ADHD.

Accepted for Publication: June 6, 2019.

Published: July 26, 2019. doi:10.1001/jamanetworkopen.2019.7850

Correction: This article was corrected on August 28, 2019, to fix a numeric error in the Key Points Findings.

Open Access: This is an open access article distributed under the terms of the CC-BY License. © 2019 Sultan RS et al. JAMA Network Open.

Corresponding Author: Ryan S. Sultan, MD, Department of Psychiatry, College of Physicians and Surgeons, Columbia University, 1051 Riverside Dr, PO Box 78, New York, NY 10032 (rs3511@cumc.columbia.edu).

Author Contributions: Drs Sultan and Olfson had full access to all of the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis.

Concept and design: Sultan, Crystal, Olfson.

Acquisition, analysis, or interpretation of data: Sultan, Wang, Crystal.

Drafting of the manuscript: Sultan, Crystal, Olfson.

Critical revision of the manuscript for important intellectual content: Sultan, Wang, Crystal, Olfson.

Statistical analysis: Sultan, Wang, Crystal.

Obtained funding: Sultan, Crystal, Olfson.

Administrative, technical, or material support: Sultan.

Supervision: Sultan, Olfson.

Conflict of Interest Disclosures: Dr Olfson reported receiving personal fees from Lundbeck Pharmaceuticals during the conduct of the study. No other disclosures were reported.

Funding/Support: This study was supported by grants 1R01HS026001-01A1 and U19HS021112-01 from the Agency for Healthcare Research and Quality and the American Academy of Child and Adolescent Psychiatry Pilot Research Award for Attention Disorders.

Role of the Funder/Sponsor: The funding organizations had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; and decision to submit the manuscript for publication.