[Skip to Content]
Sign In
Individual Sign In
Create an Account
Institutional Sign In
OpenAthens Shibboleth
[Skip to Content Landing]
Article
March 1, 2010

Editorial Policies of Pediatric JournalsSurvey of Instructions for Authors

Author Affiliations

Author Affiliations: German Cochrane Center, Institute of Medical Biometry and Medical Informatics (Drs Meerpohl, Wolff, Antes, and von Elm), and Division of Pediatric Hematology and Oncology, Department of Pediatrics (Drs Meerpohl and Niemeyer), University Medical Center Freiburg, Freiburg, Germany; Kleijnen Systematic Reviews Ltd, York, England (Dr Wolff); and Swiss Paraplegic Research, Nottwil (Dr von Elm).

Arch Pediatr Adolesc Med. 2010;164(3):268-272. doi:10.1001/archpediatrics.2009.287
Abstract

Objective  To study whether specific recommendations aiming to improve publication practice were included in author instructions of pediatric journals.

Design  We identified 69 journals in the subject category “pediatrics” of the Journal Citation Report 2007 that publish original research articles. From the journals' online author instructions, we extracted information regarding endorsement of the Uniform Requirements for Manuscripts (URM) of the International Committee of Medical Journal Editors and of 5 major reporting guidelines such as the Consolidated Standards of Reporting Trials (CONSORT) statement, disclosure of conflicts of interest, and trial registration. Two investigators collected data independently.

Results  The URM were mentioned in author instructions of 38 of the 69 journals (55%). Endorsement of reporting guidelines was low: CONSORT was referred to most frequently (14 journals; 20%); each of the other 4 reporting guidelines was mentioned in less than 10% of author instructions. Fifty-four journals (78%) explicitly required authors to disclose conflicts of interest, and 16 (23%) either recommended or required trial registration. The odds of endorsing the URM increased by 2.25 (95% confidence interval [CI], 1.17-4.34) per additional impact factor point. Similarly, the odds increased by 2.32 (95% CI, 0.95-5.70) for requiring disclosure of conflicts of interest and by 3.66 (95% CI, 1.74-7.71) for requiring trial registration.

Conclusions  Many pediatric journals do not include recommendations that aim to improve publication practice in their author instructions. About one-fifth of journals do not require authors to disclose conflicts of interest on manuscript submission and more than three-quarters do not require/recommend trial registration.

There is accumulating evidence of publication bias and selective reporting of study results1 and continued concerns regarding undisclosed conflicts of interest of authors2 and cases of scientific misconduct.3 Nonreporting of study results has been identified in several fields of medical research including pediatrics.4 Different recommendations have been proposed to bring about change in the reporting and publication practice.

First, the International Committee of Medical Journal Editors established the Uniform Requirements for Manuscripts Submitted to Biomedical Journals (URM).5 This document covers issues such as ethical conduct and reporting of biomedical research, preparation and publishing of manuscripts, and editorial policies. To date, it has been endorsed by more than 700 journals worldwide.6 Second, specific reporting guidelines such as the Consolidated Standards of Reporting Trials (CONSORT) statement aim at helping authors improve the completeness and accuracy of publications of clinical trials.7 Their bottom-line message is that all relevant information about a study should be made available so that readers can assess its validity. Third, authors but also journal editors and reviewers potentially have financial ties or personal interests in conflict with an article getting published or not.8,9 For instance, authors of articles favoring the use of calcium-channel blockers were reported to be more likely to have financial relationships with the drugs' manufacturers than those with a neutral or critical point of view.10 The journals' policies range from the requirement of full disclosure of conflicts of interest (eg, on the article's title page) to absence of any requirement. Finally, the problem of publication bias has been widely recognized and described in detail over the last 15 years.1 Registration of all clinical trials prior to patient enrollment has been advocated as an important first step to tackle it.1113 Several international and national registries such as ClinicalTrials.gov (www.clinicaltrials.gov) or the German Clinical Trials Register (www.germanctr.de) have been established and can be used free of charge to register or search ongoing and completed trials. A meta-register called the International Clinical Trials Registry Platform incorporating data of all accredited trial registries is being set up under the auspices of the World Health Organization (www.who.int/ictrp/en/).14

The current editorial practice in pediatrics has received only little attention until now. We wondered to what extent pediatric journals formally endorse existing recommendations that aim to improve publication practice. We set out to study the coverage of 4 aspects: whether journals (1) recommend use of the URM; (2) recommend major reporting guidelines; (3) have editorial policies on conflicts of interest; or (4) require trial registration.

METHODS

We accessed the Journal Citation Report 2007 (Science Edition)15 on August 5, 2008, through the Institute for Scientific Information Web of Knowledge Web site and identified all journals listed in the subject category “pediatrics.” We excluded journals that do not publish original research articles because several of the reporting guidelines of interest only apply to original research. From the journals' Web sites, we downloaded the author instructions available in August 2008 and determined the geographical location of the editorial office. Two of us (J.J.M. and R.F.W.) read each document and used relevant key words in electronic full-text searches to identify information on the following aspects:

  • Endorsement of the URM.5

  • Editorial policies for disclosure of conflicts of interest.

  • Requirement of trial registration.

  • Endorsement of the following 5 reporting guidelines and related explanatory articles: CONSORT16,17 and extensions; Strengthening the Reporting of Observational Studies in Epidemiology (STROBE)18,19; Standards for Reporting of Diagnostic Accuracy (STARD)20,21; Meta-analysis of Observational Studies in Epidemiology (MOOSE)22; and Quality of Reporting of Meta-analyses (QUOROM).23 The PRISMA statement (a revised version of the QUOROM statement) was published in July 2009.24

For each item, we distinguished whether it was “required” (ie, a submitted manuscript would not be accepted if the item was not considered), “recommended” (ie, its use or fulfillment ought to be considered), or “not mentioned.” Two of us (J.J.M. and R.F.W.) extracted and categorized information independently. Discrepancies occurred in 22 of 3588 extracted items (0.6%). They were resolved by rechecking the respective Web sites and discussion among the investigators.

Geographical location of journal editorial offices was grouped into “North America” (United States and Canada), “United Kingdom,” “Europe without the United Kingdom,” and “other countries.” To determine any associations between the journals' impact factor scores25 (used as a continuous variable) and the presence or absence of journal recommendations, we calculated odds ratios (ORs) using logistic regression models. Statistical analyses were performed using Stata software (release 10.0; StataCorp, College Station, Texas).

RESULTS

We identified 78 journals in the subject category “pediatrics.” Eight journals were excluded because they do not publish original research articles. The journals Biology of the Neonate and Neonatology (and their instructions) were identical; we included only the first title. Our final study sample comprised 69 pediatric journals. Their impact factor ranged from 0.151 to 4.655. For 35 journals (51%), the editorial office was located in North America; for 14 (20%), in the United Kingdom; for 15 (22%), in other European countries; and for the remaining 5 (7%), in Australia or India. The editorial offices of all 6 journals with an impact factor of more than 3 were located in North America.

The URM were mentioned in the author instructions of 38 journals (55%). Of these, 18 referenced the URM Web site only; 6, a print version only; and 8, both the Web site and the print version (Table 1). Six did not include any reference to the URM. If author instructions mentioned URM, they mostly did so in the section on manuscript preparation and references. Often, it was not clear whether the entire document was meant or only a part. Impact factor was associated with recommendation of the URM (OR, 2.25; 95% confidence interval [CI], 1.17-4.34 for each additional 1-point increase in impact factor).

Table 1. 
Advice Given to Authors by Pediatric Journals
Advice Given to Authors by Pediatric Journals

The author instructions of 54 journals (78%) included a statement on disclosure of conflicts of interest (Table 1). Journals with a higher impact factor were more likely to have a formal policy on conflicts of interest (OR, 2.32 per impact factor point; 95% CI, 0.95-5.70). Presence of a conflict of interest policy showed little variation by geographic location (Table 1). When analyzing the author instructions, it was not always clear what authors were expected to do, eg, whether their potential conflicts of interest should only be disclosed in the covering letter to the editor or should be published as part of the article.

Trial registration was mentioned by 16 journals (23%); 11 required that a trial be registered as a condition of publication and 5 simply recommended registration. Seven journals suggested suitable trial registries (eg, www.clinicaltrials.gov, www.isrctn.org, www.controlled-trials.com). Recommendations for trial registration were least common in journals in Europe without the United Kingdom (7%) and most common among journals in the United Kingdom (43%), but the variation was not statistically significant (Table 1). Further, journals with a higher impact factor were more likely to mention trial registration (OR, 3.66 per impact factor point; 95% CI, 1.74-7.71).

The CONSORT statement was referenced by 14 journals, of which 3 required authors to follow this reporting guideline (Table 2). Use of the CONSORT checklist and flowchart was recommended by 8 and 6 journals, respectively. Some journals gave no Web or printed citation for CONSORT material. Other reporting guidelines, such as STROBE for observational studies, MOOSE for meta-analyses of observational studies, QUOROM for meta-analyses of trials, and STARD for diagnostic test accuracy studies, were mentioned only rarely (Table 2). None of the journals provided a reference to the detailed explanatory articles accompanying the CONSORT, STARD, or STROBE statements.

Table 2. 
Endorsement of Reporting Guidelines in the Author Instructions of Pediatric Journals
Endorsement of Reporting Guidelines in the Author Instructions of Pediatric Journals
COMMENT

We analyzed the author instructions of pediatric journals for recommendations aiming to improve publication practice. The endorsement of several reporting guidelines and other recommendations was low. However, journals with a higher impact factor were more likely to have adopted some recommendations (eg, the URM).

Recently, the content of author instructions of medical journals with high impact factors was analyzed by Hopewell et al.26 The URM and the CONSORT statement were endorsed by 42% and 38% of 165 journals, respectively. We found the proportion of pediatric journals referring to the URM to be larger (55%), while the proportion of journals endorsing the CONSORT statement (23%) was lower.26 Schriger et al27 compared the methodological and statistical content of the author instructions of high-profile journals in 33 clinical categories; most of these instructions gave no advice about statistical methods (61%) or publication guidelines such as URM (59%) or CONSORT (78%). Matarese28 compared the quality of author instructions and editorial leadership of Italian and British journals and reported that Italian journals scored worse (eg, none of the Italian journals recommended trial registration).

The importance of good publication practice, including registration of clinical trials, in children has been recognized and efforts taken to translate it into editorial practice.2931 However, few pediatric journals recommended trial registration to their authors despite the ongoing discussion about this topic and the benefit of supplementary trial information made available in registries.11,32,33 Further, most pediatric journals ask authors to disclose any conflicts of interest. But a substantial number of journals still neither have a published policy on conflicts of interest nor require authors to disclose any. The journals' policies vary greatly: some require authors to mention any potential conflicts of interest in the submission letter without conveying this information to readers while others publish it as part of the article. Only a few pediatric journals provided information on potential conflicts of interest of their editors or reviewers, which is consistent with data from gastroenterology journals.9 However, we did not search the author instructions and Web sites of the journals specifically for this aspect. Given the crucial role of reviewers and editors in the dissemination of research evidence, journals may consider disclosure of potential conflicts of interest of these additional groups involved in the publication process.

Deficiencies in reports from clinical pediatric research have been found in various pediatric subspecialties including pediatric urology, pediatric orthopedics, and drug trials.3437 Generic reporting guidelines have been developed by groups of scientists, methodologists, and journal editors with the aim to improve the quality of research reports. There is now first evidence of a positive impact of such guidelines on reporting quality.7,38 To date, only a few pediatric journals endorse major reporting guidelines. Possible reasons are that, first, for a particular journal, a specific recommendation may not be applicable (eg, QUOROM for a journal not publishing systematic reviews of randomized controlled trials). However, if a journal publishes original clinical research, at least part of the included reporting guidelines are relevant. Second, reporting guidelines may be perceived as an attempt to standardize research reporting. Consequently, journals may choose to abstain from requiring their authors to follow them. However, rather than producing boilerplate manuscripts, many authors would likely use these recommendations in a sensible way to ensure the completeness and accuracy of their manuscripts before submission.

There are some limitations to our study. Not all pediatric journals are indexed in the Journal Citation Report, and consequently, our sample may not be representative of all pediatric publications. Next, we took the impact factor as an indicator of the profile of pediatric journals, bearing in mind its multiple weaknesses.25,39,40 Finally, we did not survey journal editors on whether and how they actually implement and monitor their policies or whether they have any implicit rules or policies that are not reflected by author instructions.

CONCLUSIONS

We found that current international recommendations aiming to improve publication practice have not yet been implemented widely in pediatric journals. Adherence to the URM and to reporting guidelines such as CONSORT has a potential to improve the completeness and clarity of biomedical publications. Further, the registration of trials as a prerequisite for publication of ensuing reports and the disclosure of conflicts of interests represent solutions to tackle the problem of publication bias and to enhance transparency.

Back to top
Article Information

Correspondence: Joerg J. Meerpohl, MD, German Cochrane Center, Institute of Medical Biometry and Medical Informatics, University Medical Center Freiburg, Stefan-Meier-Strasse 26, 79104 Freiburg, Germany (meerpohl@cochrane.de).

Accepted for Publication: October 10, 2009.

Author Contributions:Study concept and design: Meerpohl, Wolff, Niemeyer, and von Elm. Acquisition of data: Meerpohl and Wolff. Analysis and interpretation of data: Meerpohl, Wolff, Antes, and von Elm. Drafting of the manuscript: Meerpohl. Critical revision of the manuscript for important intellectual content: Meerpohl, Wolff, Niemeyer, Antes, and von Elm. Statistical analysis: Meerpohl, Wolff, and von Elm. Administrative, technical, and material support: Antes. Study supervision: Antes and von Elm.

Financial Disclosure: None reported.

Additional Information: Dr von Elm is one of the authors of the STROBE statement and academic editor of PLoS ONE. Dr Niemeyer is academic editor of Pediatric Blood and Cancer.

References
1.
Dwan  KAltman  DGArnaiz  JA  et al.  Systematic review of the empirical evidence of study publication bias and outcome reporting bias. PLoS One 2008;3 (8) e3081
PubMed
2.
Bekelman  JELi  YGross  CP Scope and impact of financial conflicts of interest in biomedical research: a systematic review. JAMA 2003;289 (4) 454- 465
PubMed
3.
Titus  SLWells  JARhoades  LJ Repairing research integrity. Nature 2008;453 (7198) 980- 982
PubMed
4.
Hetherington  JDickersin  KChalmers  IMeinert  CL Retrospective and prospective identification of unpublished controlled trials: lessons from a survey of obstetricians and pediatricians. Pediatrics 1989;84 (2) 374- 380
PubMed
5.
 Uniform requirements for manuscripts submitted to biomedical journals: writing and editing for biomedical publication. International Committee of Medical Journal Editors Web site. www.icmje.org. Accessed August 6, 2008
6.
 Journals following URM. International Committee of Medical Journal Editors Web site. www.icmje.org/journals.html. Accessed August 8, 2008
7.
Plint  ACMoher  DMorrison  A  et al.  Does the CONSORT checklist improve the quality of reports of randomised controlled trials? a systematic review. Med J Aust 2006;185 (5) 263- 267
PubMed
8.
Smith  R Beyond conflict of interest: transparency is the key. BMJ 1998;317 (7154) 291- 292
PubMed
9.
Bhargava  NQureshi  JVakil  N Funding source and conflict of interest disclosures by authors and editors in gastroenterology specialty journals. Am J Gastroenterol 2007;102 (6) 1146- 1150
PubMed
10.
Stelfox  HTChua  GO'Rourke  KDetsky  AS Conflict of interest in the debate over calcium-channel antagonists. N Engl J Med 1998;338 (2) 101- 106
PubMed
11.
De Angelis  CDrazen  JMFrizelle  FA  et al. International Committee of Medical Journal Editors, Clinical trial registration: a statement from the International Committee of Medical Journal Editors. Croat Med J 2004;45 (5) 531- 532
PubMed
12.
Bonati  MPandolfini  C Trial registration, the ICMJE statement, and paediatric journals. Arch Dis Child 2006;91 (1) 93
PubMed
13.
Rivara  FP Registration of clinical trials. Arch Pediatr Adolesc Med 2005;159 (7) 685
PubMed
14.
Gülmezoglu  AMPang  THorton  RDickersin  K WHO facilitates international collaboration in setting standards for clinical trial registration. Lancet 2005;365 (9474) 1829- 1831
PubMed
15.
 Journal Citation Report 2007. ISI Web of Knowledge Web site. http://admin-apps.isiknowledge.com/JCR/JCR?SID=R2bkeAaboDlmaDaHaOm. Accessed August 5, 2008
16.
Moher  DSchulz  KFAltman  DCONSORT Group (Consolidated Standards of Reporting Trials), The CONSORT statement: revised recommendations for improving the quality of reports of parallel-group randomized trials. JAMA 2001;285 (15) 1987- 1991
PubMed
17.
Altman  DGSchulz  KFMoher  D  et al. CONSORT GROUP (Consolidated Standards of Reporting Trials), The revised CONSORT statement for reporting randomized trials: explanation and elaboration. Ann Intern Med 2001;134 (8) 663- 694
PubMed
18.
von Elm  EAltman  DGEgger  MPocock  SJGotzsche  PCVandenbroucke  JPSTROBE Initiative, The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies. Ann Intern Med 2007;147 (8) 573- 577
PubMed
19.
Vandenbroucke  JPvon Elm  EAltman  DG  et al. STROBE initiative, Strengthening the Reporting of Observational Studies in Epidemiology (STROBE): explanation and elaboration. Ann Intern Med 2007;147 (8) W163-94
PubMed
20.
Bossuyt  PMReitsma  JBBruns  DE  et al. Standards for Reporting of Diagnostic Accuracy, Towards complete and accurate reporting of studies of diagnostic accuracy: the STARD Initiative. Ann Intern Med 2003;138 (1) 40- 44
PubMed
21.
Bossuyt  PMReitsma  JBBruns  DE  et al. Standards for Reporting of Diagnostic Accuracy, The STARD statement for reporting studies of diagnostic accuracy: explanation and elaboration. Ann Intern Med 2003;138 (1) W1-12
PubMed
22.
Stroup  DFBerlin  JAMorton  SC  et al.  Meta-analysis of observational studies in epidemiology: a proposal for reporting. Meta-analysis of Observational Studies in Epidemiology (MOOSE) group. JAMA 2000;283 (15) 2008- 2012
PubMed
23.
Moher  DCook  DJEastwood  SOlkin  IRennie  DStroup  DF Improving the quality of reports of meta-analyses of randomised controlled trials: the QUOROM statement. quality of reporting of meta-analyses. Lancet 1999;354 (9193) 1896- 1900
PubMed
24.
Moher  DLiberati  ATetzlaff  JAltman  DGPRISMA Group, Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. BMJ 2009;339b2535
PubMed10.1136/bmj.b2535
25.
Garfield  E The history and meaning of the journal impact factor. JAMA 2006;295 (1) 90- 93
PubMed
26.
Hopewell  SAltman  DGMoher  DSchulz  KF Endorsement of the CONSORT statement by high impact factor medical journals: a survey of journal editors and journal 'Instructions to Authors'. Trials 2008;9 (1) 20
PubMed
27.
Schriger  DLArora  SAltman  DG The content of medical journal instructions for authors. Ann Emerg Med 2006;48 (6) 743- 749, 749. e1-e4
PubMed
28.
Matarese  V Relationship between quality and editorial leadership of biomedical research journals: a comparative study of Italian and UK journals. PLoS One 2008;3 (7) e2512
PubMed
29.
Bonati  MImpicciatore  PPandolfini  C Registering clinical trials: register of clinical trials in children must be set up. BMJ 2000;320 (7245) 1339- 1340
PubMed
30.
Pandolfini  CBonati  MRossi  V  et al.  The DEC-net European register of paediatric drug therapy trials: contents and context. Eur J Clin Pharmacol 2008;64 (6) 611- 617
PubMed
31.
Santoro  ERossi  VPandolfini  CBonati  M DEC-net: the development of the European register of clinical trials on medicines for children. Clin Trials 2006;3 (4) 366- 375
PubMed
32.
Sim  IChan  AWGulmezoglu  AMEvans  TPang  T Clinical trial registration: transparency is the watchword. Lancet 2006;367 (9523) 1631- 1633
PubMed
33.
Zarin  DAIde  NCTse  THarlan  WRWest  JCLindberg  DA Issues in the registration of clinical trials. JAMA 2007;297 (19) 2112- 2120
PubMed
34.
Dulai  SKSlobogean  BLBeauchamp  RDMulpuri  K A quality assessment of randomized clinical trials in pediatric orthopaedics. J Pediatr Orthop 2007;27 (5) 573- 581
PubMed
35.
Raad  JMBellinger  S McCormick  ERoberts  MCSteele  RG Brief report: reporting practices of methodological information in four journals of pediatric and child psychology. J Pediatr Psychol 2008;33 (7) 688- 693
PubMed
36.
Standing  JFKhaki  ZFWong  IC Poor formulation information in published pediatric drug trials. Pediatrics 2005;116 (4) e559- e562
PubMed
37.
Welk  BAfshar  KMacNeily  AE Randomized controlled trials in pediatric urology: room for improvement. J Urol 2006;176 (1) 306- 309, discussion 309-310
PubMed
38.
Moher  DJones  ALepage  LCONSORT Group (Consolitdated Standards for Reporting of Trials), Use of the CONSORT statement and quality of reports of randomized trials: a comparative before-and-after evaluation. JAMA 2001;285 (15) 1992- 1995
PubMed
39.
Dong  PLoh  MMondry  A The “impact factor” revisited. Biomed Digit Libr 2005;27
PubMed
40.
Hernán  MA Impact factor: a call to reason. Epidemiology 2009;20 (3) 317- 318, discussion 319-320
PubMed
×