Bibliometric Analysis of Neurology Articles Published in General Medicine Journals

IMPORTANCE A significant portion of neurology literature is published in general medicine journals. Despite this, a detailed examination of publication patterns of neurology articles in these journals has not yet been carried out. OBJECTIVE To examine the publication patterns of neurology articles in general medicine journals during a 10-year period using a bibliometric approach. DESIGN, SETTING, AND PARTICIPANTS This cross-sectional bibliometric analysis identified the top 5 general medicine journals using the 2017 Journal Citations Report. Four other medical subspecialties (ie, immunology, endocrinology, gastroenterology, and pulmonology) were selected for comparison of publication patterns with neurology. Using MEDLINE, the 5 journals were searched for articles published between 2009 and 2018 that were indexed with the following MeSH terms: nervous system diseases, immune system diseases, endocrine system diseases, gastrointestinal diseases, and respiratory tract diseases. Data analysis was conducted from February 2019 to December 2020. MAIN OUTCOMES AND MEASURES Publications were characterized by journal, specialty, and study design. These variables were used for comparison of publication numbers. RESULTS The general medicine journals with the 5 highest journal impact factors (JIF) were New England Journal of Medicine (NEJM; JIF 79.3), Lancet (JIF 53.3), JAMA (JIF 47.7), BMJ (JIF 23.6), and PLOS Medicine (JIF 11.7). Our bibliometric search yielded 3719 publications, of which 1098 (29.5%) were in neurology. Of these 1098 neurology publications, 317 (28.9%) were published in NEJM, 205 (18.7%) in Lancet, 284 (25.9%) in JAMA, 214 (19.5%) in BMJ, and 78 (7.1%) in PLOS Medicine. Randomized clinical trials were the most frequent neurology study type in general medicine journals (519 [47.3%]). The number of publications in each of the other specialties were as follows: immunology, 817; endocrinology, 633; gastroenterology, 353; and pulmonology, 818. CONCLUSIONS AND RELEVANCE The results of this study provide some guidance to authors regarding where they may wish to consider submitting their neurology research. Compared with other specialties, neurology-based articles are published more frequently in general medicine journals. JAMA Network Open. 2021;4(4):e215840. doi:10.1001/jamanetworkopen.2021.5840 Introduction There has been considerable growth in scientific publications over time,1 including in the field of neurology, and researchers are faced with a number of options regarding where to publish their articles. Neurology-focused research articles (NFRAs) are published in a number of journal types, including general neurology journals, neurology subspecialty journals, and general medicine journals Key Points Question What are the publication patterns for neurology publications in general medicine journals, and how do they compare with other specialties? Findings In this cross-sectional bibliometric analysis of the top 5 most cited general medicine journals, the New England Journal of Medicine (NEJM) published more neurology articles than other journals. In the top 5 general medicine journals, there were more publications in neurology than in immunology, endocrinology, gastroenterology, or pulmonology. Meaning In this study, neurology articles were published most often in NEJM, and general medicine journals published more articles in neurology than in other medical specialties. Author affiliations and article information are listed at the end of this article. Open Access. This is an open access article distributed under the terms of the CC-BY License. JAMA Network Open. 2021;4(4):e215840. doi:10.1001/jamanetworkopen.2021.5840 (Reprinted) April 15, 2021 1/7 Downloaded From: https://jamanetwork.com/ by a Non-Human Traffic (NHT) User on 08/22/2021 (GMJs). However, there has been little examination of the precise publication patterns of NFRAs, specifically how frequently GMJs publish neurology articles and how the publication of neurology articles compares with other specialties. Bibliometric analysis can provide data regarding productivity rates, publication patterns, and publication characteristics by providing statistical descriptions of publications based on, in part, the premise that the published literature of a field embodies the field’s knowledge.2,3 It uses computerized analytic techniques with the individual publication as the unit of analysis, drawing data from sources such as MEDLINE, Google Scholar, or Journal Citation Reports (JCR; Clarivate Analytics).4 Bibliometric methods have been used to explore the productivity of researchers, institutions, and countries within given subject areas; to examine research trends and emphases in various disciplines; and to guide policy decision making.5-8 The JAMA Network has served as a medium for publishing bibliometric research in various medical specialties, including dermatology, ophthalmology, critical care, and obstetrics and gynecology (OBGYN),9-12 but bibliometric research related to neurology has not been extensively published. Therefore, our goal was to examine publication patterns of NFRAs in GMJs using a bibliometric approach and to compare these publication patterns with other medical subspecialties.

JAMA Network has served as a medium for publishing bibliometric research in various medical specialties, including dermatology, ophthalmology, critical care, and obstetrics and gynecology (OBGYN), [9][10][11][12] but bibliometric research related to neurology has not been extensively published. Therefore, our goal was to examine publication patterns of NFRAs in GMJs using a bibliometric approach and to compare these publication patterns with other medical subspecialties.

Methods
The institutional review board of the Children's Hospital of Eastern Ontario deemed that ethical approval was not necessary, as this was a pure bibliometric study. This study followed the Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) reporting guideline. 15

Journal Selection
The top 5 GMJs were identified using the JCR. The JCR generates a list of journals ranked by journal impact factor (JIF). The JCR data was filtered by the following: (1) selected categories, Medicine, General, and Internal; (2) selected JCR year, 2017; (3) selected editions, Science Citation Index Expanded (SCIE); and (4) selected category scheme, Web of Science. We then identified the 5 journals with the highest JIFs that met the following criteria: (1) GMJ, (2) accepting adult and pediatric articles, and (3) publishing primary research reports (ie, not exclusively review articles). We then obtained each journal's 2017 JIF, 13 reflecting the mean number of citations to articles published in that journal.

Specialty Selection
We sought to compare the publication patterns seen in neurology with 4 other medical subspecialties. To establish these 4 additional disciplines, we examined the JCR categories and selected the 4 specialties with the highest number of total citations in the JCR 2017 report that also met the following criteria: (1) the specialty must be relevant to all age groups, excluding, eg, gerontology and pediatrics, and (2) the specialty must be clinically focused. When an article was indexed with MeSH terms for more than 1 specialty, we included the article in each of those specialties.

Bibliometric Search Strategy
On April 24, 2019, using Ovid MEDLINE, we searched the 5 journals for articles published between 2009 and 2018 that were indexed with the following MeSH terms: nervous system diseases, immune system diseases, endocrine system diseases, gastrointestinal diseases, and respiratory tract diseases.
We further restricted the search to records with abstracts and excluded commentaries, editorials, historical articles, and letters. Records were downloaded into Reference Manager version 11 (Thomas Reuters).

Study Designs and Review of Classification Accuracy
Our search included MEDLINE classification for the following study designs: randomized clinical trials (RCTs), clinical trials, systematic reviews, case reports, cohort studies, cross-sectional studies, casecontrol studies, and comparative studies. A hierarchical filtering process was used to ensure all study types were mutually exclusive and that each article was only indexed for 1 study type. We reviewed a random 5% sample of the records to ensure classification accuracy for specialty and study type.

Statistical Analysis
Data analysis was conducted from February 2019 to December 2020. Models for the number of publications by year, journal, and specialty were constructed. Poisson models were initially considered; however, due to the presence of overdispersion, these models were replaced by quasi-Poisson models. The starting point was a model including main effects for year, journal, and specialty as well as all 2-way interactions. When the evidence for an interaction was weak (P > .10), that interaction was removed, and the reduced model was fitted. Based on the final model, estimated marginal means by year, journal, and specialty were computed. Within journals, contrasts between the 4 other specialties (immunology, endocrinology, gastroenterology, and pulmonology) and neurology were estimated, averaging over years, and are displayed as ratios with 95% CIs, adjusted for multiple testing using the multivariate t-distribution method. 14 All tests were 2-tailed, and analyses were conducted in R version 4.0.4 (R Project for Statistical Computing).

Results
The

Comparison of the Yearly Number of Publications Between Neurology and Other Specialties
The

Discussion
Our results indicate that NEJM published the most neurology studies compared with other GMJs.
GMJs tend to publish neurology articles more than other specialties; the exception to this was PLOS Medicine, which published immunology most frequently of the specialties we studies.  It is apparent that the top GMJs have higher JIFs than neurology-focused journals. In our study, the range, mean, and median JIFs for the top 5 GMJs were 11.7 to 79.3, 43.1, and 47.7, respectively. In 5 of the top neurology journals by JIF (Lancet Neurology, JAMA Neurology, Brain, Annals of Neurology,

JAMA Network Open | Medical Journals and Publishing
and Neurology), the range, mean, and median JIF were 3.1 to 27.1, 8.7, and 4.0, respectively. This trend is not limited to the specialty of neurology. For example, a bibliometric study examining the publication patterns of OBGYN articles found that the top-cited articles published in nonspecialty journals were more frequently cited than those in OBGYN journals. 12 One reason that is likely driving higher JIFs in GMJs vs neurology-focused journals, and is a reason for authors to preferentially publish in these journals, is that the neurology articles published in GMJs tend to be applicable to clinicians and researchers other than neurologists.
It was noteworthy that NEJM did not publish any systematic reviews. This is consistent with a prior analysis of the prevalence of review articles in GMJs, 16 which demonstrated that NEJM did publish narrative reviews but did not publish any systematic reviews. Unlike the other 4 journals examined in our study that did publish systematic reviews, NEJM does not endorse the Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) reporting guideline. 17,18 There was a decrease in the number of publications of neurology (and other subspecialties) with decreasing JIF. This likely is likely because GMJs journals such as NEJM, JAMA, and Lancet all have higher JIFs than specialty journals, including neurology-specific journals. However, with decreasing impact factors, authors essentially have more choice. While they could submit to PLOS Medicine, with a JIF of 11.7, they could also choose to submit to a neurology-specific journal with a similar or even higher impact factor (eg, JAMA Neurology has an impact factor of 12.3). 19 There are many factors for neurology researchers to consider when deciding where to publish their work. Researchers typically want their research to reach both a large and interested audience, which can be accomplished by publishing in a journal with a high JIF and whose scope is relevant to the topic of the publication, respectively. Whether the JIF or the scope of the journal is more important is likely highly variable among individual researchers and the nature of the publication.
Further qualitative research may help to elucidate the most important factors used by authors to determine where to publish their neurology-based research.

Limitations
Our study has limitations. One limitation of our study, inherent to any bibliometric approach, was that we did not examine individual article records, except those in the random sample we examined to verify the accuracy of indexing. Rather, we relied on indexing in MEDLINE for classifications.
Nonetheless, accuracy of the 5% sample we manually verified was very high, and thus, we can be confident that the results achieved through bibliometric methods are a true reflection of the GMJ literature. It also would have been interesting to see which neurological subspecialties were most heavily represented in high-impact GMJs, although this analysis is beyond the scope of the present study.
Using the JIF to select the 5 most cited GMJs has both advantages and limitations. JIF is widely used because it is an established metric that allows for comparison of journal impact within disciplines and is designed to reduce bias toward larger journals that publish more articles annually.
The main limitation of the JIF is that it does not reflect the number of citations (or impact) of individual articles but rather the number of citations of the journal. In this sense, highly cited articles published in journals with low JIF are deemed to have a lower impact in the literature than articles with fewer citations published in journals with higher JIF. Similarly, individual articles can make a disproportionate contribution to the overall JIF; as such, the JIF may not provide the most accurate assessment of the quality of the individual articles that are published within a journal. Additionally, JIF does not consider journals citing their own publications (ie, self-citation) and the context of the citation (ie, positive vs negative citation).

Conclusions
In this study, neurology articles were published most often in NEJM, and more neurology articles were published in GMJs than other medical specialties. These results may provide some guidance to