Evaluation of the quality and subsequent performance of manuscripts rejected by Clinical Rheumatology: a research report

Abstract

Objectives: To assess the quality and performance of manuscripts previously rejected by a rheumatology-focused journal.

Methods: This was a cross-sectional, audit-type, exploratory study of manuscripts submitted to Clinical Rheumatology (CLRH) and rejected by one associate editor in 2019. We used a 36-item quality assessment instrument (5-point ordinal scale, 1 being worst). Performance variables included whether a rejected manuscript was published in another PubMed-listed journal, impact factor of the publishing journal (Scimago), number of citations (Web of Science), and social media attention (Altmetrics). Exploratory variables included authors' past publications, use of reporting guidelines, and text structure. Exploratory variables were assessed using non-parametric tests.

Results: In total, 165 manuscripts were rejected. Reporting guidelines were used in only five (4%) manuscripts. The mean overall quality rating was 2.48 ± 0.73, with 54% of manuscripts rated 2; 40-80% were rated < 3 on crucial items. Over a 26-month follow-up, 79 (48%) rejected manuscripts were published in other journals, mostly with lower impact factors; 70% of these had at least one citation, compared with 90.5% for manuscripts published in CLRH. Altmetrics was significantly lower for manuscripts published elsewhere than for those published in CLRH. As for text structure, the methods and results sections were shorter and the discussion longer than suggested. The corresponding authors' past experience and text structure were not associated with quality or acceptance.

Conclusions: Research report quality is an area for improvement, mainly for items critical to explaining the research and findings. The use of reporting guidelines should be encouraged by journals. Key Points • The quality of research reports (in rejected manuscripts) is insufficient. • Guidelines for reporting are seldom used in rejected manuscripts. • A manuscript rejected by Clinical Rheumatology may subsequently be published in another journal with a lower impact factor and have fewer citations and less social media attention than accepted manuscripts.

Keywords: Editorial policies; Journal impact factor; Manuscripts, medical as topic*; Peer review, research; Publishing/statistics & numerical data*; Rheumatology/statistics & numerical data.