Background: Due to the impact of coronavirus disease 2019 (COVID-19), a significant number of COVID-related papers have been published. The journal citation report (JCR) of Web of Science, released in June 2022 and 2023, demonstrated that the journal impact factors (JIFs) of biomedical journals have increased substantially. Methods: This study examined two traditional multidisciplinary journals (Science and Nature) and four medical journals (The Journal of the American Medical Association [JAMA], The Lancet [LANCET], The New England Journal of Medicine [NEJM], and British Medical Journal [BMJ]). The influence of COVID-related papers on JIFs was analyzed using bibliometric methods. Results: The proportion of citations in 2021 to items published in 2020 was notably high, with five journals exceeding 50%. Similarly, the proportion of citations in 2022 to items published in 2020 and the proportion of citations in 2022 to items published in 2021 remained high, although exhibiting a gradual downward trend. Conclusion: The JIFs of the four medical journals were higher than those of the top traditional multidisciplinary journals Science and Nature by a wide margin. This discrepancy could be attributed to the larger denominators (citable items) in the JIF calculations for Science and Nature or other factors. However, in terms of average citations per paper, there was no evidence that Science and Nature performed worse than the medical journals. Emerging hot topics, such as COVID-19, tend to elevate JIFs considerably. However, it is important to adopt a rational perspective on these surges. The publication of scientific and technological papers should prioritize advancing human knowledge through academic exchange rather than focusing solely on JIFs values.

1. Mulcahy MB, Miller KA, Elston H. Impact factor: friend or foe? ACS Chem Health Saf. 2021;28(5):291-292.    DOI: 10.1021/acs.chas.1c00081

2. Wáng YXJ, Arora R, Choi Y, et al. Implications of Web of Science journal impact factor for scientific output evaluation in 16 institutions and investigators' opinion. Quant Imaging Med Surg. 2014;4(6):453-461.    DOI: 10.3978/j.issn.2223-4292.2014.11.16

3. The PLoS Medicine Editors. The impact factor game. It is time to find a better way to assess the scientific literature. PLoS Med. 2006;3(6):e291.    DOI: 10.1371/journal.pmed.0030291

4. Zhang L, Rousseau R, Sivertsen G. Science deserves to be judged by its contents, not by its wrapping: revisiting Seglen’s work on journal impact and research evaluation. PLoS One. 2017;12(3):e0174205.    DOI: 10.1371/journal.pone.0174205

5. Fischer I, Steiger HJ. Dynamics of journal impact factors and limits to their inflation. J Schol Publ. 2018;50(1):26-36.    DOI: 10.3138/JSP.50.1.06

6. Manley S. Letters to the editor and the race for publication metrics. J Assoc Inf Sci Technol. 2022;73(5):702-707.    DOI: 10.1002/asi.24574

7. Falagas ME, Alexiou VG. The top-ten in journal impact factor manipulation. Arch Immunol Ther Exp (Warsz). 2008;56(4):223-226.    DOI: 10.1007/s00005-008-0024-5

8. Neff BD, Olden JD. Not so fast: inflation in impact factors contributes to apparent improvements in journal quality. BioScience. 2010;60(6):455-459.    DOI: 10.1525/bio.2010.60.6.9

9. Caramoy A, Korwitz U, Eppelin A, Kirchhof B, Fauser S. Analysis of aggregate impact factor inflation in ophthalmology. Ophthalmologica. 2013;229(2):113-118.    DOI: 10.1159/000343081

10. Zheng MX, Zhao KJ, Zhao SK, Zhang YT. Effecting variables of journal’s ranking in forestry field. Scientometrics. 2020;125:135-151.    DOI: 10.1007/s11192-020-03629-9

11. Tort ABL, Targino ZH, Amaral OB. Rising publication delays inflate journal impact factors. PLoS One. 2012;7(12):e53374.    DOI: 10.1371/journal.pone.0053374

12. Althouse BM,West JD, Bergstrom CT, et al. Differences in impact factor across fields and over time. J Assoc Inf Sci Technol. 2009;60(1):27-34.    DOI: 10.1002/asi.20936

13. McVeigh ME, Mann SJ. The journal impact factor denominator: defining citable (counted) items. JAMA. 2009;302(10):1107-1109.    DOI: 10.1001/jama.2009.1301

14. Quaderi N. Journal Citation Reports 2022: COVID-19 research continues to drive increased citation impact. Accessed June 22, 2024. https://clarivate.com/blog/journal-citation-reports-2022-covid-19-research-continues-to-drive-increased-citation-impact/

15. Guo XL, Li XX, Yu YG. Publication delay adjusted impact factor: The effect of publication delay of articles on journal impact factor. J Inform. 2021;15(1):101100.    DOI: 10.1016/j.joi.2020.101100

16. Horbach SPJM. Pandemic publishing: Medical journals strongly speed up their publication process for COVID-19. Quant Sci Stud. 2020;1(3):1056-1067.    DOI: 10.1162/qss_a_00076

17. Sevryugina YV, Dicks AJ. Publication practices during the COVID-19 pandemic: expedited publishing or simply an early bird effect? Learn Publ. 2022;30.    DOI: 10.1002/leap.1483

18. Behera BK, Radhakrishnan RV, Mohanty CR, Bellapukonda S. COVID-19 pandemic and its impact on peer review speed of anesthesiology journals: an observational study. J Anaesthesiol Clin Pharmacol. 2021;37(1):57-62.    DOI: 10.4103/joacp.JOACP_652_20

19. González-Hermosillo LM, Roldan-Valadez E. Impact factor JUMPS after the 2020 COVID-19 pandemic: a retrospective study in Dermatology journals. Ir J Med Sci. 2022;3:1-7.    DOI: 10.1007/s11845-022-03179-4

20. Alberts B. Impact factor distortions. Science. 2013;340(6134):787.    DOI: 10.1126/science.1240319

21. Fassin Y. Does the Financial Times FT50 journal list select the best management and economics journals? Scientometrics. 2021;126(7):5911-5943.    DOI: 10.1007/s11192-021-03988-x

22. SCImago Journal & Country Rank. About Us. SJR. Accessed June 22, 2024. https://www.scimagojr.com/aboutus.php

23. The Declaration on Research Assessment. About DORA. DORA. Accessed June 22, 2024. https://sfdora.org/about-dora/

24. Riccaboni M, Verginer L. The impact of the COVID-19 pandemic on scientific research in the life sciences. PLoS One. 2022;17(2):e0263001.    DOI: 10.1371/journal.pone.0263001

25. Delardas O, Giannos P. How COVID-19 affected the journal impact factor of high impact medical journals: bibliometric analysis. J Med Internet Res. 2022;24(12):e43089.    DOI: 10.2196/43089

26. Arrizabalaga O, Otaegui D, Vergara I, Arrizabalaga J, Méndez E. Open Access of COVID-19-related publications in the first quarter of 2020: a preliminary study based in PubMed. F1000Res. 2020;9:649.    DOI: 10.12688/f1000research.24136.2

27. Lozano GA, Lariviere V, Gingras Y. The weakening relationship between the impact factor and papers' citations in the digital age. J Am Soc Inf Sci Technol. 2012;63(11):2140-2145.    DOI: 10.1002/asi.22731

28. Hartley J. Never mind the impact factor: colleagues know better! Learn Publ. 2010;23:63-65.    DOI: 10.1087/20100111

29. Van Noorden R. More than 10,000 research papers were retracted in 2023—a new record. Nature. 2023;624(7992):479-481.    DOI: 10.1038/d41586-023-03974-8

30. Putman MS, Ruderman EM, Niforatos JD. Publication rate and journal review time of COVID-19-related research. Mayo Clin Proc. 2020;95(10):2290-2291.    DOI: 10.1016/j.mayocp.2020.08.017

31. Serio CD, Malgaroli A, Ferrari P, Kenett RS. The reproducibility of COVID-19 data analysis: paradoxes, pitfalls, and future challenges. PNAS Nexus. 2022;1(3):125.    DOI: 10.1093/pnasnexus/pgac125

32. Stefanini G, Sanz-Sanchez J, Piccolo R, et al. Effects of COVID-19 scientific pressure on quality of published evidence. ESC 365; 2020.