The effects of Open Access (OA) upon journal performance are investigated. The key research question holds: How does the citation impact and publication output of journals switching (“flipping”) from non-OA to Gold-OA develop after their switch to Gold-OA? A review is given of the literature, with an emphasis on studies dealing with flipping journals. Two study sets with 119 and 100 flipping journals, derived from two different OA data sources (DOAJ and OAD), are compared with two control groups, one based on a standard bibliometric criterion, and a second controlling for a journal’s national orientation. Comparing post-switch indicators with pre-switch ones in paired T-tests, evidence was obtained of an OA Citation advantage but not of an OA Publication Advantage. Shifts in the affiliation countries of publishing and citing authors are characterized in terms of countries’ income class and geographical world region. Suggestions are made for qualitative follow-up studies to obtain more insight into OA flipping or reverse-flipping.
This is a preview of subscription content, log in to check access.
Buy single article
Instant access to the full article PDF.
Price includes VAT for USA
The Scopus Source List contains information on the OA status at the level of journals, derived from DOAJ. As from 02/01/2018, Scopus contains data on OA status at the level of individual articles, based on an analysis conducted by the Scopus team in collaboration with CrossRef. The Article Level Open Access indicator identifies articles both in Gold OA journals and in hybrid journals. (https://blog.scopus.com/posts/what-s-new-on-scopus-article-level-open-access-indicator-now-at-the-article-level-and-other). ImpactStory’s UnPaywall posted on its website https://blog.ourresearch.org/elsevier-data-feed/ already in July 2018 the following message: “We’re pleased to announce that Elsevier has become the newest customer of Impactstory’s Unpaywall Data Feed, which provides a weekly feed of changes in Unpaywall, our open database of 20 million open access articles. It is uncertain whether UnPayWall-based data were used in Scopus at the date the data for the current study were collected” (End of December 2019). Akbaritabar and Stahlschmidt (2019) compared Scopus with Unpaywall, and concluded that “Only about 70% of articles and reviews from WOS and Scopus could be matched via a DOI to Unpaywall” (Akbaritabar and Stahlschmidt 2019, p. 1).
Akbaritabar, A., & Stahlschmidt, S. (2019). Merits and Limits: Applying open data to monitor open access publications in bibliometric databases. arXiv preprint arXiv:1902.03937.
Archambault, É., Amyot, D., Deschamps, P., Nicol, A., Provencher, F., Rebout, L., & Roberge, G. (2014). Proportion of open access papers published in peer-reviewed journals at the European and world levels—1996–2013. European Commission. http://science-metrix.com/sites/default/files/science-metrix/publications/d_1.8_sm_ec_dg-rtd_proportion_oa_1996-2013_v11p.pdf.
Björk, B. (2019). Open access journal publishing in the Nordic countries. Learned Publishing,32(3), 227–236. https://doi.org/10.1002/leap.1231.
BOAI (2002). Budapest open access initiative. https://www.budapestopenaccessinitiative.org/.
Busch, S. (2014). The careers of converts—how a transfer to BioMed Central affects the Impact Factors of established journals. Retrieved March 9, 2020, from BioMed Central Blog website: https://blogs.biomedcentral.com/bmcblog/2014/01/15/the-careers-of-converts-how-a-transfer-to-biomed-central-affects-the-impact-factors-of-established-journals/.
Busch, S. (2014). The Impact Factor of journals converting from subscription to open access. Retrieved March 9, 2020, from BioMed Central Blog website: https://blogs.biomedcentral.com/bmcblog/2014/11/06/the-impact-factor-of-journals-converting-from-subscription-to-open-access/
Copiello, S. (2019). The open access citation premium may depend on the openness and inclusiveness of the indexing database, but the relationship is controversial because it is ambiguous where the open access boundary lies. Scientometrics,121, 995–1018. https://doi.org/10.1007/s11192-019-03221-w.
Craig, I. D., Plume, A. M., McVeigh, M. E., Pringle, J., & Amin, M. (2007). Do open access articles have greater citation impact? A critical review of the literature. Journal of Informetrics,1(3), 239–248.
Dallmeier-Tiessen, S., Goerner, B., Darby, R., Hyppoelae, J., Igo-Kemenes, P., Kahn, D., Lambert S., Lengenfelder, A., Leonard, C., Mele, S., Polydoratou, P., Ross, D., Ruiz-Pérez, S., Schimmer, R., Swaisland, M., van der Stelt, W. (2010). Open Access Publishing - Models and Attributes. 2010. 62. https://edoc.mpg.de/478647. Accessed 9 Mar 2020.
Davis, P. M., Lewenstein, B. V., Simon, D. H., Booth, J. G., & Connolly, M. J. L. (2008). Open access publishing, article downloads, and citations: Randomised controlled trial. BMJ,337(7665), 343–345. https://doi.org/10.1136/bmj.a568.
De-Moya-Anegón, F., Guerrero-Bote, V.P., & Herrán-Páez, E. (2020). Cross-national comparison of Open Access models: A cost/benefit analysis. Festschrift in the honour of Henk F. Moed, Springer (to be published).
DOAJ. (2019). Directory of open access journals. www.doaj.org.
Gargouri, Y., Hajjem, C., Larivière, V., Gingras, Y., Carr, L., Brody, T., et al. (2010). Self-selected or mandated, open access increases citation impact for higher quality research. PLoS ONE,5(10), e13636. https://doi.org/10.1371/journal.pone.0013636.
Holmberg, K., Hedman, J., Bowman, T. D., Didegah, F., & Laakso, M. (2020). Do articles in open access journals have more frequent altmetric activity than articles in subscription-based journals? An investigation of the research output of Finnish universities. Scientometrics,122(1), 645–659. https://doi.org/10.1007/s11192-019-03301-x.
Hua, F., Sun, H., Walsh, T., Worthington, H., & Glenny, A.-M. (2016). Open access to journal articles in dentistry: Prevalence and citation impact. Journal of Dentistry,47, 41–48. https://doi.org/10.1016/j.jdent.2016.02.005.
Lawrence, S. (2001). Free online availability substantially increases a paper's impact. Nature,411, 521. https://doi.org/10.1038/35079151.
Leta, J., dos Santos, H., Weitzel S. (2019). Open access journals and the adherence of the elite of Brazilian researchers. In the 17th International Conference on Scientometrics & Informetrics (ISSI 2019), Rome (Italy), Volume II, pp. 1759–1769 (ISBN 978-88-3381-118-5).
Lewis, C. (2018). The open access citation advantage: Does it exist and what does it mean for libraries? Information Technology and Libraries,37(3), 50–65. https://doi.org/10.6017/ital.v37i3.10604.
Matthias, L., Jahn, N., & Laakso, M. (2019). The two-way street of open access journal publishing: Flip it and reverse it. Publications,7(2), 23. https://doi.org/10.3390/publications7020023.
McCabe, M. J., & Snyder, C. M. (2015). Does online availability increase citations? Theory and evidence from a panel of economics and business journals. Review of Economics and Statistics,97(1), 144–165. https://doi.org/10.1162/REST_a_00437.
McKiernan, E. C., Bourne, P. E., Brown, C. T., Buck, S., Kenall, A., Lin, J., et al. (2016). How open science helps researchers succeed. Elife,5, e16800.
McKiernan, E. C., Bourne, P. E., Brown, C. T., Buck, S., Kenall, A., Lin, J., et al. (2016). How open science helps researchers succeed. ELife. https://doi.org/10.7554/eLife.16800.
Moed, H. F., de Moya-Anegon, F., Guerrero-Bote, V., & Lopez-Illescas, C. (2020). Are nationally oriented journals indexed in Scopus becoming more international? The effect of publication language and access modality. Journal of Informetrics,14(2), 101011.
Momeni, F., Fraser, N., Peters, I., & Mayr, P. (2019). From closed to open access: A case study of flipped journals. arXiv preprint arXiv:1903.11682.
Morrison, H. (2008). Directory of Open Access Journals (DOAJ). Doctoral dissertation, University of British Columbia.
Piwowar, H., Priem, J., Larivière, V., Alperin, J. P., Matthias, L., Norlander, B., et al. (2018). The state of OA: A large-scale analysis of the prevalence and impact of Open Access articles. PeerJ,6, e4375. https://doi.org/10.7717/peerj.4375.
Pölönen, J., Kulczycki, E., Laakso, M., & Sivertsen, G. (2019). Open access challenge at the national level: Comprehensive analysis of publication channels used by Finnish researchers in 2016–2017. In the 17th International Conference on Scientometrics and Informetrics, ISSI 2019 - Proceedings Volume 2, 2019, Rome (Italy), Volume II, pp. 1776–1787 (ISBN 978-88-3381-118-5)
Rimmert C, Bruns A, Lenke C, Taubert NC. (2017). ISSN-Matching of Gold OA Journals (ISSN-GOLD-OA) 2.0. Bielefeld University.
Scopus. (2019). Scopus source title list. Version May 2019. https://www.elsevier.com/solutions/scopus/how-scopus-works/content.
Sivertsen, G., Guns, R., Kulczycki, E., & Pölönen, J. (2019). The use of Gold Open Access in four European countries: An analysis at the level of articles. In the 17th International Conference on Scientometrics and Informetrics, ISSI 2019—Proceedings Volume 2, 2019, Rome (Italy), Volume II, pp. 1600–1604 (ISBN 978-88-3381-118-5).
Solomon, D. J., Laakso, M., & Björk, B. C. (2013). A longitudinal comparison of citation rates and growth among open access journals. Journal of Informetrics,7(3), 642–650. https://doi.org/10.1016/j.joi.2013.03.008.
Sotudeh, H., & Horri, A. (2007). Tracking open access journals evolution: Some considerations in open access data collection validation. Journal of the American Society for Information Science and Technology,58(11), 1578–1585. https://doi.org/10.1002/asi.20639.
Sotudeh, H., Ghasempour, Z., & Yaghtin, M. (2015). The citation advantage of author-pays model: The case of Springer and Elsevier OA journals. Scientometrics,104(2), 581–608. https://doi.org/10.1007/s11192-015-1607-5.
Swan, A. (2010). The open access citation advantage: Studies and results to date. Retrieved from eprints.soton.ac.uk: https://eprints.soton.ac.uk/268516/.
World Bank (2019). New country classifications by income level: 2019–2020. https://blogs.worldbank.org/opendata/new-country-classifications-income-level-2019-2020.
About this article
Cite this article
Bautista-Puig, N., Lopez-Illescas, C., de Moya-Anegon, F. et al. Do journals flipping to gold open access show an OA citation or publication advantage?. Scientometrics 124, 2551–2575 (2020). https://doi.org/10.1007/s11192-020-03546-x
- Open access
- Publishing model
- Citation analysis
- Paired t-test
- Effects of OA
- OA flipping