Skip to main content
Log in

The dark side of open access in Google and Google Scholar: the case of Latin-American repositories

  • Published:
Scientometrics Aims and scope Submit manuscript

Abstract

Since repositories are a key tool in making scholarly knowledge open access (OA), determining their web presence and visibility on the Web (both are proxies of web impact) is essential, particularly in Google (search engine par excellence) and Google Scholar (a tool increasingly used by researchers to search for academic information). The few studies conducted so far have been limited to very specific geographic areas (USA), which makes it necessary to find out what is happening in other regions that are not part of mainstream academia, and where repositories play a decisive role in the visibility of scholarly production. The main objective of this study is to ascertain the web presence and visibility of Latin American repositories in Google and Google Scholar through the application of page count and web mention indicators respectively. For a sample of 137 repositories, the results indicate that the indexing ratio is low in Google, and virtually nonexistent in Google Scholar; they also indicate a complete lack of correspondence between the repository records and the data produced by these two search tools. These results are mainly attributable to limitations arising from the use of description schemas that are incompatible with Google Scholar (repository design) and the reliability of web mention indicators (search engines). We conclude that neither Google nor Google Scholar accurately represent the actual size of OA content published by Latin American repositories; this may indicate a non-indexed, hidden side to OA, which could be limiting the dissemination and consumption of OA scholarly literature.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1

Similar content being viewed by others

Notes

  1. http://www.budapestopenaccessinitiative.org (accessed 15 March 2014).

  2. http://oa.mpg.de/lang/en-uk/berlin-prozess/berliner-erklarung (accessed 15 March 2014).

  3. http://www.opendoar.org/index.html (accessed 15 March 2014).

  4. http://arxiv.org (accessed 15 March 2014).

  5. http://repec.org (accessed 15 March 2014).

  6. http://dspace.mit.edu (accessed 15 March 2014).

  7. E-Expectations research reports. http://omniupdate.com/resources/research.html (accessed 15 March 2014).

  8. http://repositories.webometrics.info (accessed 15 March 2014).

  9. http://www.majesticseo.com (accessed 15 March 2014).

  10. http://ahrefs.com (accessed 15 March 2014).

  11. http://blekko.com (accessed 15 March 2014).

  12. Supplementary data will be uploaded into an institutional repository, consigning here final URI.

  13. http://www.opensiteexplorer.org (accessed 15 March 2014).

  14. Of the 127 URLs analysed, page count data were not obtained for five, which have not been taken into account for the rest of the calculations: <bibliotecavirtual.unl.edu.ar>, <memoria.fahce.unlp.edu.ar>, <repositorio.utm.edu.ec>, <dspace.conicyt.cl/ri20> y <cartapacio.edu.ar>.

  15. http://www.google.com/patents/US8589784 (accessed 15 March 2014).

References

  • Aguillo, I. F. (2009). Measuring the institutions’ footprint in the web. Library Hi Tech, 27(4), 540–556.

    Article  Google Scholar 

  • Aguillo, I. F. (2011). Building web indicators for the EU OA repository. Workshop on new research lines in informetrics (España).

  • Aguillo, I. F., & Granadino, B. (2006). Indicadores web para medir la presencia de las universidades en la Red. RUSC: Revista de universidad y sociedad del conocimiento, 3(1), 68–75.

    Google Scholar 

  • Aguillo, I. F., Ortega, J. L., Fernandez, M., & Utrilla, A. M. (2010). Indicators for a webometric ranking of open Access repositories. Scientometrics, 82(3), 477–486.

    Article  Google Scholar 

  • Archambault, E., Amyot, D., Deschamps, P., Nicol, A., Rebout, L. & Roberge, G. (2013). Proportion of open access peer-reviewed papers at the european and world. Science-Metrix [Technical report]. http://www.science-metrix.com/pdf/SM_EC_OA_Availability_2004-2011.pdf Accessed 15 March 2014.

  • Arlitsch, K., & O’Brian, P. S. (2012). Invisible institutional repositories: Addressing the low indexing ratios of IRs in Google. Library Hi Tech, 30(1), 60–81.

    Article  Google Scholar 

  • Arlitsch, K., O’Brian, P. S., & Rossmann, B. (2013). Managing search engine optimization: An introduction for library administrators. Journal of Library Administrators, 53(2–3), 177–188.

    Article  Google Scholar 

  • Armbruster, C., & Romary, L. (2010). Comparing repository types-challenges and barriers for subject-based repositories, research repositories, national repository systems and institutional repositories in serving scholarly communication. International Journal of Digital Library Systems, 1(4), 61–73.

    Article  Google Scholar 

  • Björk, B.-C. (2014). Open access subject repositories: An overview. Journal of the Association for Information Science and Technology, 65(4), 698–706.

    Article  MATH  Google Scholar 

  • Björk, B. C., Welling, P., Laakso, M., Majlender, P., Hedlund, T., & Gudnason, G. (2010). Open access to the scientific journal literature: Situation 2009. PLoS One, 5(6). http://www.plosone.org/article/info%3Adoi%2F10.1371%2Fjournal.pone.0011273 Accessed 15 March 2014.

  • Burns, C. S. (2013). Free or open access to scholarly documentation: Google Scholar or academic libraries. University of Missouri.

  • Calderón-Martínez, A., & Ruiz-Conde, E. (2013). The participation and web visibility of university digital repositories in the European context. Comunicar, 20(40), 193–201.

    Article  Google Scholar 

  • Chan, L. (2004). Supporting and enhancing scholarship in the digital age: The role of open access institutional repository. Canadian Journal of Communication, 29(3), 277–300.

    Google Scholar 

  • Cook, C., Heath, F., Thomson, B., Davis, M., Kyrillidou, M. & Roebuck, G. (2009). LibQual + 2009 Survey. Association of Research Libraries [technical report]. http://www.libqual.org/documents/admin/ARL_Notebook_2009.pdf Accessed 15 March 2014.

  • Cox, J., & Cox, L. (2003). Scholarly publishing practice: The ALPSPS report on academic journal publishers’ policies and practices in online publishing. London (England): Association of Learned and Professional Society Publishers.

    Google Scholar 

  • Crow, R. (2002). The Case for Institutional Repositories: a SPARC Position Paper. Association of Research Libraries [technical report, n. 223]. http://www.sparc.arl.org/sites/default/files/media_files/instrepo.pdf Accessed 30 April 2014.

  • De Rosa, C., & OCLC. (2005). Perceptions of libraries and information resources; a report to the OCLC membership. Dublin, OH: OCLC Online Computer Library Center.

    Google Scholar 

  • Delgado López-Cózar, E. & Robinson-García, N. (2012). Repositories in Google Scholar Metrics: what is this document type doing in a place as such. Cybermetrics, v. 16. http://cybermetrics.cindoc.csic.es/articles/v16i1p4.pdf Accessed 15 March 2014.

  • Galina, I. (2011). La visibilidad de los recursos académicos: una revisión crítica del papel de los repositorios institucionales y el acceso abierto. Investigación Bibliotecológica, 25(53), 159–183.

    MathSciNet  Google Scholar 

  • Griffiths, J. R., & Brophy, P. (2005). Student searching behavior and the Web: Use of academic resources and Google. Library Trends, 53(4), 545.

    Google Scholar 

  • Haglund, L., & Olsson, P. (2008). The impact on university libraries of changes in information behavior among academic researchers: a multiple case study. The Journal of Academic Librarianship, 34(1), 52.

    Article  Google Scholar 

  • Harnad, S., Brody, T., Vallières, F., Carr, L., Hitchcock, S., Gingras, Y., et al. (2004). The access/impact problem and the green and gold roads to open access. Serial Review, 30(4), 310–314.

    Article  Google Scholar 

  • Herrera, G. (2011). Google Scholar users and user behaviours: an exploratory study. College and Research Libraries, 72(4), 316–330.

    Article  MathSciNet  Google Scholar 

  • Hixson, C.G. (2005). First we build them, then what?: The future of institutional repositories. BiD, Textos Universitaris de Biblioteconomia i Documentació, (15). http://bid.ub.edu/15hixso2.htm Accessed 30 April 2014.

  • Holmberg, K. (2010). Web impact factors- a significant contribution to webometric research. In B. Larssen, J. W. Schneider, & F. Åstrom (Eds.), The Janus facet scholar: a festschrift in honour of Peter Ingwersen (pp. 127–134). Copenhaghe: Royal School of Library and Information Science.

    Google Scholar 

  • Kling, R., & McKim, G. (2000). Not just a matter of time: Field differences and the shaping of electronic media in supporting scientific communication. Journal of the American Society for Information Science and Technology, 51(14), 1306–1320.

    Article  Google Scholar 

  • Lynch, C. (2003). Institutional repositories: Essential infrastructure for scholarship in the digital age. ARL Bimonthy Report 226, 1–16. Available at http://www.arl.org/storage/documents/publications/arl-br-226.pdf. Accessed 02 July 2014.

  • Mas-Bleda, A., Thelwall, M., Kousha, K., & Aguillo, I. F. (2014). Successful researchers publicizing research online: an outlink analysis of European highly cited scientists’ personal websites. Journal of Documentation, 70(1), 148–172.

    Article  Google Scholar 

  • Orduña-Malea, E. (2012). Propuesta de un modelo de análisis redinformétrico multinivel para el estudio sistémico de las universidades (2010). Valencia: Universidad Politécnica de Valencia [unpublished doctoral dissertation].

  • Orduña-Malea, (2013). Aggregation of the web performance of internal university units as a method of quantitative analysis of a university system: the case of Spain. Journal of the American Society for Information Science and Technology, 64(10), 2100–2114.

    Article  Google Scholar 

  • Orduña-Malea, E., & Regazzi, J. J. (2014). US academic libraries: understanding their web presence and their relationship with economic indicators. Scientometrics, 98(1), 315–336.

    Article  Google Scholar 

  • Ortega, J. L., Orduña-Malea, E., & Aguillo, I. F. (2014). Influence of language and file type on the web visibility of top European universities. Aslib Proceedings, 66(1), 96–116.

    Google Scholar 

  • Pinfield, S., Salter, J., Bath, P.A., Hubbard, B., Millington, P., Anders, J.H.S. & Hussain, A. (2014). Open-access repositories worldwide, 2005–2012: Past growth, current characteristics and future possibilities. Journal of the Association for Information Science and Technology. doi:10.1002/asi.23131

  • Ruiz-Conde, E., & Calderón-Martinez, A. (2014). University institutional repositories: competitive environment and their role as communication media of scientific knowledge. Scientometrics, 98(2), 1283–1299.

    Article  Google Scholar 

  • Sato, S., & Itsumura, H. (2011). How do people use open access papers in non-academic activities? A link analysis of papers deposited in institutional repositories. Library, Information and Media Studies, 9(1), 51–64.

    Google Scholar 

  • Scholze, F. (2007). Measuring research impact in an open access environment. Liber Quarterly: The Journal of European Research Libraries, 17(1–4), 220–232.

    Google Scholar 

  • Schonfeld, Roger C. & Housewright, R. (2010). Faculty Survey 2009: Key Strategic insights for libraries, publishers, and societies (Ithaka S + R, Apr. 7, 2010): 7. http://www.sr.ithaka.org/research-publications/us-faculty-survey-2009 Accessed 15 March 2014.

  • Smith, A. G. (2011). Wikipedia and institutional repositories: An academic symbiosis? Proceedings of the ISSI 2011 Conference. Durban (South Africa), 794-800.

  • Smith, A. G. (2012). Webometric evaluation of institutional repositories. Proceedings of the 8th International Conference on Webometrics Informetrics and Scientometrics & 13th Collnet Meeting. Seoul (Korea), pp. 722-729.

  • Smith, A.G. (2013). Web Based Impact Measures for Institutional Repositories. Proceedings of the ISSI 2013 conference. Viena (Austria), 1806–1816.

  • Thelwall, M. (2004). Link analysis: An information science approach. Amsterdam: Elsevier.

    Google Scholar 

  • Thelwall, M., & Sud, P. (2011). A comparison of methods for collecting web citation data for academic organisations. Journal of the American Society for Information Science and Technology, 62(8), 1488–1497.

    Article  Google Scholar 

  • Zuccala, A., Oppenheim, C. & Dhiensa, R. (2008). Managing and evaluating digital repositories. Information research, 13(1). http://informationr.net/ir/13-1/paper333.html Accessed 15 March 2014.

  • Zuccala, A., Thelwall, M., Oppenheim, C., & Dhiensa, R. (2007). Web intelligence analyses of digital libraries: A case study of the national electronic library for health (NeLH). Journal of Documentation, 63(4), 558–589.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Enrique Orduña-Malea.

Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary material 1 (PDF 93 kb)

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Orduña-Malea, E., Delgado López-Cózar, E. The dark side of open access in Google and Google Scholar: the case of Latin-American repositories. Scientometrics 102, 829–846 (2015). https://doi.org/10.1007/s11192-014-1369-5

Download citation

  • Received:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11192-014-1369-5

Keywords

Navigation