Abstract
A central tenet in support of research reproducibility is the ability to uniquely identify research resources, i.e., reagents, tools, and materials that are used to perform experiments. However, current reporting practices for research resources are insufficient to identify the exact resources that are reported or to answer basic questions such as “How did other studies use resource X?” To address this issue, the Resource Identification Initiative was launched as a pilot project to improve the reporting standards for research resources in the methods sections of papers and thereby improve identifiability and scientific reproducibility. The pilot engaged over 25 biomedical journal editors from most major publishers, as well as scientists and funding officials. Authors were asked to include Research Resource Identifiers (RRIDs) in their manuscripts prior to publication for three resource types: antibodies, model organisms, and tools (i.e., software and databases). RRIDs are assigned by an authoritative database, for example a model organism database, for each type of resource. To make it easier for authors to obtain RRIDs, resources were aggregated from the appropriate databases and their RRIDs made available in a central web portal (http://scicrunch.org/resources). RRIDs meet three key criteria: they are machine readable, free to generate and access, and are consistent across publishers and journals. The pilot was launched in February of 2014 and over 300 papers have appeared that report RRIDs. The number of journals participating has expanded from the original 25 to more than 40 with RRIDs appearing in 62 different journals to date. Here, we present an overview of the pilot project and its outcomes to date. We show that authors are able to identify resources and are supportive of the goals of the project. Identifiability of the resources post-pilot showed a dramatic improvement for all three resource types, suggesting that the project has had a significant impact on identifiability of research resources.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Bandrowski, A., Tan, S., & Hof, P. R. (2014). Promoting research resource identification at JCN. Journal of Comparative Neurology, 522(8), 1707.
Button, K. S., Ioannidis, J. P., Mokrysz, C., Nosek, B. A., Flint, J., Robinson, E. S., & Munafò, M. R. (2013). Power failure: why small sample size undermines the reliability of neuroscience. Nature Review Neuroscience, 14, 365–376.
Cone, A. C., Ambrosi, C., Scemes, E., Martone, M. E., & Sosinsky, G. E. (2013). A comparative antibody analysis of pannexin1 expression in four rat brain regions reveals varying subcellular localizations. Frontiers in Pharmacology, 4, 6.
Gardner, D., Akil, H., Ascoli, G. A., Bowden, D. M., Bug, W., Donohue, D. E., Goldberg, D. H., Grafstein, B., Grethe, J. S., Gupta, A., Halavi, M., Kennedy, D. N., Marenco, L., Martone, M. E., Miller, P. L., Müller, H. M., Robert, A., Shepherd, G. M., Sternberg, P. W., van Essen, D. C., & Williams, R. W. (2008). The neuroscience information framework: a data and knowledge environment for neuroscience. Neuroinformatics, 6, 149–160.
Gronenschild, E. H., Habets, P., Jacobs, H. I., Mengelers, R., Rozendaal, N., van Os, J., & Marcelis, M. (2012). The effects of FreeSurfer version, workstation type, and macintosh operating system version on anatomical volume and cortical thickness measurements. PLoS One, 7, e38234.
Herkenham, M., Rathore, P., Brown, P., & Listwak, S. J. (2011). Cautionary notes on the use of NF-κB p65 and p50 antibodies for CNS studies. Journal of Neuroinflammation, 8, 141.
Hupé, J. M. (2015). Statistical inferences under the null hypothesis: common mistakes and pitfalls in neuroimaging studies. Frontiers in Neuroscience, 9, 18.
ICLAC. (2015). Cell line cross-contamination: WSU-CLL is a known derivative of REH and is unsuitable as a model for chronic lymphocytic leukaemia. Leukemia Research, 38, 999–1001.
Listwak, S. J., Rathore, P., & Herkenham, M. (2013). Minimal NF-κB activity in neurons. Neuroscience, 250, 282–299.
MacLaren, D. A., Markovic, T., Daniels, D., & Clark, S. D. (2015). Enhanced consumption of salient solutions following pedunculopontine tegmental lesions. Neuroscience, 284, 381–399.
Marenco, L. N., Wang, R., Bandrowski, A. E., Grethe, J. S., Shepherd, G. M., & Miller, P. L. (2014). Extending the NIF DISCO framework to automate complex workflow: coordinating the harvest and integration of data from diverse neuroscience information resources. Frontiers in Neuroinformatics, 8, 58.
McIntyre, N. J., Fluck, R., McIntyre, C., & Taal, M. (2012). Treatment needs and diagnosis awareness in primary care patients with chronic kidney disease. British Journal of General Practice, 62, e227–e232.
Slotta, C., Müller, J., Tran, L., Hauser, S., Widera, D., Kaltschmidt, B., & Kaltschmidt, C. (2014). An investigation of the specificity of research antibodies against NF-κB-subunit p65. Journal of Histochemistry and Cytochemistry, 62, 157–161.
Vasilevsky, N. A., Brush, M. H., Paddock, H., Ponting, L., Tripathy, S. J., Larocca, G. M., & Haendel, M. A. (2013). On the reproducibility of science: unique identification of research resources in the biomedical literature. PeerJ, 1, e148.
Acknowledgments
We would like to thank John Maunsell for his effort in getting this effort going and helpful comments on the paper, as well as the many other editors who wrote letters to their authors and the staff at various publishers and many other community projects that wrote blogs and press releases about this initiative. We would also like to thank NIH and INCF for providing the venues and vision for this pilot project, specifically Dr. Jonathan Pollock, who drove the workshop and saw early the need to bring this particular group together around a central goal of better identification of research resources. We thank ZFIN, who recognized the need for an RRID system and provided inspiration for this project. We would also like to thank Laura Ponting for her help with curating the drosophila strains.
Author information
Authors and Affiliations
Consortia
Corresponding author
Additional information
This article is simultaneously published in Journal of Comparative Neurology (DOI: 10.1002/cne.23913), F1000Research (DOI: 10.12688/f1000research.6555.2), and Brain and Behavior (DOI: 10.1002/brb3.417)
Electronic supplementary material
Below is the link to the electronic supplementary material.
ESM 1
(XLSX 218 kb)
Rights and permissions
About this article
Cite this article
Bandrowski, A., Brush, M., Grethe, J.S. et al. The Resource Identification Initiative: A Cultural Shift in Publishing. Neuroinform 14, 169–182 (2016). https://doi.org/10.1007/s12021-015-9284-3
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12021-015-9284-3