Morgan PP. Anonymity in medical journals. Can Med Assoc J. 1984; 131(9):1007–8.
Google Scholar
Pierson CA. Peer review and journal quality. J Am Assoc Nurse Pract. 2018; 30(1).
Wilson JD. Peer review and publication. Presidential address before the 70th annual meeting of the American Society for Clinical Investigation, San Francisco, California, 30 April 1978. J Clin Investig. 1978; 61(6):1697–701. https://doi.org/10.1172/JCI109091.
Google Scholar
Largent EA, Snodgrass RT. In: Robertson CT, Kesselheim AS, (eds).Chapter 5 Blind peer review by academic journals: Academic Press; 2016, pp. 75–95. https://doi.org/10.1016/b978-0-12-802460-7.00005-x.
Klebel T, Reichmann S, Polka J, McDowell G, Penfold N, Hindle S, Ross-Hellauer T. Peer review and preprint policies are unclear at most major journals. BioRxiv. 2020. https://doi.org/10.1101/2020.01.24.918995.
Pontille D, Torny D. The blind shall see! The question of anonymity in journal peer review. Ada: J Gender New Media Technol. 2014; 4. https://doi.org/10.7264/N3542KV.
Ross-Hellauer T. What is open peer review? A systematic review. F1000Research. 2017; 6. https://doi.org/10.12688/f1000research.11369.2.
Baggs JG, Broome ME, Dougherty MC, Freda MC, Kearney MH. Blinding in peer review: the preferences of reviewers for nursing journals. J Adv Nurs. 2008; 64(2):131–8. https://doi.org/10.1111/j.1365-2648.2008.04816.x.
Google Scholar
Haider J, Åström F. Dimensions of trust in scholarly communication: problematizing peer review in the aftermath of John Bohannon’s “Sting” in science. J Assoc Inf Sci Technol. 2016; 68(2):450–67. https://doi.org/10.1002/asi.23669.
Google Scholar
Mulligan A, Hall L, Raphael E. Peer review in a changing world: an international study measuring the attitudes of researchers. J Am Soc Inf Sci Technol; 64(1):132–61. https://doi.org/10.1002/asi.22798.
Moore S, Neylon C, Eve MP, O’Donnell DP, Pattinson D. “Excellence R Us”: university research and the fetishisation of excellence. Palgrave Commun. 2017; 3:16105. https://doi.org/10.1057/palcomms.2016.105.
Google Scholar
Armstrong JS. Peer review for journals: evidence on quality control, fairness, and innovation. Sci Eng Ethics. 1997; 3(1):63–84. https://doi.org/10.1007/s11948-997-0017-3.
Google Scholar
Baxt WG, Waeckerle JF, Berlin JA, Callaham ML. Who reviews the reviewers? Feasibility of using a fictitious manuscript to evaluate peer reviewer performance. Ann Emerg Med. 1998; 32(3):310–7. https://doi.org/10.1016/S0196-0644(98)70006-X.
Google Scholar
D’Andrea R, O’Dwyer JP. Can editors save peer review from peer reviewers?. PLOS ONE. 2017; 12(10):1–14. https://doi.org/10.1371/journal.pone.0186111.
Google Scholar
Hettyey A, Griggio M, Mann M, Raveh S, Schaedelin FC, Thonhauser KE, Thoß M, van Dongen WFD, White J, Zala SM, Penn DJ. Peerage of science: will it work?. Trends Ecol Evol. 2012; 27(4):189–90. https://doi.org/10.1016/j.tree.2012.01.005.
Google Scholar
Prechelt L, Graziotin D, Fernández DM. A community’s perspective on the status and future of peer review in software engineering. Inf Softw Technol. 2018; 95:75–85. https://doi.org/10.1016/j.infsof.2017.10.019.
Google Scholar
Tennant J, Dugan J, Graziotin D, Jacques D, Waldner F, Mietchen D, Elkhatib Y, B. Collister L, Pikas C, Crick T, Masuzzo P, Caravaggi A, Berg D, Niemeyer K, Ross-Hellauer T, Mannheimer S, Rigling L, Katz D, Greshake Tzovaras B, Pacheco-Mendoza J, Fatima N, Poblet M, Isaakidis M, Irawan D, Renaut S, Madan C, Matthias L, Nrgaard KjÊr J, O’Donnell D, Neylon C, Kearns S, Selvaraju M, Colomb J. A multi-disciplinary perspective on emergent and future innovations in peer review [version 3; referees: 2 approved]. F1000Research. 2017; 6(1151). https://doi.org/10.12688/f1000research.12037.3.
Tennant JP. The state of the art in peer review. FEMS Microbiol Lett. 2018; 365(19):204. https://doi.org/10.1093/femsle/fny204.
Google Scholar
Baldwin M. In referees we trust?. Phys Today. 2017; 70(2):44–9. https://doi.org/10.1063/pt.3.3463.
Google Scholar
Baldwin M. What it was like to be peer reviewed in the 1860s. Phys Today. 2017. https://doi.org/10.1063/PT.3.3463.
Spier R. The history of the peer-review process. Trends Biotechnol. 2002; 20(8):357–8. https://doi.org/10.1016/S0167-7799(02)01985-6.
Google Scholar
Kennefick D. Einstein versus the physical review. Phys Today. 2005; 58(9):43. https://doi.org/10.1063/1.2117822.
Google Scholar
Walker R, Rocha da Silva P. Emerging trends in peer review—a survey. Front Neurosci. 2015; 9:169. https://doi.org/10.3389/fnins.2015.00169.
Google Scholar
Schroter S, Black N, Evans S, Carpenter J, Godlee F, Smith R. Effects of training on quality of peer review: randomised controlled trial. BMJ. 2004; 328(7441):673. https://doi.org/10.1136/bmj.38023.700775.AE.
Google Scholar
Bornmann L, Daniel H-D. How long is the peer review process for journal manuscripts? A case study on Angewandte Chemie International Edition. CHIMIA Int J Chem. 2010; 64(1):72–7. https://doi.org/10.2533/chimia.2010.72.
Google Scholar
Benos DJ, Bashari E, Chaves JM, Gaggar A, Kapoor N, LaFrance M, Mans R, Mayhew D, McGowan S, Polter A, Qadri Y, Sarfare S, Schultz K, Splittgerber R, Stephenson J, Tower C, Walton RG, Zotov A. The ups and downs of peer review. Adv Physiol Educ. 2007; 31(2):145–52. https://doi.org/10.1152/advan.00104.2006.
Google Scholar
Kravitz RL, Franks P, Feldman MD, Gerrity M, Byrne C, Tierney WM. Editorial peer reviewers’ recommendations at a general medical journal: are they reliable and do editors care?. PLOS ONE. 2010; 5(4):1–5. https://doi.org/10.1371/journal.pone.0010072.
Google Scholar
Mahoney MJ. Publication prejudices: an experimental study of confirmatory bias in the peer review system. Cogn Therapy Res. 1977; 1(2):161–75. https://doi.org/10.1007/BF01173636.
Google Scholar
Herron DM. Is expert peer review obsolete? A model suggests that post-publication reader review may exceed the accuracy of traditional peer review. Surg Endosc. 2012; 26(8):2275–80. https://doi.org/10.1007/s00464-012-2171-1.
Google Scholar
Jansen Y, Hornbaek K, Dragicevic P. What did authors value in the CHI’16 reviews they received?. In: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems: 2016. https://doi.org/10.1145/2851581.2892576.
Squazzoni F, Grimaldo F, Marušić A. Publishing: journals could share peer-review data. Nature. 2017; 546:352.
Google Scholar
Jubb M. Peer review: the current landscape and future trends. Learn Publ. 2016; 29(1):13–21. https://doi.org/10.1002/leap.1008.
Google Scholar
Snodgrass R. Single- versus double-blind reviewing: an analysis of the literature. SIGMOD Rec. 2006; 35(3):8–21. https://doi.org/10.1145/1168092.1168094.
Google Scholar
Budden AE, Tregenza T, Aarssen LW, Koricheva J, Leimu R, Lortie CJ. Double-blind review favours increased representation of female authors. Trends Ecol Evol. 2008; 23(1):4–6. https://doi.org/10.1016/j.tree.2007.07.008.
Google Scholar
Jefferson T, Godlee F. Peer Review in Health Sciences. London: BMJ Books; 2003.
Google Scholar
Kassirer JP, Campion EW. Peer review: crude and understudied, but indispensable. JAMA. 1994; 272(2):96–7. https://doi.org/10.1001/jama.1994.03520020022005.
Google Scholar
Regehr G, Bordage G. To blind or not to blind? What authors and reviewers prefer. Med Educ. 2006; 40(9):832–9. https://doi.org/10.1111/j.1365-2929.2006.02539.x.
Google Scholar
Ross JS, Gross CP, Desai MM, Hong Y, Grant AO, Daniels SR, Hachinski VC, Gibbons RJ, Gardner TJ, Krumholz HM. Effect of blinded peer review on abstract acceptance. JAMA. 2006; 295(14):1675–80. https://doi.org/10.1001/jama.295.14.1675.
Google Scholar
Bacchelli A, Beller M. Double-blind review in software engineering venues: the community’s perspective. In: 2017 IEEE/ACM 39th International Conference on Software Engineering Companion (ICSE-C): 2017. p. 385–96. https://doi.org/10.1109/ICSE-C.2017.49.
Tennant JP. The dark side of peer review. In: EON: 2017. p. 2–4. https://doi.org/10.18243/eon/2017.10.8.1.
McNutt RA, Evans AT, Fletcher RH, Fletcher SW. The effects of blinding on the quality of peer review: a randomized trial. JAMA. 1990; 263(10):1371–6. https://doi.org/10.1001/jama.1990.03440100079012.
Google Scholar
Baggs JG, Broome ME, Dougherty MC, Freda MC, Kearney MH. Blinding in peer review: the preferences of reviewers for nursing journals. J Adv Nurs. 2008; 64(2):131–8.
Google Scholar
Weicher M. Peer review and secrecy in the “information age”. Proc Am Soc Inf Sci Technol. 2008; 45(1):1–12.
Google Scholar
Isenberg SJ, Sanchez E, Zafran KC. The effect of masking manuscripts for the peer-review process of an ophthalmic journal. Br J Ophthalmol. 2009; 93(7):881–4. https://doi.org/10.1136/bjo.2008.151886.
Google Scholar
Justice AC, Cho MK, Winker MA, Berlin JA, Rennie D, the PEER Investigators. Does masking author identity improve peer review quality? A randomized controlled trial. JAMA. 1998; 280(3):240–2. https://doi.org/10.1001/jama.280.3.240.
Google Scholar
Lee CJ, Sugimoto CR, Zhang G, Cronin B. Bias in peer review. J Am Soc Inf Sci Technol. 2013; 64(1):2–17. https://doi.org/10.1002/asi.22784.
Google Scholar
Van Rooyen S, Godlee F, Evans S, Smith R, Black N. Effect of blinding and unmasking on the quality of peer review: a randomized trial. JAMA. 1998; 280(3):234–7. https://doi.org/10.1001/jama.280.3.234.
Google Scholar
Darling ES. Use of double-blind peer review to increase author diversity. Conserv Biol. 2015; 29(1):297–9. https://doi.org/10.1111/cobi.12333.
Google Scholar
Helmer M, Schottdorf M, Neef A, Battaglia D. Research: Gender bias in scholarly peer review. eLife. 2017; 6:21718. https://doi.org/10.7554/eLife.21718.
Google Scholar
Roberts SG, Verhoef T. Double-blind reviewing at evolang 11 reveals gender bias †. J Lang Evol. 2016; 1(2):163–7. https://doi.org/10.1093/jole/lzw009.
Google Scholar
Parks S GS. Tracking global trends in open peer review. https://www.rand.org/blog/2017/10/tracking-global-trends-in-open-peer-review.html. Accessed 15 June 2020.
Walsh E, Rooney M, Appleby L, Wilkinson G. Open peer review: a randomised controlled trial. Br J Psychiatry. 2000; 176(1):47–51. https://doi.org/10.1192/bjp.176.1.47.
Google Scholar
Csiszar A. Peer review: troubled from the start. Nat News. 2016; 532(7599):306. https://doi.org/10.1038/532306a.
Google Scholar
Ross-Hellauer T, Schmidt B, Kramer B. Are funder open access platforms a good idea?. PeerJ Preprints. 2018; 6:26954–1. https://doi.org/10.7287/peerj.preprints.26954v1.
Google Scholar
Ross-Hellauer T, Deppe A, Schmidt B. Survey on open peer review: attitudes and experience amongst editors, authors and reviewers. PLOS ONE. 2017; 12(12):0189311.
Google Scholar
Jones R.Rights, wrongs and referees. N Sci. 1974; 61(890):758–9.
Google Scholar
Shapiro BJ. A culture of fact: England, 1550-1720. Ithaca: Cornell University Press; 2003.
Google Scholar
in Neuroscience F.Frontiers in Neuroscience Review System. https://www.frontiersin.org/about/review-system.Accessed 15 June 2020.
PeerJ. Policies and procedures. https://peerj.com/about/policies-and-procedures/. Accessed 15 June 2020.
Health BP. Peer review policy. https://bmcpublichealth.biomedcentral.com/submission-guidelines/peer-review-policy.
of Bioethics TAJ. Standards for manuscript submission general information. http://www.bioethics.net/wp-content/uploads/2012/02/Standards-for-Manuscript-Submission.pdf?x63245. Accessed 15 June 2020.
Pucker B, Schilbert H, Schumacher SF. Integrating molecular biology and bioinformatics education. Preprints 2018. 2018. https://doi.org/10.20944/preprints201811.0183.v1. Accessed 15 June 2020.
Snell L, Spencer J. Reviewers’ perceptions of the peer review process for a medical education journal. Med Educ. 2005; 39(1):90–7. https://doi.org/10.1111/j.1365-2929.2004.02026.x.
Google Scholar
Eysenbach G. Improving the quality of web surveys: the Checklist for Reporting Results of Internet E-surveys (CHERRIES). J Med Internet Res. 2004; 6(3):34.
Google Scholar
Isenberg T, Isenberg P, Chen J, Sedlmair M, Möller T. A systematic review on the practice of evaluating visualization. IEEE Trans Vis Comput Graph. 2013; 19(12):2818–27. https://doi.org/10.1109/TVCG.2013.126.
Google Scholar
Caine K. Local standards for sample size at chi. In: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, CHI ’16. New York: ACM: 2016. p. 981–992. https://doi.org/10.1145/2858036.2858498.
Google Scholar
Koeman L. How many participants do researchers recruit? A look at 678 UX/HCI studies. 2018. https://lisakoeman.nl/blog/how-many-participants-do-researchers-recruit-a-look-at-678-ux-hci-studies. Accessed 6 Jan 2019.
Besançon L, Semmo A, Biau DJ, Frachet B, Pineau V, Sariali EH, Taouachi R, Isenberg T, Dragicevic P. Reducing affective responses to surgical images through color manipulation and stylization In: ACM, editor. Proceedings of the Joint Symposium on Computational Aesthetics, Sketch-Based Interfaces and Modeling, and Non-Photorealistic Animation and Rendering. Victoria: ACM: 2018. p. 4–1413. https://doi.org/10.1145/3229147.3229158. ACM/Eurographics. https://hal.inria.fr/hal-01795744.
Besançon L, Issartel P, Ammi M, Isenberg T. Hybrid tactile/tangible interaction for 3D data exploration. IEEE Trans Vis Comput Graph. 2017; 23(1):881–90. https://doi.org/10.1109/TVCG.2016.2599217.
Google Scholar
Fröhlich B, Plate J. The cubic mouse: a new device for three-dimensional input. In: Proc. CHI: 2000. p. 526–31. https://doi.org/10.1145/332040.332491. ACM.
Gomez SR, Jianu R, Laidlaw DH. A fiducial-based tangible user interface for white matter tractography. In: Advances in visual computing. Berlin, Heidelberg: Springer: 2010. p. 373–81. https://doi.org/10.1007/978-3-642-17274-8\_37.
Google Scholar
Hinckley K, Pausch R, Goble JC, Kassell NF. A survey of design issues in spatial input. In: Proc. UIST. New York: 1994. p. 213–22. https://doi.org/10.1145/192426.192501. ACM.
Sousa M, Mendes D, Paulo S, Matela N, Jorge J, Lopes DSo. Vrrrroom: Virtual reality for radiologists in the reading room. In: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, CHI ’17. New York: ACM: 2017. p. 4057–62. https://doi.org/10.1145/3025453.3025566.
Google Scholar
Sultanum N, Somanath S, Sharlin E, Sousa MC. “Point it, split it, peel it, view it”: techniques for interactive reservoir visualization on tabletops. In: Proc. ITS. New York: ACM: 2011. p. 192–201. https://doi.org/10.1145/2076354.2076390.
Google Scholar
Bacchetti P. Current sample size conventions: flaws, harms, and alternatives. BMC Medicine. 2010; 8(1):17. https://doi.org/10.1186/1741-7015-8-17.
Google Scholar
Analysing Likert scale/type data. https://www.st-andrews.ac.uk/media/capod/students/mathssupport/Likert. Accessed 15 June 2019.
Stevens SS. On the theory of scales of measurement. Science. 1946; 103(2684):677–80. https://doi.org/10.1126/science.103.2684.677.
Google Scholar
Sauro J. Can you take the mean of ordinal data?. https://measuringu.com/mean-ordinal/#. Accessed 06 June 2019.
Lewis JR. Psychometric evaluation of the PSSUQ using data from five years of usability studies. Int J Hum Comput Interact. 2002; 14(3-4):463–88. https://doi.org/10.1080/10447318.2002.9669130.
Google Scholar
Lewis JR. Multipoint scales: mean and median differences and observed significance levels. Int J Hum Comput Interact. 1993; 5(4):383–92. https://doi.org/10.1080/10447319309526075.
Google Scholar
Sauro J, Lewis JR. Quantifying the user experience: practical statistics for user research, Chapter 9. Burlington: Morgan Kaufmann; 2016.
Google Scholar
Lord FM. On the statistical treatment of football numbers. 1953. https://doi.org/10.1037/h0063675.
Bravo G, Grimaldo F, López-Iñesta E, Mehmani B, Squazzoni F. The effect of publishing peer review reports on referee behavior in five scholarly journals. Nat Commun. 2019; 10(1):322. https://doi.org/10.1038/s41467-018-08250-2.
Google Scholar