Advertisement

Scientometrics

, Volume 120, Issue 3, pp 1351–1371 | Cite as

What might get published in management and applied psychology? Experimentally manipulating implicit expectations of reviewers regarding hedges

  • Nida ul Habib Bajwa
  • Markus LangerEmail author
  • Cornelius J. König
  • Hannah Honecker
Article
  • 130 Downloads

Abstract

Researchers’ careers depend on publishing papers. There are explicit expectations (e.g., paper structure) that affect editors’ and reviewers’ perceptions of manuscripts and therefore chances of publishing papers that can be easily conveyed in written feedback. However, previous research uncovered that some expectations could be rather implicit, thus reviewers and editors might not be aware that those may affect their perceptions of manuscripts. Specifically, the use of hedges (i.e., words that create vagueness; e.g., “the results show” vs. “the results might show”) seems to be expected by editors and reviewers of high impact management and applied psychology journals. However, previous work did not investigate causality of hedges on publishing recommendations. The current experiment introduced reviewers (N = 96) from top-tier journals from psychology and management with one of two versions of an introduction differing in the use of hedges. Results provide first evidence that authors’ use of hedges impacts reviewers’ recommendation for publication and suggest that this expectation is rather implicit. Moreover, the findings call for research on implicit expectations in the publishing process, may have important consequences for reviewers’ and editors’ awareness of this topic, and raise attention in novice and international researchers to subtle aspects of language that might influence chances of publishing.

Keywords

Publishing process Hedging Implicit expectations Academic writing Meta-research 

References

  1. Aguinis, H., Ramani, R. S., Campbell, P. K., Bernal-Turnes, P., Drewry, J. M., & Edgerton, B. T. (2017). Most frequently cited sources, articles, and authors in industrial-organizational psychology textbooks: Implications for the science–practice divide, scholarly impact, and the future of the field. Industrial and Organizational Psychology, 10, 507–557.  https://doi.org/10.1017/iop.2017.69.CrossRefGoogle Scholar
  2. Ahlstrom, D., Bruton, G. D., & Zhao, L. (2013). Turning good research into good publications. Nankai Business Review International, 4, 92–106.  https://doi.org/10.1108/20408741311323317.CrossRefGoogle Scholar
  3. Alvesson, M., & Gabriel, Y. (2013). Beyond formulaic research: In praise of greater diversity in organizational research and publications. Academy of Management Learning and Education, 12, 245–263.  https://doi.org/10.5465/amle.2012.0327.CrossRefGoogle Scholar
  4. APA. (2018). Summary report of journal operations 2017. American Psychologist, 73, 683–684.  https://doi.org/10.1037/amp0000347.CrossRefGoogle Scholar
  5. Bajwa, N. ul H., & König, C. J. (2019). How much is research in the top journals of industrial/organizational psychology dominated by authors from the U.S.? (Manuscript Submitted for Publication).Google Scholar
  6. Bajwa, N. ul H., König, C. J., & Harrison, O. (2016). Towards evidence-based writing advice: Using applied linguistics to understand reviewers’ expectations. Academy of Management Learning and Education, 15, 419–434.  https://doi.org/10.5465/amle.2015.0002.CrossRefGoogle Scholar
  7. Baruch, Y. (2001). Global or North American? A geographical based comparative analysis of publications in top management journals. International Journal of Cross Cultural Management, 1, 109–126.  https://doi.org/10.1177/147059580111010.CrossRefGoogle Scholar
  8. Bono, J. E., & McNamara, G. (2011). Publishing in AMJ-Part 2: Research design. Academy of Management Journal, 54, 657–660.  https://doi.org/10.5465/AMJ.2011.64869103.CrossRefGoogle Scholar
  9. Burgess, T. F., & Shaw, N. E. (2010). Editorial board membership of management and business journals: A social network analysis study of the Financial Times 40. British Journal of Management, 21, 627–648.  https://doi.org/10.1111/j.1467-8551.2010.00701.x.CrossRefGoogle Scholar
  10. Canagarajah, A. S. (2002). Geopolitics and academic writing. Pittsburgh, PA: University of Pittsburgh Press.CrossRefGoogle Scholar
  11. Carver, R. P. (1992). Reading rate: Theory, research, and practical implications. Journal of Reading, 36, 84–95.  https://doi.org/10.2307/40016440.Google Scholar
  12. Cheek, N. N. (2017). Scholarly merit in a global context: The nation gap in psychological science. Perspectives on Psychological Science, 12, 1133–1137.  https://doi.org/10.1177/1745691617708233.CrossRefGoogle Scholar
  13. Colquitt, J. A., & George, G. (2011). Publishing in AMJ-Part 1: Topic choice. Academy of Management Journal, 54, 432–435.  https://doi.org/10.5465/AMJ.2011.61965960.CrossRefGoogle Scholar
  14. Eden, D., & Rynes, S. (2003). Publishing across borders: Furthering the internationalization of “AMJ”. Academy of Management Journal, 46, 679–683.  https://doi.org/10.5465/AMJ.2003.11901933.CrossRefGoogle Scholar
  15. Faul, F., Erdfelder, E., Buchner, A., & Lang, A. G. (2009). Statistical power analyses using G*Power 3.1: Tests for correlation and regression analyses. Behavior Research Methods, 41, 1149–1160.  https://doi.org/10.3758/brm.41.4.1149.CrossRefGoogle Scholar
  16. Flowerdew, J. (2000). Discourse community, legitimate peripheral participation, and the nonnative-english-speaking scholar. TESOL Quarterly, 34, 127–149.  https://doi.org/10.2307/3588099.CrossRefGoogle Scholar
  17. Geletkanycz, M., & Tepper, B. J. (2012). Publishing in AMJ-Part 6: Discussing the implications. Academy of Management Journal, 55, 256–260.  https://doi.org/10.5465/amj.2012.4002.CrossRefGoogle Scholar
  18. George, G. (2012). Publishing in AMJ for non-U.S. authors. Academy of Management Journal, 55, 1023–1026.  https://doi.org/10.5465/amj.2012.4005.Google Scholar
  19. George, G. (2015, August). Publishing in AMJ: Tips from the editors. Presentation presented at the 75th Annual Meeting of the Academy of Management, Vancouver, BC. Retrieved May 21, 2018, from http://aom.org/uploadedFiles/Publications/AMJ/AMJ%20PDW%20GG%202015.pdf.
  20. Goodrum, A. A., McCain, K. W., Lawrence, S., & Lee Giles, C. (2001). Scholarly publishing in the Internet age: A citation analysis of computer science literature. Information Processing and Management, 37, 661–675.  https://doi.org/10.1016/S0306-4573(00)00047-9.CrossRefzbMATHGoogle Scholar
  21. Grant, A. M., & Pollock, T. G. (2011). Publishing in AMJ-Part 3: Setting the hook. Academy of Management Journal, 54, 873–879.  https://doi.org/10.5465/amj.2011.4000.CrossRefGoogle Scholar
  22. Horn, S. A. (2017). Non-English nativeness as stigma in academic settings. Academy of Management Learning and Education, 16, 579–602.  https://doi.org/10.5465/amle.2015.0194.CrossRefGoogle Scholar
  23. Huff, A. S. (1999). Writing for scholarly publication. Thousand Oaks, CA: Sage.Google Scholar
  24. Hyland, K. (1998a). Hedging in scientific research articles. Amsterdam: John Benjamins Publishing.CrossRefGoogle Scholar
  25. Hyland, K. (1998b). Persuasion and context: The pragmatics of academic metadiscourse. Journal of Pragmatics, 30, 437–455.  https://doi.org/10.1016/S0378-2166(98)00009-5.CrossRefGoogle Scholar
  26. Hyland, K. (2000). Hedges, boosters and lexical invisibility: Noticing modifiers in academic texts. Language Awareness, 9, 179–197.  https://doi.org/10.1080/09658410008667145.CrossRefGoogle Scholar
  27. Hyland, K. (2005). Stance and engagement: a model of interaction in academic discourse. Discourse Studies, 7, 173–192.  https://doi.org/10.1177/1461445605050365.CrossRefGoogle Scholar
  28. Hyland, K., & Milton, J. (1997). Qualification and certainty in L1 and L2 students’ writing. Journal of Second Language Writing, 6, 183–205.  https://doi.org/10.1016/S1060-3743(97)90033-3.CrossRefGoogle Scholar
  29. Hyland, K., & Salager-Meyer, F. (2008). Scientific writing. Annual Review of Information Science and Technology, 42, 297–338.  https://doi.org/10.1002/aris.2008.1440420114.CrossRefGoogle Scholar
  30. Hyland, K., & Tse, P. (2004). Metadiscourse in academic writing: A reappraisal. Applied Linguistics, 25, 156–177.  https://doi.org/10.1093/applin/25.2.156.CrossRefGoogle Scholar
  31. Joday, H. (2011). Reading rate and comprehension. Retrieved April 25, 2018, from https://files.eric.ed.gov/fulltext/ED523331.pdf.
  32. Judge, T. A., Cable, D. M., Colbert, A. E., & Rynes, S. L. (2007). What causes a management article to be cited—Article, author, or journal? Academy of Management Journal, 50, 491–506.  https://doi.org/10.5465/amj.2007.25525577.CrossRefGoogle Scholar
  33. Kwan, B. S. C. (2013). Facilitating novice researchers in project publishing during the doctoral years and beyond: A Hong Kong-based study. Studies in Higher Education, 38, 207–225.  https://doi.org/10.1080/03075079.2011.576755.CrossRefGoogle Scholar
  34. Leung, K. (2009). Never the twain shall meet? Integrating Chinese and Western management research. Management and Organization Review, 5, 121–129.  https://doi.org/10.1111/j.1740-8784.2008.00135.x.CrossRefGoogle Scholar
  35. Levashina, J., & Campion, M. A. (2006). A model of faking likelihood in the employment interview. International Journal of Selection and Assessment, 14, 299–316.  https://doi.org/10.1111/j.1468-2389.2006.00353.x.CrossRefGoogle Scholar
  36. Martinko, M. J., Campbell, C. R., & Douglas, S. C. (2000). Bias in the social science publication process: Are there exceptions? Journal of Social Behavior and Personality, 15, 1–18.Google Scholar
  37. McKinley, J., & Rose, H. (2018). Conceptualizations of language errors, standards, norms and nativeness in English for research publication purposes: An analysis of journal submission guidelines. Journal of Second Language Writing, 42, 1–11.  https://doi.org/10.1016/j.jslw.2018.07.003.CrossRefGoogle Scholar
  38. Monatersky, R. (2005). The number that’s devouring science. The Chronicle of Higher Education, 52, 12–17.Google Scholar
  39. Murphy, J., & Zhu, J. (2012). Neo-colonialism in the academy? Anglo-American domination in management journals. Organization, 19, 915–927.  https://doi.org/10.1177/1350508412453097.CrossRefGoogle Scholar
  40. Nation, P. (2009). Reading faster. International Journal of English Studies, 9, 131.Google Scholar
  41. Ozbilgin, M. (2004). “International” human resource management: Academic parochialism in editorial boards of the “top” 22 journals on international human resource management. Personnel Review, 33, 205–221.  https://doi.org/10.1108/00434804105180559.CrossRefGoogle Scholar
  42. Peffers, K., Tuunanen, T., Rothenberger, M. A., & Chatterjee, S. (2014). A design science research methodology for information systems research. Journal of Management Information Systems, 24, 45–77.  https://doi.org/10.2753/MIS0742-1222240302.CrossRefGoogle Scholar
  43. Podsakoff, P. M., MacKenzie, S. B., Podsakoff, N. P., & Bachrach, D. G. (2008). Scholarly influence in the field of management: A bibliometric analysis of the determinants of university and author impact in the management literature in the past quarter century. Journal of Management, 34, 641–720.  https://doi.org/10.1177/0149206308319533.CrossRefGoogle Scholar
  44. Pudelko, M., & Tenzer, H. (2018). Boundaryless careers or career boundaries? The impact of language barriers on academic careers in international business schools. Academy of Management Learning and Education.  https://doi.org/10.5465/amle.2017.0236.Google Scholar
  45. Roberts, S. J., Walzer, A. S., & Sinnett, S. A. (2015). Best of both worlds: Integrating Big Data into HR research. In Presentation presented at the 30th annual conference of the society for industrial and organizational psychology (SIOP), Philadelphia, PA.Google Scholar
  46. Rynes, S. L., Hillman, A., Ireland, R. D., Kirkman, B., Law, K., Miller, C. C., et al. (2005). Everything you’ve always wanted to know about AMJ (but may have been afraid to ask). Academy of Management Journal, 48, 732–737.  https://doi.org/10.5465/AMJ.2005.28563879.CrossRefGoogle Scholar
  47. Smeyers, P., & Burbules, N. C. (2011). How to improve your impact factor: Questioning the quantification of academic quality. Journal of Philosophy of Education, 45, 1–17.  https://doi.org/10.1111/j.1467-9752.2011.00787.x.CrossRefGoogle Scholar
  48. Sparrowe, R. T., & Mayer, K. J. (2011). Publishing in AMJ-Part 4: Grounding hypotheses. Academy of Management Journal, 54, 1098–1102.  https://doi.org/10.5465/amj.2011.4001.CrossRefGoogle Scholar
  49. Sullivan, S. E., Baruch, Y., & Schepmyer, H. (2010). The why, what, and how of reviewer education: A human capital approach. Journal of Management Education, 34, 393–429.  https://doi.org/10.1177/1052562909346687.CrossRefGoogle Scholar
  50. Swales, J. (2004). Research genres: Explorations and applications. New York, NY: Cambridge University Press.CrossRefGoogle Scholar
  51. Swales, J., & Najjar, H. (1987). The writing of research article introductions. Written Communication, 4, 175–191.  https://doi.org/10.1177/0741088387004002004.CrossRefGoogle Scholar
  52. Teplitskiy, M., Acuna, D., Elmarani-Raoult, A., Körding, K., & Evans, J. (2018). The sociology of scientific validity: How professional networks shape judgement in peer review. Research Policy, 47, 1825–1841.  https://doi.org/10.1016/j.respol.2018.06.014.CrossRefGoogle Scholar
  53. Thomson Reuters. (2014). Journal citation reports. Retrieved September 7, 2015, from http://thomsonreuters.com/journal-citation-reports/.
  54. Tourish, D. (2011). Leading questions: Journal rankings, academic freedom and performativity: What is, or should be, the future of Leadership? Leadership, 7, 367–381.  https://doi.org/10.1177/1742715011407385.CrossRefGoogle Scholar
  55. Tsui, A. S. (2007). From homogenization to pluralism: International management research in the academy and beyond. Academy of Management Journal, 50, 1353–1364.  https://doi.org/10.2307/20159477.CrossRefGoogle Scholar
  56. Walsh, J. P. (2015). Organization and management scholarship in and for Africa and the world. Academy of Management Perspectives, 29, 1–6.  https://doi.org/10.5465/amp.2015.0019.CrossRefGoogle Scholar
  57. Wood, D. A. (2016). Comparing the publication process in accounting, economics, finance, management, marketing, psychology, and the natural sciences. Accounting Horizons, 30, 341–361.  https://doi.org/10.2308/acch-51443.CrossRefGoogle Scholar
  58. Zhang, Y. A., & Shaw, J. D. (2012). Publishing in AMJ-Part 5: Crafting the methods and results. Academy of Management Review, 37, 8–12.CrossRefGoogle Scholar

Copyright information

© Akadémiai Kiadó, Budapest, Hungary 2019

Authors and Affiliations

  1. 1.Universität des SaarlandesSaarbrückenGermany

Personalised recommendations