Skip to main content
Log in

Citation choice and innovation in science studies

  • Published:
Scientometrics Aims and scope Submit manuscript

Abstract

What are the factors which render an article more likely to be cited? Using social network analysis of citations between published scholarly works, the nascent field around Social Studies of Science is examined from its incipience in 1971 until 2008. To gauge intellectual positioning, closeness centrality and orthodoxy rates are derived from bibliographic networks. Bibliographic orthodoxy is defined as the propensity of an article to cite other highly popular works. Orthodoxy and closeness centrality have differing effects on citation rates, varying across historical periods of development in the field. Effects were modest, but significant. In early time periods, articles with higher orthodoxy rates were cited more, but this effect dissipated over time. In contrast, citations associated with closeness centrality increased over time. Early SSS citation networks were smaller, less structurally cohesive and less modular than later networks. In contrast, later networks were larger, more structurally cohesive, more modular and less dense. These changes to the global SSS knowledge networks are linked to changes in the scientific reward structure ensconced in the network, particularly regarding orthodoxy and closeness centrality.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

Notes

  1. Risks associated with nascence are tempered by the notion of first-mover advantage, and the fact that priority is the most prized resource in academia (Merton 1968; Dasgupta and David 2002). Being first to claim ownership for a valued idea in academia, is the means by which academics accrue credit and professional benefits (Latour and Woolgar 1979). Thus, while there are generally risks associated with nascence, rewards can also simultaneously exist. Or alternatively, liabilities of senescence (Ranger-Moore 1997; Ganz 2000) can exist alongside liabilities of newness.

  2. A question this raises, is when and how some fields or networks will maintain intellectual homogeneity and deference to elites with growth, while others will “calve off” and become a subfield, usually with new elites, shared information, identity and foci (see Abbott (2001) on fractalization).

  3. This includes its initial incarnate as Science Studies, between 1971 and 1974.

  4. Digitization may enable the large-scale study of book citations in the near future.

  5. For example, in this case the most cited work in the SSS network was a book, Kuhn’s (1962) Structure of Scientific Revolutions.

  6. This measure was taken prior to the pruning of asymmetric pendants (i.e. works cited only once by a single SSS focal article).

  7. For occasional references, due to multiple editions of books existing published in different years, there is an inevitable amount of noise associated with this measure. As a rule, the date of earliest edition of a book was used.

  8. Giant components of each network were extracted using Pajek. The vast majority of all articles in each network were connected.

  9. For articles published in the first decade of SSS, the citation history in the journal a given article has to draw upon is obviously less extensive. Thus, while the entire citation history of the journal is included in the networks of articles published in 1971–1979; the network cannot go back the entire 10 years, as scholars work with a shorter time-horizon during nascent years.

  10. The institutions were identified through their prominence in early Science Studies and Social Studies of Science. They include: Bath, Birmingham, Edinburgh, Lancaster, Leicester and Manchester, in the United Kingdom. In the United States, they include Cornell, MIT, RPI and UCSD. The American departments were spurred by NSF grants in the 1980s designed to establish Science Studies, emulating the successful diffusion in the United Kingdom in the 1970s (Jasanoff 1992).

  11. The vast majority of articles with fewer than six citations were ‘non-articles’, such as book reviews and editorial material. However, given that many influential works were not listed by the ISI as formal ‘articles’ (e.g., Review Essays), parsing by citation count was chosen over merely restricting analyses to what the Thomson Reuters dubbed as an ‘article.’ Amongst articles with at least six cited works in the bibliography, all were included, regardless of how many citations they received.

  12. Models were also run without these time periods, instead interacting time with key variables to gauge trends and changes over time. Results were quite similar to the models reported with four different time periods, with significant relationships in the same directions. However, as the analyses focusing on the time periods yielded higher variance explained, they are reported in the results section.

  13. While creative accumulation of citations is a sign of intellectual vitality and corpus development, Abbott (1999: 166–167) observed that the expanding space longer reference lists demand from can create problems for journals, sometimes necessitating a decrease in manuscripts accepted.

  14. To ensure that results were not being unduly skewed by shorter articles, an additional set of models was generated, limiting analysis to articles with 20 or more citations in the bibliography. Results were quite similar to the results in Table 3.

  15. As articles are published in volumes throughout each calendar year, but Thomson Reuters only tabulates citation counts yearly, this means that this variable will actually mean citations from anywhere from 5 to 6 years since publication. Further, since this is a relatively small amount of time for ideas to diffuse on a large scale, this reduces citation inequality sharply, and obviates the need to log this dependent variable.

  16. While there was no gender effect in the first time period, it should be noted that as per Table 1, only roughly nine percent of publications came from females (some of whom were repeat authors) during that time slice. Thus, there were very few published female STS scholars to make a comparison with.

  17. Of note is that calculations for networks before 1974 were not computed by UCInet due to the primitiveness and small-size of the network. Thus, modularity levels were very low for the first 4 years of the network.

  18. The majority of contributors to Social Studies of Science have only published a single article in the journal. The breakdown is: 690 with one publication, 177 with two, 74 with three, 37 with four and 19 with five or more.

  19. Access and connections to interpersonal and institutional networks is an additional cause which has been argued to adversely affect women in professions (Burt 1998).

  20. In other fields, tradeoffs and equilibria may be different than in SSS and Science Studies.

References

  • Abbott, A. D. (1999). Department and discipline: Chicago sociology at one-hundred. Chicago: University of Chicago Press.

    Google Scholar 

  • Abbott, A. D. (2001). Chaos of disciplines. Chicago: University of Chicago Press.

    Google Scholar 

  • Academic Ranking of World Universities. (2010). Accessed April 3, 2011 from the World Wide Web: http://www.arwu.org/.

  • Baldi, S. (1998). Normative versus social constructivist processes in the allocation of citations: A network-analytic model. American Sociological Review, 63(6), 829–846.

    Article  Google Scholar 

  • Barabási, A. L., & Albert, R. (1999). Emergence of scaling in random networks. Science, 286(5439), 509–512.

    Article  MathSciNet  Google Scholar 

  • Benford, R. D., & Snow, D. A. (2000). Framing and social movements: An overview and assessment. Annual Review of Sociology, 26, 611–639.

    Article  Google Scholar 

  • Blau, P. (1970). A formal theory of differentiation in organizations. American Sociological Review, 35(2), 201–218.

    Article  MathSciNet  Google Scholar 

  • Bonacich, P. (1972). Factoring and weighting approaches to status scores and clique identification. Journal of Mathematical Sociology, 2, 113–120.

    Article  Google Scholar 

  • Bourdieu, P. (1988). Homo academicus. Stanford: Stanford University Press.

    Google Scholar 

  • Burris, V. (2004). The academic caste system: Prestige hierarchies in PhD exchange networks. American Sociological Review, 69(2), 239–264.

    Article  MathSciNet  Google Scholar 

  • Burt, R. S. (1998). Gender and social capital. Rationality and Society, 10(1), 5–46.

    Article  MathSciNet  Google Scholar 

  • Burt, R. S. (2004). Structural holes and good ideas. American Journal of Sociology, 110(2), 349–399.

    Article  Google Scholar 

  • Carley, K. (1991). A theory of group stability. American Sociological Review, 56(3), 331–354.

    Article  Google Scholar 

  • Cole, S. (1983). The hierarchy of the sciences? American Journal of Sociology, 89, 111–139.

    Article  Google Scholar 

  • Cole, J., & Zuckerman, H. (1984). The productivity puzzle: Persistence and change in patterns of publication among men and women scientists. In: M. Maehr & M. Steinhamp (Eds.), Advances in motivation and achievement (pp. 217–256). Greenwich, CT: JAI.

    Google Scholar 

  • Coleman, J. S. (1988). Free Riders and Zealots: The role of social networks. Sociological Theory, 6(1), 52–57.

    Article  Google Scholar 

  • Collins, H. M. (1983). The sociology of scientific knowledge: Studies of contemporary science. Annual Review of Sociology, 9(1), 265–285.

    Article  Google Scholar 

  • Collins, R. (1998). The sociology of philosophies: A global theory of intellectual change. Cambridge: Harvard University Press.

    Google Scholar 

  • Crane, D. (1972). Invisible colleges: Diffusion of knowledge in scientific communities. Chicago: University of Chicago Press.

    Google Scholar 

  • Dasgupta, P., & David, P. (2002). Toward a new economics of science, Ch. 7. In: P. Mirowski & E.-M. Sent (Eds.), Science bought and sold. Chicago: University of Chicago Press.

    Google Scholar 

  • De Nooy, W. (2002). The dynamics of artistic prestige. Poetics, 30, 147–167.

    Google Scholar 

  • DiMaggio, P. J. (1988). Interest and agency in institutional theory. In: L. Zucker (Ed.), Institutional patterns and culture (pp. 3–22). Cambridge: Ballmer.

    Google Scholar 

  • Elster, J. (1991). Jon Elster. In: R. Swedberg (Ed.), Economics and sociology: Redefining their boundaries (pp. 233–248). Princeton: Princeton University Press.

    Google Scholar 

  • Evans, J. (2005). Stratification in knowledge production: Author prestige and the influence of an American academic debate. Poetics, 33(2), 111–133.

    Article  Google Scholar 

  • Fligstein, N. (1997). Social skill and institutional theory. American Behavioral Scientist, 40(4), 397.

    Article  Google Scholar 

  • Freeman, L. C. (1979). Centrality in social networks: A conceptual clarification. Social Networks, 1(3), 215–239.

    Article  Google Scholar 

  • Frickel, S., & Gross, N. (2005). A general theory of scientific/intellectual movements. American Sociological Review, 70(2), 204–232.

    Article  Google Scholar 

  • Fuchs, S. (1993). A sociological theory of scientific change. Social Forces, 71, 933–955.

    Google Scholar 

  • Ganz, M. (2000). Resources and resourcefulness: Strategic capacity and the unionization of California agriculture. American Journal of Sociology, 105, 1003–1062.

    Article  Google Scholar 

  • Gondal, N. (2011). The local and global structure of knowledge production in an emergent research field: An exponential random graph analysis. Social Networks, 33(1), 20–30.

    Article  MathSciNet  Google Scholar 

  • Hackett, E. O., Amsterdamska, O., Lynch, M., & Wajcman, J. (2007). Introduction. In: E. O. Hackett, O. Amsterdamska, M. Lynch, & J. Wajcman (Eds.), The handbook of science and technology studies (3rd edn.). Cambridge: MIT Press.

    Google Scholar 

  • Hanneman, R. A. (2004). The prestige of PhD granting departments of sociology: A simple network approach. Connections, 24(1), 68–77.

    Google Scholar 

  • Hargens, L. (2000). Using the literature: Reference networks, reference contexts and the social structure of scholarship. American Sociological Review, 65, 846–865.

    Article  Google Scholar 

  • Hilgartner, S. (2003). Institutionalizing science and technology studies in the academy. In: B. Joerges & H. Nowotny (Eds.), Social studies of science and technology: Looking back, ahead (pp. 201–210). London: Springer.

    Chapter  Google Scholar 

  • Jasanoff, S. (1992). Introduction. In: S. Jasanoff (Ed.), The outlook for STS: Report on an STS symposium & workshop. Science & Technology Studies, Cornell University, pp. i–iv.

  • Katz, L. (1953). A new status index derived from sociometric analysis. Psychometrika, 18, 39–43.

    Google Scholar 

  • Knoke, D., & Burt, R. S. (1983). Prominence. In: R. Burt & M. Minor (Eds.), Applied network analysis (pp. 195–222). Beverly Hills: Sage.

    Google Scholar 

  • Kuhn, T. S. (1962). The structure of scientific revolutions. Chicago: University of Chicago Press.

    Google Scholar 

  • Kuhn, T. S. (1977). The essential tension: Selected studies in scientific tradition and change. Chicago: University of Chicago Press.

    Google Scholar 

  • Lamont, M. (2009). How professors think: Inside the curious world of academic judgment. Cambridge: Harvard University Press.

    Google Scholar 

  • Latour, B., & Woolgar, S. (1979). Laboratory life: The construction of scientific facts. Los Angeles: Sage.

    Google Scholar 

  • Long, J. S., & Fox, M. F. (1995). Scientific careers: Universalism and particularism. Annual Review of Sociology, 24, 45–71.

    Article  Google Scholar 

  • Lotka, A. J. (1927). The frequency distribution of scientific productivity. Journal of the Washington Academy of Sciences, 16(1926), 317–323.

    Google Scholar 

  • Lynn, F. B. (2012). The role of expertise in the consumption of status signals. Stanford, CA: Stanford Graduate School of Business Colloquium.

    Google Scholar 

  • March, J. (1994). A primer on decision making: How decisions happen. New York, NY: Free Press.

    Google Scholar 

  • Mark, N. (1998). Beyond individual differences: Social differentiation from first principles. American Sociological Review, 63(June), 309–330.

    Article  Google Scholar 

  • Mayhew, B. H., & Levinger, R. L. (1976). On the emergence of oligarchy in human interaction. American Journal of Sociology, 81, 1017–1049.

    Article  Google Scholar 

  • McCain, K., & Salvucci, L. (2006). How influential is Brooks’ Law? A longitudinal citation context analysis of Frederick Brooks’ The Mythical Man-Month. Journal of Information Science, 32(3), 277–295.

    Article  Google Scholar 

  • McCloskey, D. (1994). Knowledge and persuasion in economics. Cambridge: Cambridge University Press.

    Book  Google Scholar 

  • McLaughlin, N. G. (1998). How to become a forgotten intellectual: Intellectual movements and the rise and fall of Erich Fromm. Sociological Forum, 13(2), 215–246.

    Article  Google Scholar 

  • Merton, R. K. (1968). The Matthew effect in science. Science, 159, 56–63.

    Article  Google Scholar 

  • Merton, R. K. (1973). The sociology of science. Chicago: University of Chicago Press.

    Google Scholar 

  • Mingers, J. (2008). Exploring the dynamics of journal citations: Modelling with S-curves. Journal of the Operational Research Society, 59, 1013–1025.

    Article  MATH  Google Scholar 

  • Mirowski, P., & Nik-Khah, E. (2007). Markets make flesh: Performativity, and a problem in science studies, augmented with consideration of the FCC auctions. In: D. A. MacKenzie, F. Iuneisa, & L. Siu (Eds.), Do economists make markets? On the performativity of economics (pp. 190–224). Princeton: Princeton University Press.

    Google Scholar 

  • Moody, J. (2004). The structure of a social science collaboration network: Disciplinary cohesion from 1963 to 1999. American Sociological Review, 69(2), 213–238.

    Article  Google Scholar 

  • Moody, J. (2006). The network structure of sociological production. Accessed October 28, 2009 from the World Wide Web: http://www.soc.duke.edu/~jmoody77/presentations/soc_Struc_II.ppt.

  • Mulkay, M. J., Gilbert, G. N., & Woolgar, S. (1975). Problem areas and research networks in science. Sociology, 9(2), 187–203.

    Article  Google Scholar 

  • Newman, M. E. J., Girvan M. (2004). Finding and evaluating community structure in networks. Physical Review E, 69(2), 026113.

    Google Scholar 

  • Perry-Smith, J. E., & Shalley, C. E. (2003). The social side of creativity: A static and dynamic social network perspective. Academy of Management Review, 28(1), 89–106.

    Google Scholar 

  • Podolny, J. (1993). A status-based model of market competition. American Journal of Sociology, 98(4), 829–872.

    Article  Google Scholar 

  • Powell, W. W., Koput, K. W., & Smith-Doerr, L. (1996). Interorganizational collaboration and the locus of innovation: Networks of learning in biotechnology. Administrative Science Quarterly, 41(1), 116–145.

    Article  Google Scholar 

  • Price, D. D. (1963). Big science, little science. New York: Columbia University Press.

    Google Scholar 

  • Price, D. D. (1970). Citation measures of hard science, soft science, technology, and nonscience. In: C. E. Nelson & D. K. Pollack (Eds.), Communication among scientists and engineers (pp. 4–22). Lexington, MA: Heath.

    Google Scholar 

  • Ranger-Moore, J. (1997). Bigger may be better, but is older wiser? Organizational age and size in the New York life insurance industry. American Sociological Review, 62(4), 903–920.

    Article  Google Scholar 

  • Reskin, B. F. (1978). Scientific productivity, sex and location in the institution of science. American Journal of Sociology, 83(5), 1235–1243.

    Article  Google Scholar 

  • Rogers, E. M. (1995). Diffusion of innovations (4th edn.). New York: Free Press.

    Google Scholar 

  • Rojas, F. (2007). From black power to black studies. Baltimore: Johns Hopkins University Press.

    Google Scholar 

  • Rosen, S. (1981). The economics of superstars. American Economic Review, 7(5), 845–858.

    Google Scholar 

  • Sci2 Team (2009) Science of science (Sci2) Tool. Indiana University and SciTech Strategies, http://sci.slis.indiana.edu.

  • Selznick, P. (1949). 1949 TVA and the grass roots: A study in the study of formal organization. Berkeley/Los Angeles: University of California Press.

    Google Scholar 

  • Sismondo, S. (2007). Science and technology studies and an engaged program. In E. Hackett, O. Amsterdamska, M. Lynch, & J. Wajcman (Eds.), Handbook of science and technology studies (3rd edn., pp. 13–32). Cambridge: MIT Press.

    Google Scholar 

  • Small, H. (1978). Cited documents as concept symbols. Social Studies of Science, 8, 327–340.

    Article  Google Scholar 

  • Tarrow, S. (1994). Power in movement: Social movements and contentious politics. Cambridge: Cambridge University Press.

    Google Scholar 

  • Uzzi, B. (1997). Social structure and competition in interfirm networks: The paradox of embeddedness. Administrative Science Quarterly, 42(1), 35–67.

    Article  Google Scholar 

  • Uzzi, B., & Spiro, J. (2005). Collaboration and creativity: The small world problem. American Journal of Sociology, 111(2), 447–504.

    Article  Google Scholar 

  • Whitley, R. (1984). The intellectual and social organization of the sciences. Oxford: Clarendon.

    Google Scholar 

  • Winner, L. (1996). The gloves come off: Shattered alliances in science and technology studies. Social Text, 14(1–2), 81–91.

    Article  Google Scholar 

  • Zuckerman, E. (1999). The categorical imperative: Securities analysts and the illegitimacy discount. American Journal of Sociology, 104(5), 1398–1438.

    Article  Google Scholar 

Download references

Acknowledgments

The author acknowledges helpful feedback on previous drafts of this article from Matthew Brashears, Stephen Hilgartner, Neil McLaughlin, Tony Puddephatt, David Strang, Sarah Soule and Pamela Tolbert. Further, the author is especially grateful to Katherine McCain for introducing him to citation analysis. This research was supported in part by a seed grant from the Cornell University Center for the Study of Economy and Society.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Kyle Siler.

Appendix

Appendix

Correlation matrix

 

Received citations per year (log)

Average signal (orthodoxy)

Out-degree (bibliography length)

Out-closeness

Citation age

Non-Elite Univ.

Outside North Amer.

Non-core STS Univ.

Gender (M)

Received citations per year (log)

1.000

        

Average signal

0.062

1.000

       

Out-degree (bibliography length)

0.271

−0.131

1.000

      

Out-closeness

−0.068

−0.146

−0.029

1.000

     

Citation age

−0.070

−0.126

0.253

−0.007

1.000

    

Non-Elite Univ.

−0.036

−0.044

−0.019

0.007

−0.025

1.000

   

Outside North Amer.

−0.069

0.019

0.002

0.049

−0.006

0.489

1.000

  

Non-core STS Univ.

−0.027

0.032

0.003

−0.091

0.024

0.199

−0.004

1.000

 

Gender (M)

0.065

0.057

0.084

−0.072

−0.018

−0.101

−0.013

0.065

1.000

Rights and permissions

Reprints and permissions

About this article

Cite this article

Siler, K. Citation choice and innovation in science studies. Scientometrics 95, 385–415 (2013). https://doi.org/10.1007/s11192-012-0881-8

Download citation

  • Received:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11192-012-0881-8

Keywords

Navigation