Abstract
Purpose
Social media (SoMe) is increasingly important in surgical education and may be necessary in the current learning environment. Whilst expanding in use and applications, few studies detail the impact of SoMe on measurable outcomes. The goal of this study was to quantify the impact of a dedicated SoMe strategy on engagement metrics for surgical research.
Methods
A retrospective review of a peer-reviewed surgical journal’s Twitter microblog platform (@ColorectalDis) was performed from 6/2015 to 4/2021. A formal SoMe strategy was introduced in September 2018. Data were stratified into 2 time periods: pre-intervention (6-2015 to 9-2018) and post-SoMe intervention (9-2018 to 4-2021). The main outcome was the impact of the SoMe strategy on user engagement with the Twitter platform, journal, and traditional journal metrics. Twitter Analytics and Twitonomy were used to analyse engagement.
Results
From conception to analysis, the microblog published 1198 original tweets, generating 5 million impressions and 231,000 engagements. Increased account activity (increased tweets published per month—5.51 vs 28.79; p < 0.01) was associated with significant engagement growth, including new monthly followers (213 vs 38; p < 0.01) and interactions with posted articles (4,096,167 vs 269,152; p < 0.01). Article downloads increased twenty-fold post-SoMe intervention (210,449 vs 10,934; p < 0.01), with significant increases in traditional journal metrics of new subscribers (+11%), article submissions (+24%), and impact factor (+0.9) (all p < 0.01).
Conclusion
SoMe directly impacts traditional journal metrics in surgical research. By examining the patterns of user engagement between SoMe and journal sites, the growing beneficial impact of a structured social media strategy and SoMe as an educational tool is demonstrated.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
Introduction
Social media (SoMe) is a collective term for online-based applications that facilitate seamless connection and communication between users [1]. SoMe offers the unique benefits of free, real-time communications in multiple forms to users at all levels across the world, promoting engagement, equity, and collaboration. As such, SoMe platforms are consistently increasing in use and popularity in general [2]. The same trend is seen in medicine. A recent systematic review of undergraduate medical students demonstrated the ability of SoMe to improve short-term knowledge in both self-reported and objective assessments, flatten hierarchies, and improve communication with educators [3]. In surgery, SoMe offers additional unique opportunities to connect with a larger and more diverse group of investigators to directly interact with patients, colleagues, and the public and effectively recruit for research [4,5,6]. This has especially proven true in the colorectal surgery community, where investigators have favoured the Twitter microblog platform to disseminate study findings to a global audience, generate discussion with investigators at all experience levels, and increase the visibility of academic work [7, 8]. Members may generate discussion using a mixture of text, visual, and audio media, succinctly delivering the key points of their content; thus, Twitter is an attractive educational resource for trainees and surgeons in practice who need to be time efficient [9].
Whilst increasing in use, little work to date has measured if SoMe increases the reach and impact of surgical research published by journals [10]. Journals traditionally used citation-based bibliometric indices, such as article citations, CiteScore metrics, impact factor (calculated by dividing the total number of citations in a given year for publications in one journal in the preceding 2 years by the total number of citable items published in the preceding 2 years), h-index, and the SCImago Journal Rank, to quantify the journal- and author-level success of a publication. However, these measures are inconsistent in application and interpretation and fail to recognize scholarly activity on social media [11]. The range of metrics used by the scientific publishing community has grown in recent years to consider downloads, reviews, mentions, and shares on social media as legitimate indicators of impact. Alternative metrics (Altmetrics) have emerged that give insight into public impact, predict future citations, and track attention for non-traditional research outputs [12, 13]. For journals, SoMe offers engagement on study findings and implications for clinical practice, facilitates connection with stakeholders, and amplifies published work for increased visibility, article reads, and citation rates, which in turn may influence the impact factor of the journal [14, 15]. Despite the proven value, there is little work to date that quantifies the impact of a journal’s social media strategy, as most work published previously has focussed on the influence of social media on individual article metrics and reach [10, 16]. Determining these journal-specific metrics is important to first establish a baseline and, second, track outcomes for this growing surgical education tool.
The primary aim of this study was to evaluate the impact of a dedicated SoMe strategy on engagement metrics with surgical research published within one international journal—Colorectal Disease. Secondly, we aimed to quantify the influence of social media on evidence-based medicine and surgical education. Our hypothesis was that a dedicated SoMe strategy would translate to increased traffic to the journal’s surgical research that was measurable, generalisable, and reproducible.
Methods
Study outline
A retrospective review of user engagement metrics for the SoMe microblog platform (Twitter®) for the Colorectal Disease journal from June 2015 to April 2021 was performed. Analysis was stratified into 2 time periods: firstly, pre-intervention (Phase 1: June 2015–September 2018, 39 months) and post-intervention (Phase 2: September 2018–April 2021, 32 months), following the implementation of a targeted SoMe strategy. The SoMe strategy consisted of daily posting, consistent branding, and a defined weekly tweet structure, under the leadership of dedicated SoMe editors and team members. User engagement was defined as SoMe and website interactions, journal traffic, and article downloads, which were assessed using Altmetrics, Twitonomy, Twitter Analytics, and univariate analysis. The main outcome measures were to identify changes in user engagement with the journal before and after the implementation of the SoMe strategy.
Definitions
Twitter Analytics and Twitonomy (Digonomy Pty Ltd) are online analytics tools which monitor and analyse patterns of user engagement with tweets. The definitions used by these SoMe analytical tools are summarised in Table 1.
Outcome and exposure
The outcomes are described in 3 parts: firstly, changes in account activity (e.g., differences in the number of tweets posted by @ColorectalDis, total number of impressions); secondly, engagement with followers (including total number of engagements, engagement rates of tweets, and URL clicks); and lastly, account growth (mean number of new account followers per month). New monthly follower data is only available from July 2016 using Twitter Analytics, although the total number of followers from June 2015 to June 2016 is available.
Statistical analysis
Statistical analysis was performed using descriptive statistics, with frequency (n) and percentages (%) for occurrences. Comparative analysis was performed using Student’s paired t-tests. Statistical significance was set at an alpha level < 0.05.
Ethics
There are currently no EQUATOR reporting parameters that address social media metrics. Publication of this work could be a precedent for establishing standardised terms and reporting variables. This study does not use any protected health information and was exempt from institutional review board consideration.
Results
From 25th June 2015 to the time of writing (30th April 2021), the Colorectal Disease Twitter handle has published 1198 organic tweets (excluding retweets without comment), generating almost 5 million impressions and over 230,000 engagements. At the time of writing, the total number of tweets published by the @ColorectalDis handle (inclusive of retweets without comment) was 3409 tweets. Mean monthly comparisons between the 2 phases are demonstrated in Table 2.
Activity of @ColorectalDis
Significant increases in the total and mean monthly tweets posted before (215 vs 5.51) and after the SoMe strategy (835 vs 28.79; p < 0.01) were observed. Similarly, the total number of tweet impressions increased from 269,152 in Phase 1 to 4,721,198 impressions for tweets posted in Phase 2, with an average of 1251.87 impressions per tweet pre-intervention versus 4802.85 impressions per tweet post-intervention. The total number of interactions with published articles was significantly higher post-SoMe than pre-SoMe (4,096,167 vs 269,152; p < 0.01 respectively).
Engagement with @ColorectalDis
Increasing engagement from followers was observed between the 2 phases. The total number of engagements in Phase 1 was 10,934, with an average of 50.86 engagements per tweet, increasing to 236,369 engagements in Phase 2, with an average of 240.46 engagements per tweet (an almost fivefold increase in engagements). The engagement rate in Phase 1 was 4.06%, rising to 5.01% in Phase 2. The total number of URL link clicks relating to published tweets also increased between the 2 phases, with 3533 URL clicks in Phase 1. This increased ninefold to 30,863 URL clicks in Phase 2.
Account growth and traditional metrics
Trends in increasing activity and engagement were also accompanied by significant differences in the number of followers, with a monthly average of 38 new followers per month in Phase 1 versus 213 (p < 0.01) new followers per month in Phase 2. This is also reflected by an increase in new subscribers (up 11%, p < 0.01). At the time of writing, the account has 12,283 followers. Article downloads increased nearly 20-fold (210,449 post-SoMe vs 10,934 pre-SoMe; p < 0.01). Article submissions increased by 24% during this timeframe (p < 0.01), as did the journal’s impact factor by 0.9 (p < 0.01).
Examples of ‘good practice’ used as part of the SoMe strategy
Increased tweet activity corresponded to specific events such as the Association of Coloproctology of Great Britain and Ireland (ACPGBI) Annual Meetings, weekly ‘takeovers’ by six junior editors, and themed ‘tweetchats’ which used the hashtag #colorectaldischat. Some examples of approaches to SoMe engagement used by @ColorectalDis are listed in Table 3 and shown in Figs. 1 and 2.
Discussion
This study highlights the advantages that a dedicated social media strategy has for surgical education and journal engagement with its stakeholders. In just 2.5 years, the benefits of a motivated core group without commercial SoMe experience or specific training have rapidly increased the reach of authors’ work within Colorectal Disease and increased their presence within the colorectal surgery community. For the foreseeable future, a designated multimodal SoMe approach is likely to remain important in maintaining journal relevance and being representative of and of interest to the journal’s readership.
Whilst Twitter is not necessarily the most popular global social media platform in terms of crude user numbers, the platform and its interface have a well-established clinician and patient base [17, 18]. Although Facebook is the most popular platform, with an estimated 1.7 billion users worldwide [19], surgeons appear to prefer the use of Twitter as a professional networking and microblogging tool. Facebook is often seen as more ‘personal’, with clinicians preferring to use this platform for connecting with friends and family due to enhanced privacy settings, compared to other more public platforms such as Twitter or Doximity [20]. Whilst ‘closed groups’ exist, the uptake by the medical community for using Facebook other than for advertising reasons is limited [21]. Instagram (owned by Facebook) is another popular platform which is primarily a photo-blogging application. This platform is traditionally more popular with younger demographics for image and video-sharing content, with an estimated 631 million users aged between 18 and 34 years old and 995 photos posted every second [22]. However, it is an application that is primarily for personal use or product advertisement, with seemingly limited engagement at present with surgical academia [23]. It may be that journals can utilise applications like Instagram as part of their SoMe educational strategy in the future, particularly to widen participation amongst medical students and surgeons-in-training (for example, using visual abstracts and reels) [24, 25]. Interestingly, there is evidence to show that the use of visual abstracts increased the number of impressions by 7.7-fold and retweets by 8.4-fold compared to tweets containing article titles alone [26]. It is therefore important that a journal’s SoMe team is forward-thinking and considers the future use of other SoMe platforms, as well as keeping abreast of its own monthly Twitter metrics to monitor trends in user engagement.
With huge increases in the @ColorectalDis follower base and higher engagement rates, the journal may be considered an ‘influencer’ account within colorectal academia [27]. ‘Influencers’ are generally considered to be SoMe accounts which ‘disproportionately impact the spread of information or some related behaviour of interest’ [28]. Thus, influence works on the principle of homophily, which inevitably may create echo chambers. Interestingly, one study using statistical modelling on Twitter demonstrated that the ‘word-of-mouth’ spread of small cascades of information is more likely to result in greater reach than information distribution from one very large following account [28]. Therefore, whilst a large follower count is a crude reflection of popularity and interest, individual users (such as engagement from journal editors, authors, and clinicians) are necessary to maximise information dissemination. It is currently unclear what the ‘target’ number of followers is required (the ‘number needed to tweet’); however, in comparison to other leading surgical journals, those with the highest impact factor tend to have a large follower base, regular tweet updates, use visual abstracts, and have a designated SoMe editor [29]. It is also unclear if it is the journal’s high impact factor itself which drives its popularity and engagement, if social media engagement increases the influence and thus impact factor of the journal, or if this is a mutually beneficial relationship. We hypothesise that it is likely to be the latter.
As with all SoMe platforms, caution must be exercised with their usage. Whilst Colorectal Disease is a peer-reviewed journal, caution must be considered regarding tweet content, as it is a digital and public representation of the journal. This places increased responsibility on those managing professional and educational SoMe accounts to post responsibly. Guidance on the ethical usage of SoMe in the UK is provided by the GMC [30], which also highlights the importance of respectful interactions between users. Careful consideration of tweet content is necessary to prevent the propagation of ‘fake news’, i.e., the spread of misinformation from sources of varying credibility and transparency [31, 32]. This may be exacerbated through an ‘echo chamber’ effect, where social media feeds are often tailored to display posts from like-minded users who share similar beliefs which further amplifies misinformation [33]. Other considerations for responsible SoMe usage include the potential for a security breach or an unauthorised user obtaining access to the account. Regular changes of passwords limited to a core group of SoMe team members may aid data security [34]. A further drawback of SoMe (particularly for content creators) is the increased risk of burnout associated with high levels of ‘screentime’, which may make it difficult for researchers to fully ‘switch off’ outside of work and on annual leave [35, 36].
Limitations within this study include an inherent English-language bias. Whilst efforts are made for the journal to be of interest to a global audience, the distribution map of followers has clearly demonstrated a predisposition to English-speaking countries, despite the increasing presence of Spanish-speaking (amongst others) surgeons using Twitter [37]. A distribution map was generated using the geo-locations inputted by followers as part of their account biographies (encompassing only one-fifth of the total number of @ColorectalDis followers (n = 2270)); therefore, the map may not necessarily be a true representation of where @ColorectalDis followers are based. Whilst the editorial committee (including junior editors) encompasses a wide variety of surgeons and surgeons-in-training from across the world with differing subspecialty interests, there is always room for increasing diversity of thought and collaboration which will in turn reduce the likelihood of an ‘echo chamber’ effect. A further limitation is that the impact factor of a journal may also be influenced by the publication of articles of greater interest to the wider public and readership or by greater overall numbers of submissions to journals. With the wider adoption of social media, other surgical Twitter accounts have seen an increase in followers. However, we did not have access to other surgical accounts to assess their metrics. It is not possible to confirm the causality of whether the increase in @ColorectalDis metrics was due to the new strategy or due to the increasing popularity and engagement with #SoMe, including other social media platforms.
Conclusion
The relationship between surgical academia and social media has changed drastically in the last 10 years. Guideline updates, surgical innovation, the sharing of ideas, and networking amongst global peers are now only ‘clicks’ (or tweets) away. For journals to remain relevant to their readership, a designated social media strategy is necessary. With increasing popularity, Twitter remains the ideal SoMe platform for journals to engage regularly with their stakeholders, and SoMe is likely to bear increasing importance in determining and influencing a journal’s impact factor. This study has demonstrated that a dedicated SoMe strategy has increased access to the journal’s content, increased user engagement and number of article downloads, and increased traffic to the journal’s website, providing further evidence that SoMe activity may advance surgical research and education, thus leading to a paradigm shift towards alternative academic metrics.
References
Kaplan AM, Haenlein M (2010) Users of the world, unite! The challenges and opportunities of social media. Bus Horiz 53(1):59–68
Our World in Data. Users by social media platform. Last accessed 6/8/21 via. https://ourworldindata.org/grapher/users-by-social-media-platform?tab=table&time=2004..latest&country=Facebook~Instagram~Snapchat~TikTok~Twitter~Whatsapp~YouTube
Guckian J, Utukuri M, Asif A, Burton O, Adeyoju J, Oumeziane A, Chu T, Rees EL (2021) Social media in undergraduate medical education: a systematic review. Med Educ 55(11):1227–1241
Steele SR, Arshad S, Bush R, Dasani S, Cologne K, Bleier JI, Raphaeli T, Kelz RR (2015) Social media is a necessary component of surgery practice. Surgery 158(3):857–862
Wexner SD, Petrucci AM, Brady RR, Ennis-O'Connor M, Fitzgerald JE, Mayol JJ (2017) Social media in colorectal surgery. Color Dis 19(2):105–114
Bisset CN, Carter B, Law J, Hewitt J, Parmar K, Moug SJ (2020) The influence of social media on recruitment to surgical trials. BMC Med Res Methodol 20(1):1
Brady RR, Chapman SJ, Atallah S, Chand M, Mayol J, Lacy AM, Wexner SD (2017) #Colorectalsurgery. Br J Surg 104(11):1470–1476
Keller DS, Winter DC, Pellino G, Cologne K, Smart NJ, Brady RR (2018) #Colorectalresearch: introducing a disruptive technology for academic surgery in the social media age. Dis Colon Rectum 61(3):279–280
Petrucci AM, Chand M, Wexner SD (2017) Hot topics: social media and surgery: social media: changing the paradigm for surgical education. Clin Colon Rectal Surg 30(4):244
Fox CS, Barry K, Colbert J (2016) Importance of social media alongside traditional medical publications. Circulation 133(20):1978–1983
Elsevier. Measuring a journal’s impact. Last accessed 6/8/21 via. https://www.elsevier.com/authors/tools-and-resources/measuring-a-journals-impact
Warren HR, Raison N, Dasgupta P (2017) The rise of Altmetrics. JAMA 317(2):131–132
Thelwall M, Haustein S, Larivière V, Sugimoto CR (2013) Do Altmetrics work? Twitter and ten other social web services. PLoS One 8:e64841. https://doi.org/10.1371/journal.pone.0064841
Jeong JW, Kim MJ, Oh HK, Jeong S, Kim MH, Cho JR, Kim DW, Kang SB (2019) The impact of social media on citation rates in coloproctology. Color Dis 21(10):1175–1182
O'Kelly F, Nason GJ, Manecksha RP, Cascio S, Quinn FJ, Leonard M, Koyle MA, Farhat W, Leveridge MJ (2017) The effect of social media (# SoMe) on journal impact factor and parental awareness in paediatric urology. J Pediatr Urol 13(5):513–5e1
Buckarma EH, Thiels CA, Gas BL, Cabrera D, Bingener-Casey J, Farley DR (2017) Influence of social media on the dissemination of a traditional surgical research article. J Surg Educ 74(1):79–83
Grossman R, Sgarbura O, Hallet J, Søreide K (2021) Social media in surgery: evolving role in research communication and beyond. Langenbeck's Arch Surg 28:1–6
McDonald JJ, Bisset C, Coleman MG, Speake D, Brady RR (2015) Contemporary use of social media by consultant colorectal surgeons. Color Dis 17(2):165–171
Statista. Social media usage worldwide. Last accessed 6/8/21 via. https://www.statista.com/study/12393/social-networks-statista-dossier/
Langenfeld SJ, Vargo DJ, Schenarts PJ (2016) Balancing privacy and professionalism: a survey of general surgery program directors on social media and surgical education. J Surg Educ 73(6):e28–e32
Bittner JG, Logghe HJ, Kane ED, Goldberg RF, Alseidi A, Aggarwal R et al (2019) A Society of Gastrointestinal and Endoscopic Surgeons (SAGES) statement on closed social media (Facebook®) groups for clinical education and consultation: issues of informed consent, patient privacy, and surgeon protection. Surg Endosc 33(1):1–7
Aslam S. Instagram by the numbers: stats, demographics & fun facts. Last accessed 6/8/21 via. https://www.omnicoreagency.com/instagram-statistics
Dorfman RG, Vaca EE, Mahmood E, Fine NA, Schierle CF (2018) Plastic surgery-related hashtag utilization on Instagram: implications for education and marketing. Aesthet Surg J 38(3):332–338
Wong XL, Liu RC, Sebaratnam DF (2019) Evolving role of Instagram in #medicine. Intern Med J 49(10):1329–1332
Chapman SJ, Grossman RC, FitzPatrick ME, Brady RR (2019) Randomized controlled trial of plain English and visual abstracts for disseminating surgical research via social media. Br J Surg 106(12):1611–1616
Ibrahim AM, Lillemoe KD, Klingensmith ME, Dimick JB (2017) Visual abstracts to disseminate research on social media: a prospective, case-control crossover study. Ann Surg 266(6):e46–e48
Keller DS, McDermott FD (2020) Social media and the evolution of colorectal disease. Color Dis 22(2):127–128. https://doi.org/10.1111/codi.14974 PMID: 32017370
Bakshy E, Hofman JM, Mason WA, Watts DJ (2011) Everyone’s an influencer: quantifying influence on twitter. In: Proceedings of the fourth ACM international conference on Web search and data mining, pp 65–74
Søreide K (2019) Numbers needed to tweet: social media and impact on surgery. Eur J Surg Oncol 45(2):292–295
General Medical Council. Ethical guidance for doctors: use of social media (2013) Last accessed 13/3/21 via. https://www.gmc-uk.org/ethical-guidance/ethical-guidance-for-doctors/doctors-use-of-social-media
Merchant RM, Asch DA (2018) Protecting the value of medical science in the age of social media and “fake news”. JAMA 320(23):2415–2416. https://doi.org/10.1001/jama.2018.18416
Brady JT, Kelly ME, Stein SL (2017) Hot topics: social media and surgery: the Trump effect: with no peer review, How do we know what to really believe on social media? Clin Colon Rectal Surg 30(4):270
Chou WS, Oh A, Klein WMP (2018) Addressing health-related misinformation on social media. JAMA 320(23):2417–2418. https://doi.org/10.1001/jama.2018.16865
Denecke K, Bamidis P, Bond C, Gabarron E, Househ M, Lau AY, Mayer MA, Merolli M, Hansen M (2015) Ethical issues of social media usage in healthcare. Yearb Med Inform 10(1):137
Mheidly N, Fares MY, Fares J (2020) Coping with stress and burnout associated with telecommunication and online learning. Front Public Health 8:672
Sansone RA, Sansone LA (2013) Cell phones: the psychosocial risks. Innov Clin Neurosci 10(1):33
Cabrera LF, Ferrada P, Mayol J, Mendoza AC, Herrera G, Pedraza M, Sanchez S (2020) Impact of social media on the continuous education of the general surgeon, a new experience, @ Cirbosque: a Latin American example. Surgery 167(6):890–894
Acknowledgements
The authors would like to thank Mr. Neil Smart (editor of Colorectal Disease), our other associate editors, all of the reviewers and readers of Colorectal Disease, and the wider social media community for their support for this study. Since the time of writing and submission, Twitter has been renamed ‘X’.
Funding
The authors received no funding support for this work.
Author information
Authors and Affiliations
Contributions
CB extracted data, synthesised results, and wrote the first draft manuscript alongside all subsequent redrafts. FM co-designed the study, contributed to data interpretation, and contributed to all drafts and critical revisions of the manuscript. DK co-designed the study, contributed to data acquisition and interpretation, and contributed to all drafts and critical revisions of the manuscript. All authors approve of the final redrafted manuscript for submission.
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing interests.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Bisset, C.N., McDermott, F.D. & Keller, D.S. The impact of a dedicated social media strategy on enhancing surgical education. Langenbecks Arch Surg 408, 412 (2023). https://doi.org/10.1007/s00423-023-03148-0
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s00423-023-03148-0