Skip to main content

Advertisement

SpringerLink
Log in

A real-time biosurveillance mechanism for early-stage disease detection from microblogs: a case study of interconnection between emotional and climatic factors related to migraine disease

  • Original Article
  • Published:
Network Modeling Analysis in Health Informatics and Bioinformatics Aims and scope Submit manuscript

Abstract

For many years, certain climatic factors have been used to predict potential disease outcomes of relevance to humans. This is because early discovery of disease (or its symptoms) would help people or healthcare professionals to take the necessary precautions. Since microblogs can be used to create new connections and maintain existing relationships, disease detection in microblogs is still considered a serious problem for many healthcare systems, especially for establishing a successful epidemic recognition procedure. To tackle this issue, this study proposed a novel tracking approach to diagnose illnesses in microblogs. It is based on the interconnection between certain emotional type and climatic factors associated with a specific disease (e.g., migraine). In this study, detailed migraine data were collected from Twitter. We used K-means and Apriori algorithms to extract migraine-related emotions and investigate the potential associations between migraine symptoms and climatic factors. The results showed that sad emotions were highly interrelated with migraine symptoms. The classification results showed that Sequential Minimal Optimization (SMO) was efficient (95.53% accuracy) in detecting the migraine symptoms from Twitter. The proposed mechanism can be used efficiently in biosurveillance systems due to its capability in identifying the hidden symptoms of a sickness on microblogs. This study paves the way to discover disease-related features using both emotional and climatic factors.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

References

  • Aha DW, Kibler D, Albert MK (1991) Instance-based learning algorithms. Mach Learn 6(1):37–66

    Google Scholar 

  • Aiello AE, Renson A, Zivich PN (2020) Social media–and internet-based disease surveillance for public health. Ann Rev Public Health. https://doi.org/10.1146/annurev-publhealth-040119-094402

    Article  Google Scholar 

  • Aramaki E, Maskawa S, Morita M (2011) Twitter catches the flu Detecting influenza epidemics using twitter. In: Proceedings of the conference on empirical methods in natural language processing. Association for Computational Linguistics, Stroudsburg, pp 1568–1576

    Google Scholar 

  • Atefeh F, Khreich W (2015) A survey of techniques for event detection in twitter. Comput Intell 31(1):132–164

    MathSciNet  Google Scholar 

  • Banciu A, Bouleanu EL (2018) The experience of persons living with migraine. Acta Medica Transilvanica 23(2):27–29

    Google Scholar 

  • Barnaghi P, Ghaffari P, Breslin JG (2016) Opinion mining and sentiment polarity on twitter and correlation between events and sentiment. In: 2016 IEEE second international conference on big data computing service and applications (BigDataService). IEEE, Oxford, pp 52–57.

  • Bhattacharjee U, Srijith P, Desarkar MS (2019) Term specific tf-idf boosting for detection of rumours in social networks. In: 2019 11th International conference on communication systems and networks (COMSNETS). IEEE, Bengaluru, India, pp 726–731.

  • Boit J, El-Gayar O (2020) Topical mining of malaria using social media. A text mining approach. In: Proceedings of the 53rd Hawaii International Conference on System Sciences https://doi.org/10.24251/HICSS.2020.466.

  • Broniatowski DA, Paul MJ, Dredze M (2013) National and local influenza surveillance through twitter: an analysis of the 2012–2013 influenza epidemic. PLoS ONE 8(12):e83672

    Google Scholar 

  • Bujisic M, Bogicevic V, Parsa H, Jovanovic V, Sukhu A (2019) It’s raining complaints! How weather factors drive consumer comments and word-of-mouth. J Hosp Tour Res 43(5):656–681

    Google Scholar 

  • Burton SH, Tanner KW, Giraud-Carrier CG, West JH, Barnes MD (2012) "Right time, right place" health communication on twitter: value and accuracy of location information. J Med Int Res 14(6):34–52

    Google Scholar 

  • Buse DC, Loder EW, Gorman JA, Stewart WF, Reed ML, Fanning KM et al (2013) Sex differences in the prevalence, symptoms, and associated features of migraine, probable migraine and other severe headache: results of the American migraine prevalence and prevention (ampp) study. Headache 53(8):1278–1299

    Google Scholar 

  • Byrd K, Mansurov A, Baysal O (2016) Mining twitter data for influenza detection and surveillance. In: Proceedings of the international workshop on software engineering in healthcare systems, ACM, Austin, Texas, pp 43–49.

  • Capi M, Gentile G, Lionetto L, Salerno G, Cipolla F, Curto M et al (2018) Pharmacogenetic considerations for migraine therapies. Expert Opin Drug Metab Toxicol 14(11):1161–1167

    Google Scholar 

  • Chai NC, Rosenberg JD, Peterlin BL (2012) The epidemiology and comorbidities of migraine and tension-type headache. Techniques in Region Anesth Pain Manag 16(1):4–13

    Google Scholar 

  • Chen Y-D, Brown SA, Hu PJ-H, King C-C, Chen H (2011) Managing emerging infectious diseases with information systems: reconceptualizing outbreak management through the lens of loose coupling. Inf Syst Res 22(3):447–468

    Google Scholar 

  • Choubey DK, Kumar P, Tripathi S, Kumar S (2020) Performance evaluation of classification methods with pca and pso for diabetes. Netw Model Anal Health Inf Bioinf 9(1):5–19

    Google Scholar 

  • Cioffi I, Farella M, Chiodini P, Ammendola L, Capuozzo R, Klain C et al (2017) Effect of weather on temporal pain patterns in patients with temporomandibular disorders and migraine. J Oral Rehabil 44(5):333–339

    Google Scholar 

  • Clark EM, James T, Jones CA, Alapati A, Ukandu P, Danforth CM, Dodds PS (2018) A sentiment analysis of breast cancer treatment experiences and healthcare perceptions across twitter. arXiv:1805.09959.

  • Culotta A (2010) Towards detecting influenza epidemics by analyzing twitter messages. In: Proceedings of the first workshop on social media analytics, ACM, Washington D.C, pp 115–122.

  • Dales RE, Cakmak S, Vidal CB (2009) Air pollution and hospitalization for headache in Chile. Am J Epidemiol 170(8):1057–1066

    Google Scholar 

  • Erraguntla M, Zapletal J, Lawley M (2019) Framework for infectious disease analysis: a comprehensive and integrative multi-modeling approach to disease prediction and management. Health Inf J 25(4):1170–1187

    Google Scholar 

  • Ettema D, Friman M, Olsson LE, Gärling T (2017) Season and weather effects on travel-related mood and travel satisfaction. Front Psychol 8:140–163

    Google Scholar 

  • Fang Z-H, Chen CC (2016) A novel trend surveillance system using the information from web search engines. Decis Support Syst 88:85–97

    Google Scholar 

  • Harris JK, Hawkins JB, Nguyen L, Nsoesie EO, Tuli G, Mansour R, Brownstein JS (2017) Research brief report: using twitter to identify and respond to food poisoning: The food safety stl project. J Public Health Manag Pract 23(6):577–592

    Google Scholar 

  • Hartley DM, Nelson NP, Arthur R, Barboza P, Collier N, Lightfoot N et al (2013) An overview of internet biosurveillance. Clin Microbiol Infect 19(11):1006–1013

    Google Scholar 

  • Hoffmann J, Schirra T, Lo H, Neeb L, Reuter U, Martus P (2015) The influence of weather on migraine–are migraine attacks predictable? Ann Clin Trans Neurol 2(1):22–28

    Google Scholar 

  • Holte RC (1993) Very simple classification rules perform well on most commonly used datasets. Mach Learn 11(1):63–90

    MATH  Google Scholar 

  • Huang Z, Dong W, Duan H (2015) A probabilistic topic model for clinical risk stratification from electronic health records. J Biomed Inform 58:28–36

    Google Scholar 

  • Jehn M, Appel LJ, Sacks FM, Miller ER (2002) The effect of ambient temperature and barometric pressure on ambulatory blood pressure variability. Am J Hypertens 15(11):941–945

    Google Scholar 

  • Jordan SE, Hovet SE, Fung IC-H, Liang H, Fu K-W, Tse ZTH (2019) Using twitter for public health surveillance from monitoring and prediction to public response. Data 4(1):6–16

    Google Scholar 

  • Joshi A, Sparks R, McHugh J, Karimi S, Paris C, MacIntyre CR (2020) Harnessing tweets for early detection of an acute disease event. Epidemiology 31(1):90–97

    Google Scholar 

  • Kämpfer S, Mutz M (2013) On the sunny side of life: sunshine effects on life satisfaction. Soc Indic Res 110(2):579–595

    Google Scholar 

  • Kamsu-Foguem B, Rigal F, Mauget F (2013) Mining association rules for the quality improvement of the production process. Expert Syst Appl 40(4):1034–1045

    Google Scholar 

  • Karami A, Dahl AA, Turner-McGrievy G, Kharrazi H, Shaw G Jr (2018) Characterizing diabetes, diet, exercise, and obesity comments on twitter. Int J Inf Manage 38(1):1–6

    Google Scholar 

  • Kim K-N, Lim Y-H, Bae HJ, Kim M, Jung K, Hong Y-C (2016) Long-term fine particulate matter exposure and major depressive disorder in a community-based urban cohort. Environ Health Perspect 124(10):1547–1553

    Google Scholar 

  • Kitagawa Y, Komachi M, Aramaki E, Okazaki N, Ishikawa H (2015) Disease event detection based on deep modality analysis. In: Proceedings of the ACL-IJCNLP 2015 Student Research Workshop, ACL Anthology, Beijing, pp 28–34.

  • Kööts L, Realo A, Allik J (2011) The influence of the weather on affective experience. J Individ Differ 32:74–84

    Google Scholar 

  • Lamb A, Paul MJ, Dredze M (2013) Separating fact from fear: Tracking flu infections on twitter. In: Proceedings of the 2013 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, ACL Anthology, Atlanta, Georgia, pp 789–795.

  • Lantéri-Minet M, Duru G, Mudge M, Cottrell S (2011) Quality of life impairment, disability and economic burden associated with chronic daily headache, focusing on chronic migraine with or without medication overuse: a systematic review. Cephalalgia 31(7):837–850

    Google Scholar 

  • Lim S, Tucker CS, Kumara S (2017) An unsupervised machine learning model for discovering latent infectious diseases using social media data. J Biomed Inform 66:82–94

    Google Scholar 

  • Liu F, Weng C, Yu H (2019) Advancing clinical research through natural language processing on electronic health records: Traditional machine learning meets deep learning. In: Clinical Research Informatics. Springer, Cham, pp 357–378

    Google Scholar 

  • Makris GD, Reutfors J, Larsson R, Isacsson G, Ösby U, Ekbom A et al (2016) Serotonergic medication enhances the association between suicide and sunshine. J Affect Disord 189:276–281

    Google Scholar 

  • Mannix S, Skalicky A, Buse DC, Desai P, Sapra S, Ortmeier B et al (2016) Measuring the impact of migraine for evaluating outcomes of preventive treatments for migraine headaches. Health Qual Life Out 14(1):143–168

    Google Scholar 

  • Molaei S, Khansari M, Veisi H, Salehi M (2019) Predicting the spread of influenza epidemics by analyzing twitter messages. Health Technol 1:1–16

    Google Scholar 

  • Naslund JA, Aschbrenner KA, McHugo GJ, Unützer J, Marsch LA, Bartels SJ (2019) Exploring opportunities to support mental health care using social media: a survey of social media users with mental illness. Early Interv Psychiaty 13(3):405–413

    Google Scholar 

  • Nejad MY, Delghandi MS, Bali AO, Hosseinzadeh M (2020) Using twitter to raise the profile of childhood cancer awareness month. Netw Model Anal Health Inf Bioinf 9(1):3–18

    Google Scholar 

  • Noelke C, McGovern M, Corsi DJ, Jimenez MP, Stern A, Wing IS, Berkman L (2016) Increasing ambient temperature reduces emotional well-being. Environ Res 151:124–129

    Google Scholar 

  • Patowary P, Sarmah R, Bhattacharyya DK (2020) Developing an effective biclustering technique using an enhanced proximity measure. Netw Model Anal Health Inf Bioinf 9(1):1–17

    Google Scholar 

  • Paul MJ, Sarker A, Brownstein JS, Nikfarjam A, Scotch M, Smith KL, Gonzalez G (2016) Social media mining for public health monitoring and surveillance. In: Biocomputing 2016: Proceedings of the Pacific symposium, World Scientific, Kohala Coast, Hawaii, pp 468–479.

  • Peres MFP, Mercante JP, Tobo PR, Kamei H, Bigal ME (2017) Anxiety and depression symptoms and migraine: a symptom-based approach research. J Headache Pain 18(1):37–52

    Google Scholar 

  • Petridou E, Papadopoulos FC, Frangakis CE, Skalkidou A, Trichopoulos D (2002) A role of sunshine in the triggering of suicide. Epidemiology 13(1):106–109

    Google Scholar 

  • Plattt J (1998) Fast training of support vector machines using sequential minimal optimization. In: Schlkopf B, Burges C, Smola A (eds) Advances in kernel methods-support vector learning. MIT Press, Cambridge

    Google Scholar 

  • Poole S, Schroeder LF, Shah N (2016) An unsupervised learning method to identify reference intervals from a clinical database. J Biomed Inform 59:276–284

    Google Scholar 

  • Power MC, Kioumourtzoglou M-A, Hart JE, Okereke OI, Laden F, Weisskopf MG (2015) The relation between past exposure to fine particulate air pollution and prevalent anxiety: observational cohort study. Br Med J 350:h1111. https://doi.org/10.1136/bmj.h1111

    Article  Google Scholar 

  • Priyadarshi A, Saha SK (2020) Web information extraction for finding remedy based on a patient-authored text: a study on homeopathy. Netw Model Anal Health Inf Bioinf 9(1):1–12

    Google Scholar 

  • Ravat S, Chaudhari S, Chafekar N (2019) Clinical profile of primary headaches and awareness of trigger factors in migraine patients. MVP J Med Sci 5(2):145–150

    Google Scholar 

  • Richter AN, Khoshgoftaar TM (2020) Sample size determination for biomedical big data with limited labels. Netw Model Anal Health Inf Bioinf 9(1):12

    Google Scholar 

  • Ring M, Eskofier BM (2016) An approximation of the gaussian rbf kernel for efficient classification with svms. Pattern Recogn Lett 84:107–113

    Google Scholar 

  • Sabatovych I (2019a) Do social media create revolutions? Using twitter sentiment analysis for predicting the Maidan revolution in Ukraine. Glob Media Commun 15(3):275–283

    Google Scholar 

  • Sabatovych I (2019b) Use of sentiment analysis for predicting public opinion on referendum: a feasibility study. Reference Librarian 60(3):202–211

    Google Scholar 

  • Salzberg SL (1994) C4. 5: Programs for machine learning by J. Ross Wuinlan. Morgan Kaufmann Publishers, inc., 1993. Mach Learn 16(3):235–240

    Google Scholar 

  • Santillana M, Nguyen A, Louie T, Zink A, Gray J, Sung I, Brownstein JS (2016) Cloud-based electronic health records for real-time, region-specific influenza surveillance. Sci Rep 6:25732

    Google Scholar 

  • Sarsam SM, Al-Samarraie H (2018) A first look at the effectiveness of personality dimensions in promoting users’ satisfaction with the system. SAGE Open 8(2):2158244018769125

    Google Scholar 

  • Sarsam SM, Al-Samarraie H, Omar B (2019) Geo-spatial-based emotions: a mechanism for event detection in microblogs. In: Proceedings of the 2019 8th International Conference on Software and Computer Applications, ACM, Penang, Malaysia, pp 1–5.

  • Savini L, Tora S, Di Lorenzo A, Cioci D, Monaco F, Polci A et al (2018) A web geographic information system to share data and explorative analysis tools: the application to west Nile disease in the Mediterranean basin. PLoS ONE 13(6):e0196429

    Google Scholar 

  • Schneider A, Schuh A, Maetzel F-K, Rückerl R, Breitner S, Peters A (2008) Weather-induced ischemia and arrhythmia in patients undergoing cardiac rehabilitation: another difference between men and women. Int J Biometeorol 52(6):535–547

    Google Scholar 

  • Schroeder RA, Brandes J, Buse DC, Calhoun A, Eikermann-Haerter K, Golden K et al (2018) Sex and gender differences in migraine—evaluating knowledge gaps. J Women's Health 27(8):965–973

    Google Scholar 

  • Șerban O, Thapen N, Maginnis B, Hankin C, Foot V (2019) Real-time processing of social media with sentinel: a syndromic surveillance system incorporating deep learning for health classification. Inf Process Manage 56(3):1166–1184

    Google Scholar 

  • Shin J, Park JY, Choi J (2018) Long-term exposure to ambient air pollutants and mental health status: a nationwide population-based cross-sectional study. PLoS ONE 13(4):e0195607

    Google Scholar 

  • Singh R, Sodhi (2013) Improving efficiency of Apriori algorithm using transaction reduction. Int J Sci Res Pub 3(1):1–4

    Google Scholar 

  • Spasova Z (2012) The effect of weather and its changes on emotional state–individual characteristics that make us vulnerable. Adv Sci Res 6(1):281–290

    Google Scholar 

  • Tian J, Zhang Y, Zhang C (2018) Predicting consumer variety-seeking through weather data analytics. Electron Commer Res Appl 28:194–207

    Google Scholar 

  • Vioulès MJ, Moulahi B, Azé J, Bringay S (2018) Detection of suicide-related posts in twitter data streams. IBM J Res Dev 62(1):1–7

    Google Scholar 

  • Wang Y, Xu K, Kang Y, Wang H, Wang F, Avram A (2020) Regional influenza prediction with sampling twitter data and PDE model. Int J Environ Res Public Health 17(3):678

    Google Scholar 

  • Weng J, Lee B-S (2011) Event detection in twitter. In: Proceedings of the Fifth International AAAI Conference on Weblogs and Social Media, AAAI, Barcelona, Spain, pp 401–408.

  • Yang AC, Fuh J-L, Huang NE, Shia B-C, Wang S-J (2015) Patients with migraine are right about their perception of temperature as a trigger: time series analysis of headache diary data. J Headache Pain 16(1):49–71

    Google Scholar 

  • Zadeh AH, Zolbanin HM, Sharda R, Delen D (2019) Social media for nowcasting flu activity: spatio-temporal big data analysis. Inf Syst Front 1:1–18

    Google Scholar 

  • Zaeem RN, Liau D, Barber KS (2018) Predicting disease outbreaks using social media: finding trustworthy users. In: Proceedings of the Future Technologies Conference. Springer, Cham, pp 369–384

    Google Scholar 

  • Zebenholzer K, Rudel E, Frantal S, Brannath W, Schmidt K, Wöber-Bingöl Ç, Wöber C (2011) Migraine and weather: a prospective diary-based analysis. Cephalalgia 31(4):391–400

    Google Scholar 

Download references

Acknowledgement

This study was supported by Research University Grant (No. 304/PCOMM/6315373) of Universiti Sains Malaysia.

Author information

Authors and Affiliations

  1. School of Communication, Universiti Sains Malaysia, Penang, Malaysia

    Samer Muthana Sarsam & Nurzali Ismail

  2. School of Media and Performing Arts, University of Coventry, Coventry, UK

    Hosam Al-Samarraie & Bianca Wright

  3. Applied Media Program, Higher Colleges of Technology (HCT), Ras AL khaimah, UAE

    Fahed Zaqout

Authors
  1. Samer Muthana Sarsam
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Hosam Al-Samarraie
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Nurzali Ismail
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Fahed Zaqout
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Bianca Wright
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Samer Muthana Sarsam.

Ethics declarations

Conflict of interest

The author declare that they have no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Sarsam, S.M., Al-Samarraie, H., Ismail, N. et al. A real-time biosurveillance mechanism for early-stage disease detection from microblogs: a case study of interconnection between emotional and climatic factors related to migraine disease. Netw Model Anal Health Inform Bioinforma 9, 32 (2020). https://doi.org/10.1007/s13721-020-00239-6

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s13721-020-00239-6

Keywords

Search

Navigation