Advertisement

Current Psychiatry Reports

, 16:523 | Cite as

New Measures of Mental State and Behavior Based on Data Collected From Sensors, Smartphones, and the Internet

  • Tasha Glenn
  • Scott Monteith
Psychiatry in the Digital Age (JS Luo, Section Editor)
Part of the following topical collections:
  1. Topical Collection on Psychiatry in the Digital Age

Abstract

With the rapid and ubiquitous acceptance of new technologies, algorithms will be used to estimate new measures of mental state and behavior based on digital data. The algorithms will analyze data collected from sensors in smartphones and wearable technology, and data collected from Internet and smartphone usage and activities. In the future, new medical measures that assist with the screening, diagnosis, and monitoring of psychiatric disorders will be available despite unresolved reliability, usability, and privacy issues. At the same time, similar non-medical commercial measures of mental state are being developed primarily for targeted advertising. There are societal and ethical implications related to the use of these measures of mental state and behavior for both medical and non-medical purposes.

Keywords

Remote monitoring E-mental health Smartphone Behavioral targeting Emotion recognition 

Notes

Compliance With Ethics Guidelines

Conflict of Interest

Scott Monteith declares no conflict of interest.

Tasha Glenn shares a patent for ChronoRecord software but does not receive any financial compensation from the ChronoRecord Association, a 501(c)(3) nonprofit organization.

Human and Animal Rights and Informed Consent

This article does not contain any studies with human or animal subjects performed by any authors.

References

Papers of particular interest, published recently, have been highlighted as: • Of importance

  1. 1.
    Singh I, Rose N. Biomarkers in psychiatry. Nature. 2009;460:202–7.PubMedCrossRefGoogle Scholar
  2. 2.
    Kapur S, Phillips AG, Insel TR. Why has it taken so long for biological psychiatry to develop clinical tests and what to do about it? Mol Psychiatry. 2012;17:1174–9.PubMedCrossRefGoogle Scholar
  3. 3.
    Biomarkers Definitions Working Group. Biomarkers and surrogate endpoints: preferred definitions and conceptual framework. Clin Pharmacol Ther. 2001;69:89–95.CrossRefGoogle Scholar
  4. 4.
    Lesko LJ, Atkinson Jr AJ. Use of biomarkers and surrogate endpoints in drug development and regulatory decision making: criteria, validation, strategies. Annu Rev Pharmacol Toxicol. 2001;41:347–66.PubMedCrossRefGoogle Scholar
  5. 5.
    Lakhan SE, Kramer A. Schizophrenia genomics and proteomics: are we any closer to biomarker discovery? Behav Brain Funct. 2009;5:2.PubMedCentralPubMedCrossRefGoogle Scholar
  6. 6.
    McIntyre RS, Cha DS, Jerrell JM, et al. Advancing biomarker research: utilizing ‘Big Data’ approaches for the characterization and prevention of bipolar disorder. Bipolar Disord. 2014;16(5):531–47.PubMedCrossRefGoogle Scholar
  7. 7.
    Weiser M. The computer for the 21st century. Sci Am. 1991;265:94–104.CrossRefGoogle Scholar
  8. 8.
    Gershenfeld N, Krikorian R, Cohen D. The Internet of things. Sci Am. 2004;291:76.PubMedCrossRefGoogle Scholar
  9. 9.
    Vinge V. Who’s afraid of first movers? Singularity Summit 2012. https://docs.google.com/document/d/1W7Vs8e3MNwjU_1ZZZqmq0O-dFKCwD4VRyww-qOvDdRU/pub. Accessed 9 Jul 2014.
  10. 10.
    Venta L, Isomursu M, Ahtinen A et al. “My phone is a part of my soul”—how people bond with their mobile phones. In Mobile Ubiquitous Computing, Systems, Services and Technologies, 2008. UBICOMM ’08. The second international conference on IEEE, 2008; 311–17Google Scholar
  11. 11.
    Srivastava L. Mobile phones and the evolution of social behaviour. Behav Inf Technol. 2005;24:111–29.CrossRefGoogle Scholar
  12. 12.
    Korhonen I, Bardram JE. Guest editorial: introduction to the special section on pervasive healthcare. IEEE Trans Inf Technol Biomed. 2004;8:229–34.PubMedCrossRefGoogle Scholar
  13. 13.
    Cisco Systems. Internet of things. http://www.cisco.com/web/solutions/trends/iot/indepth.html. Accessed 9 Jul 2014.
  14. 14.
    US Census. International data base. World population: 1950–2050. 2011 http://www.census.gov/population/international/data/idb/worldpopgraph.php. Accessed 9 Jul 2014.
  15. 15.
    Varshney U. Pervasive healthcare and wireless health monitoring. Mob Netw Appl. 2007;12:113–27.CrossRefGoogle Scholar
  16. 16.
    Orwat C, Graefe A, Faulwasser T. Towards pervasive computing in health care—a literature review. BMC Med Inform Decis Mak. 2008;8:26.PubMedCentralPubMedCrossRefGoogle Scholar
  17. 17.
    Kalorama Information. Remote and wireless patient monitoring markets. 2011. http://www.kaloramainformation.com/Remote-Wireless-Patient-6487095/. Accessed 9 Jul 2014.
  18. 18.
    Marshall M, Rathbone J. Early intervention for psychosis. Schizophr Bull. 2011;37:1111–4.PubMedCentralPubMedCrossRefGoogle Scholar
  19. 19.
    Berk M, Brnabic A, Dodd S, et al. Does stage of illness impact treatment response in bipolar disorder? Empirical treatment data and their implication for the staging model and early intervention. Bipolar Disord. 2011;13:87–98.PubMedCrossRefGoogle Scholar
  20. 20.
    Killackey E, Yung AR. Effectiveness of early intervention in psychosis. Curr Opin Psychiatry. 2007;20:121–5.PubMedCrossRefGoogle Scholar
  21. 21.
    Bulloch AG, Patten SB. Non-adherence with psychotropic medications in the general population. Soc Psychiatry Psychiatr Epidemiol. 2010;45:47–56.PubMedCrossRefGoogle Scholar
  22. 22.
    Cramer JA, Rosenheck R. Compliance with medication regimens for mental and physical disorders. Psychiatr Serv. 1998;49:196–201.PubMedCrossRefGoogle Scholar
  23. 23.•
    Kane JM, Perlis RH, DiCarlo LA, et al. First experience with a wireless system incorporating physiologic assessments and direct confirmation of digital tablet ingestions in ambulatory patients with schizophrenia or bipolar disorder. J Clin Psychiatry. 2013;74:e533–40. Pilot study using sensors embedded in placebo tablets.PubMedCrossRefGoogle Scholar
  24. 24.
    Lauderdale DS, Knutson KL, Yan LL, et al. Self-reported and measured sleep duration: how similar are they? Epidemiology. 2008;19:838–45.PubMedCentralPubMedCrossRefGoogle Scholar
  25. 25.
    Cook IA. Biomarkers in psychiatry: potentials, pitfalls, and pragmatics. Prim Psychiatry. 2008;15:54.Google Scholar
  26. 26.
    Wood A, Stankovic JA, Virone G, et al. Context-aware wireless sensor networks for assisted living and residential monitoring. IEEE Netw. 2008;22:26–33.CrossRefGoogle Scholar
  27. 27.
    Braddock D, Rizzolo MC, Thompson M, et al. Emerging technologies and cognitive disability. J Spec Educ Technol. 2004;19:49–56.Google Scholar
  28. 28.
    Milenković A, Otto C, Jovanov E. Wireless sensor networks for personal health monitoring: issues and an implementation. Comput Commun. 2006;29:2521–33.CrossRefGoogle Scholar
  29. 29.
    Darwish A, Hassanien AE. Wearable and implantable wireless sensor network solutions for healthcare monitoring. Sensors. 2011;11:5561–95.PubMedCentralPubMedCrossRefGoogle Scholar
  30. 30.
    Pentland A. Healthwear: medical technology becomes wearable. Computer. 2004;37:42–9.CrossRefGoogle Scholar
  31. 31.
    Alemdar H, Ersoy C. Wireless sensor networks for healthcare: a survey. Comput Netw. 2010;54:2688–710.CrossRefGoogle Scholar
  32. 32.
    Yoo H-J. Your heart on your sleeve: advances in textile-based electronics are weaving computers right into the clothes we wear. IEEE Solid-State Circ Mag. 2013;5:59–70.Google Scholar
  33. 33.
    Lowe SA, Ólaighin G. Monitoring human health behaviour in one’s living environment: a technological review. Med Eng Phys. 2014;36:147–68.PubMedCrossRefGoogle Scholar
  34. 34.
    Jerritta S, Murugappan M, Nagarajan R, et al. Physiological signals based human emotion recognition: a review. In Signal Processing and its Applications (CSPA), 2011 I.E. 7th International Colloquium on. IEEE. 2011:410–15Google Scholar
  35. 35.
    Alvarez-Lozano J, Frost M, Osmani V, et al. Tell me your apps and I will tell you your mood: correlation of apps usage with bipolar disorder state. ACM proceedings of 7th international conference on pervasive technologies related to assistive environments. 2014.Google Scholar
  36. 36.
    Kotikalapudi R, Chellappan S, Montgomery F, et al. Associating Internet usage with depressive behavior among college students. IEEE Technol Soc Mag. 2012;31:73–80.CrossRefGoogle Scholar
  37. 37.•
    De Choudhury M, Counts S, Horvitz E, et al. Predicting depression via social media. 2013. Microsoft Research. http://research.microsoft.com/apps/pubs/default.aspx?id=192721. Accessed 9 Jul 2014. Example of analyzing social media to predict mood.
  38. 38.
  39. 39.
    Picard RW. Affective computing. Cambridge: MIT; 1997.CrossRefGoogle Scholar
  40. 40.
    Pepe MS, Thompson ML. Combining diagnostic test results to increase accuracy. Biostatistics. 2000;1:123–40.PubMedCrossRefGoogle Scholar
  41. 41.
    Pletcher MJ, Pignone M. Evaluating the clinical utility of a biomarker: a review of methods for estimating health impact. Circulation. 2011;123:1116–24.PubMedCentralPubMedCrossRefGoogle Scholar
  42. 42.
    Perlis RH. Translating biomarkers to clinical practice. Mol Psychiatry. 2011;16:1076–87.PubMedCentralPubMedCrossRefGoogle Scholar
  43. 43.
    Brenner H, Gefeller O. Variation of sensitivity, specificity, likelihood ratios and predictive values with disease prevalence. Stat Med. 1997;16:981–91.PubMedCrossRefGoogle Scholar
  44. 44.
    Mayeux R. Biomarkers: potential uses and limitations. NeuroRx. 2004;1:182–8.PubMedCentralPubMedCrossRefGoogle Scholar
  45. 45.
    Gerszten RE, Wang TJ. The search for new cardiovascular biomarkers. Nature. 2008;451:949–52.PubMedCrossRefGoogle Scholar
  46. 46.
    Monteith S, Glenn T, Bauer M. Searching the internet for health information about bipolar disorder: some cautionary issues. Int J Bipolar Disord. 2013;1:22.PubMedCentralPubMedCrossRefGoogle Scholar
  47. 47.•
    Ko JG, Lu C, Srivastava MB, et al. Wireless sensor networks for healthcare. Proc IEEE. 2010;98:1947–60. Clear overview article.CrossRefGoogle Scholar
  48. 48.
    Chan M, Estève D, Fourniols JY, et al. Smart wearable systems: current status and future challenges. Artif Intell Med. 2012;56:137–56.PubMedCrossRefGoogle Scholar
  49. 49.
    Healey J, Nachman L, Subramanian S, et al. Out of the lab and into the fray: towards modeling emotion in everyday life. In Pervasive computing. Springer, Berlin, 2010:156–73.Google Scholar
  50. 50.
    May C, Montori VM, Mair FS. We need minimally disruptive medicine. BMJ. 2009;339:b2803.PubMedCrossRefGoogle Scholar
  51. 51.
    Mol A. Living with diabetes: care beyond choice and control. Lancet. 2009;373:1756–7.PubMedCrossRefGoogle Scholar
  52. 52.
    Luxton DD, McCann RA, Bush NE, et al. mHealth for mental health: integrating smartphone technology in behavioral healthcare. Prof Psychol Res Pr. 2011;42:505.CrossRefGoogle Scholar
  53. 53.
    Baig MM, Gholamhosseini H. Smart health monitoring systems: an overview of design and modeling. J Med Syst. 2013;37:9898.PubMedCrossRefGoogle Scholar
  54. 54.
    Jurik AD, Weaver AC. Remote medical monitoring. Computer. 2008;41:96–9.CrossRefGoogle Scholar
  55. 55.
    McAdams E, Krupaviciute A, Gehin C, Grenier E, et al. Wearable sensor systems: the challenges. In Engineering in Medicine and Biology Society, EMBC, 2011 Annual international conference of the IEEE. IEEE, 2011:3648–51Google Scholar
  56. 56.
    Lane ND, Mohammod M, Lin M, et al. Bewell: a smartphone application to monitor, model and promote wellbeing. In 5th international ICST conference on pervasive computing technologies for healthcare. 2011: 23–6.Google Scholar
  57. 57.
    Banaee H, Ahmed MU, Loutfi A. Data mining for wearable sensors in health monitoring systems: a review of recent trends and challenges. Sensors (Basel). 2013;13:17472–500.CrossRefGoogle Scholar
  58. 58.
    Ma Y, Xu B, Bai Y, et al. Daily mood assessment based on mobile phone sensing. In Wearable and Implantable Body Sensor Networks (BSN), 2012 Ninth international conference on. IEEE. 2012: 142–7Google Scholar
  59. 59.
    Alexe B, Hernandez MA, Hildrum KW, et al. Surfacing time-critical insights from social media. In Proceedings of the 2012 ACM SIGMOD international conference on management of data. ACM, 2012: 657–60.Google Scholar
  60. 60.
    Agichtein E, Castillo C, Donato D, et al. Finding high-quality content in social media. In Proceedings of the 2008 International conference on web search and data mining. ACM, 2008:183–194.Google Scholar
  61. 61.
    Wang W, Chen L, Thirunarayan K, et al. Harnessing Twitter ‘big data’ for automatic emotion identification. In Privacy, Security, Risk and Trust (PASSAT), 2012 International conference on and 2012 International conference on social computing (SocialCom). IEEE. 2012:587–592Google Scholar
  62. 62.•
    Konopnicki D, Shmueli-Scheuer M, Cohen D, et al. A statistical approach to mining customers’ conversational data from social media. IBM J Res Dev. 2013;57:14–1. Example of creating user profiles from social media.CrossRefGoogle Scholar
  63. 63.
    Munson L. Facebook: At least 67 million accounts are fake. 2014 http://nakedsecurity.sophos.com/2014/02/10/facebook-at-least-67-million-accounts-are-fake/. Accessed 9 Jul 2014.
  64. 64.
    Perlroth N. Fake Twitter followers become multimillion-dollar business. New York Times. 2013 http://bits.blogs.nytimes.com/2013/04/05/fake-twitter-followers-becomes-multimillion-dollar-business/?_php=true&_type=blogs&ref=technology&_r=0. Accessed 9 Jul 2014.
  65. 65.
    Duggan M. The demographics of social media users. 2013. http://www.pewinternet.org/files/old-media/Files/Reports/2013/PIP_SocialMediaUsers.pdf. Accessed 9 Jul 2014.
  66. 66.
    Viswanathan H, Chen B, Pompili D. Research challenges in computation, communication, and context awareness for ubiquitous healthcare. IEEE Commun Mag. 2012;50:92–9.CrossRefGoogle Scholar
  67. 67.
    Baldauf M, Dustdar S, Rosenberg F. A survey on context-aware systems. Int J Ad Hoc Ubiquit Comput. 2007;2:263–77.CrossRefGoogle Scholar
  68. 68.
    Dey AK, Abowd GD, Salber D. A conceptual framework and a toolkit for supporting the rapid prototyping of context-aware applications. Human-computer interaction. 2001;16:97–166.CrossRefGoogle Scholar
  69. 69.
    Welbourne E, Lester J, LaMarca A et al. Mobile context inference using low-cost sensors. In Location-and Context-Awareness. Springer, Berlin, 2005:254–63.Google Scholar
  70. 70.
    Li M, Lou W, Ren K. Data security and privacy in wireless body area networks. Wireless Communications, IEEE. 2010;17:51–8.CrossRefGoogle Scholar
  71. 71.
    Sarasohn-Kahn J. Making sense of sensors: how new technologies can change patient care. California Healthcare Foundation. 2013. http://www.chcf.org/publications/2013/02/making-sense-sensors. Accessed 9 Jul 2014
  72. 72.
    Halperin D, Kohno T, Heydt-Benjamin TS, et al. Security and privacy for implantable medical devices. IEEE Pervasive Comput. 2008;7:30–9.CrossRefGoogle Scholar
  73. 73.
    Redspin 2014. Breach report 2013: protected health information (PHI) http://www.redspin.com/resources/whitepapers-datasheets/Request-2013-Breach-Report-Protected-Health-Information-PHI-Redspin.php. Accessed 9 Jul 2014.
  74. 74.
    Consumer Reports. Smart phone thefts rose to 3.1 million last year, Consumer Reports finds. 2014. http://www.consumerreports.org/cro/news/2014/04/smart-phone-thefts-rose-to-3-1-million-last-year/index.htm#. Accessed 9 Jul 2014.
  75. 75.
    Ponemon Institute. Airport insecurity: the case of missing & lost laptops. 2008. http://www.dell.com/downloads/global/services/dell_lost_laptop_study.pdf. Accessed 9 Jul 2014.
  76. 76.
    Pantic M, Sebe N, Cohn JF et al. Affective multimodal human-computer interaction. In Proceedings of the 13th annual ACM international conference on multimedia. ACM, 2005; 669–76.Google Scholar
  77. 77.
    Schmidt A, Pfleging B, Alt F, et al. Interacting with 21st-century computers. IEEE Pervasive Comput. 2012;11:22–31.CrossRefGoogle Scholar
  78. 78.
    Pentland A. Looking at people: sensing for ubiquitous and wearable computing. IEEE Trans Pattern Anal Mach Intell. 2000;22:107–19.CrossRefGoogle Scholar
  79. 79.
    Sebe N, Cohen I, Gevers T, et al. Multimodal approaches for emotion recognition: a survey. In Electronic Imaging 2005, International Society for Optics and Photonics, 2005: 56–67Google Scholar
  80. 80.
    Gunes H, Pantic M. Automatic, dimensional and continuous emotion recognition. Int J Synth Emotions (IJSE). 2010;1:68–99.CrossRefGoogle Scholar
  81. 81.•
    Zeng Z, Pantic M, Roisman GI, et al. A survey of affect recognition methods: audio, visual, and spontaneous expressions. A survey of affect recognition methods: audio, visual, and spontaneous expressions. IEEE Trans Pattern Anal Mach Intell. 2009;31:39–58. Clear survey article.PubMedCrossRefGoogle Scholar
  82. 82.
    Aggarwal JK, Ryoo MS. Human activity analysis: a review. ACM Comput Surv. 2011;43:16.CrossRefGoogle Scholar
  83. 83.
    Network Advertising Initiative. Study finds behaviorally-targeted ads more than twice as valuable, twice as effective as non-targeted online ads. 2010 http://www.networkadvertising.org/pdfs/NAI_Beales_Release.pdf. Accessed 9 Jul 2014
  84. 84.
    Yan J, Liu N, Wang G, et al. How much can behavioral targeting help online advertising? In: Proceedings of the 18th international conference on world wide web. ACM. 2009:261–270.Google Scholar
  85. 85.
    Microsoft, owner. Chung WJ, Patwa P, Markov MM, inventors. Targeting advertisements based on emotion. United States Patent Application 20120143693 A1. 6/7/12Google Scholar
  86. 86.
    Meyer S, Rakotonirainy A. A survey of research on context-aware homes. In Proceedings of the Australasian information security workshop conference on ACSW frontiers. Australian Computer Society, Inc., 2003; 21:159–68.Google Scholar
  87. 87.
    Chui M, Löffler M, Roberts R. The internet of things. McKinsey Quarterly 2. 2010: 1–9.Google Scholar
  88. 88.
    Lisetti CL, Nasoz F. Using noninvasive wearable computers to recognize human emotions from physiological signals. EURASIP J Appl Signal Processing. 2004: 1672–87.Google Scholar
  89. 89.
    D’Mello S, Picard R, Graesser A. Towards an affect-sensitive autotutor. IEEE Intell Syst. 2007;22:53–61.CrossRefGoogle Scholar
  90. 90.
    Schröder M, Baggia P, Burkhardt F, et al. EmotionML—an upcoming standard for representing emotions and related states. In Affective Computing and Intelligent Interaction. Springer, Berlin. 2011:316–25.Google Scholar
  91. 91.
    Littlewort G, Whitehill J, Wu T et al. The computer expression recognition toolbox (CERT). In Automatic Face & Gesture Recognition and Workshops (FG 2011). IEEE International conference on. IEEE. 2011:298–305Google Scholar
  92. 92.
    Emotient. www.emotient.com. Accessed 9 Jul 2014.
  93. 93.
    Affdex. http://www.affdex.com/. Accessed 9 Jul 2014.
  94. 94.
  95. 95.
    NeuroSky. http://neurosky.com/. Accessed 9 Jul 2014.
  96. 96.
  97. 97.
    Overton SL, Medina SL. The stigma of mental illness. J Couns Dev. 2008;86:143–51.CrossRefGoogle Scholar
  98. 98.
    Luxton DD, June JD, Kinn JT. Technology-based suicide prevention: current applications and future directions. Telemed J E Health. 2011;17:50–4.PubMedCrossRefGoogle Scholar
  99. 99.
    Glascock AP, Kutzik DM. Behavioral telemedicine: a new approach to the continuous nonintrusive monitoring of activities of daily living. Telemed J. 2000;6:33–44.CrossRefGoogle Scholar
  100. 100.
    Niemeijer AR, Frederiks BJ, Riphagen II, et al. Ethical and practical concerns of surveillance technologies in residential care for people with dementia or intellectual disabilities: an overview of the literature. Int Psychogeriatr. 2010;22:1129–42.PubMedCrossRefGoogle Scholar
  101. 101.
    Sharpe R. Many health apps are based on flimsy science at best, and they often do not work. The Washington Post. 2012. http://www.washingtonpost.com/national/health-science/many-health-apps-are-based-on-flimsy-science-at-best-and-they-often-do-not-work/2012/11/12/11f2eb1e-0e37-11e2-bd1a-b868e65d57eb_story.html. Accessed 9 Jul 2014.
  102. 102.
  103. 103.
    Glenn T, Monteith S. Privacy in the digital world: medical and health data outside of HIPAA protections. Curr Psychiatry Rep. 2014;16(11):494.PubMedCrossRefGoogle Scholar
  104. 104.
    Stopczynski A, Greenwood D, Hansen LK. et al. Privacy for personal neuroinformatics. 2014. http://arxiv.org/abs/1403.2745. Accessed 9 Jul 2014.
  105. 105.
    Labrecque LI, Markos E, Milne GR. Online personal branding: processes, challenges, and implications. J Interact Mark. 2011;25:37–50.CrossRefGoogle Scholar
  106. 106.
    Stark M, Fins JJ. Engineering medical decisions: computer algorithms and the manipulation of choice. Camb Q Healthc Ethics. 2013;22:373–81.PubMedCrossRefGoogle Scholar
  107. 107.
    Petersen A, Seear K. Technologies of hope: techniques of the online advertising of stem cell treatments. New Genet Soc. 2011;30:329–46.CrossRefGoogle Scholar
  108. 108.
    Lazer D, Kennedy R, King G, et al. Big data. The parable of Google Flu: traps in big data analysis. Science. 2014;343:1203–5.PubMedCrossRefGoogle Scholar
  109. 109.
    Simpson MP. The future of innovation-trade secrets, property rights, and protectionism-an age-old tale. Brook L Rev. 2005;70:1121.Google Scholar
  110. 110.
    Chang KH, Fisher D, Canny J, et al. How’s my mood and stress?: an efficient speech analysis library for unobtrusive monitoring on mobile phones. In Proceedings of the 6th international conference on body area networks. ICST (Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering), 2011; 71–7.Google Scholar
  111. 111.
    Dickerson RF, Gorlin EI, Stankovic JA. Empath: a continuous remote emotional health monitoring system for depressive illness. In Proceedings of the 2nd conference on wireless health. ACM. 2011: 5.Google Scholar
  112. 112.
    Roh T, Bong K, Hong S, et al. Wearable mental-health monitoring platform with independent component analysis and nonlinear chaotic analysis. Conf Proc IEEE Eng Med Biol Soc. 2012;2012:4541–4.PubMedGoogle Scholar
  113. 113.
    Vidal M, Turner J, Bulling A, et al. Wearable eye tracking for mental health monitoring. Comput Commun. 2012;35:1306–11.CrossRefGoogle Scholar
  114. 114.
    Minassian A, Henry BL, Geyer MA, et al. The quantitative assessment of motor activity in mania and schizophrenia. J Affect Disord. 2010;120:200–6.PubMedCentralPubMedCrossRefGoogle Scholar
  115. 115.
    Gruenerbl A, Osmani V, Bahle G, et al. Using smart phone mobility traces for the diagnosis of depressive and manic episodes in bipolar patients. In Proceedings of the 5th augmented human international conference. ACM, 2014:38.Google Scholar
  116. 116.
    Kappeler-Setz C, Gravenhorst F, Schumm J, et al. Towards long term monitoring of electrodermal activity in daily life. Pers Ubiquitous Comput. 2013;17:261–71.CrossRefGoogle Scholar
  117. 117.
    Jashinsky J, Burton SH, Hanson CL, et al. Tracking suicide risk factors through Twitter in the US. Crisis. 2014;35:51–9.PubMedGoogle Scholar
  118. 118.
    McIntyre G, Gocke R, Hyett M, et al. An approach for automatically measuring facial activity in depressed subjects. In Affective computing and intelligent interaction and workshops, 2009. ACII 2009. 3rd International conference on, IEEE, 2009:1–8Google Scholar
  119. 119.
    Matic A, Mehta P, Rehg JM, et al. Monitoring dressing activity failures through RFID and video. Methods Inf Med. 2012;51:45–54.PubMedCrossRefGoogle Scholar
  120. 120.
    Miskelly F. Electronic tracking of patients with dementia and wandering using mobile phone technology. Age Ageing. 2005;34:497–9.PubMedCrossRefGoogle Scholar
  121. 121.
    LiKamWa R, Liu Y, Lane ND, et al. Can your smartphone infer your mood?. In Proc. PhoneSense Workshop. 2011. Microsoft Research. http://research.microsoft.com/en-us/projects/moodsense/. Accessed 9 Jul 2014.
  122. 122.
    Chittaranjan G, Blom J, Gatica-Perez D. Who’s who with big-five: analyzing and classifying personality traits with smartphones. In Wearable Computers (ISWC), 2011 15th annual international symposium on, IEEE. Nokia Research Center. https://research.nokia.com/publications?search=Gokul+Chittaranjan. Accessed 9 Jul 2014
  123. 123.•
    Lu H, Frauendorfer D, Rabbi M, et al. StressSense: detecting stress in unconstrained acoustic environments using smartphones. In Proceedings of the 2012 ACM conference on ubiquitous computing. ACM. 2012:351–360. Example of voice analysis using smartphones.Google Scholar
  124. 124.
    Pandey S, Aly M, Bagherjeiran A, et al. Learning to target: what works for behavioral targeting. In Proceedings of the 20th ACM international conference on Information and knowledge management. ACM. 2011:1805–14.Google Scholar
  125. 125.
    Aly M, Hatch A, Josifovski V, et al. Web-scale user modeling for targeting. In Proceedings of the 21st international conference companion on World Wide Web. ACM. 2012:3–12.Google Scholar
  126. 126.
    Gallagher R. Software that tracks people on social media created by defence firm. The Guardian. 2013. http://www.theguardian.com/world/2013/feb/10/software-tracks-social-media-defence?intcmp=239. Accessed 9 Jul 2014
  127. 127.•
    Taigman Y, Yang M, Ranzato M, et al. DeepFace: closing the gap to human-level performance in face verification. 2014. https://www.facebook.com/publications/546316888800776/. Accessed 9 Jul 2014. Advances in facial recognition.
  128. 128.
    Sahami Shirazi A, Clawson J, Hassanpour Y, et al. Already up? using mobile phones to track & share sleep behavior. Int J Hum Comput Stud. 2013;71:878–88.CrossRefGoogle Scholar
  129. 129.
    Samsung, owner. Lee H, inventor. Apparatus and method for sharing user’s emotion. United States Patent Application 20130144937 A1. 7 Aug 2012.Google Scholar
  130. 130.
    Apple, owner. Greenzeiger MF, Phulari R, Sanghavi M, inventors. Inferring user mood based on user and group characteristic data. United States Patent Application 20140025620 A1. 23 Jan 2014.Google Scholar
  131. 131.
    Microsoft, owner. Roseway A, Davis FA, Carroll EA, et al. inventors. Mood-actuated device. United States Patent Application 20140085181 A1. 27 Mar 2014Google Scholar
  132. 132.
    Yahoo, owner. White W, Slaney M, inventors. System and method for generating a playlist from a mood gradient. United States Patent Application US8583615 B2. 12 Nov 2013Google Scholar
  133. 133.
    Yahoo, owner. Kamdar G, inventor. Method and system for voice based mood analysis. United States Patent Application 20140046660 A1. 13 Feb 2014Google Scholar
  134. 134.
    Hamblem M. Dell’s new research division wants computers to detect your mood. Computerworld. 2014. http://www.computerworld.com/s/article/9247285/Dell_s_new_research_division_wants_computers_to_detect_your_mood. Accessed 9 Jul 2014

Copyright information

© Springer Science+Business Media New York 2014

Authors and Affiliations

  1. 1.ChronoRecord Association, Inc.FullertonUSA
  2. 2.Michigan State University College of Human Medicine Traverse City CampusTraverse CityUSA

Personalised recommendations