Skip to main content
SpringerLink
Log in

Myrror: a platform for holistic user modeling

Merging data from social networks, smartphones and wearable devices

  • Published:
User Modeling and User-Adapted Interaction Aims and scope Submit manuscript

Abstract

In this article, we present a platform that allows the creation of a comprehensive representation of the user that we call a holistic user model (HUM). Such a representation is based on the intuition that users’ personal data take different forms and come from several heterogeneous sources. Accordingly, we designed a pipeline that: (1) extracts personal data from three examples of important classes of such sources, namely social networks, wearable devices and smartphones; (2) processes these data through natural language processing and machine learning techniques; (3) stores the output of such processing in a user model that encodes different aspects of people’s life, such as demographic data, interests, affect values, social relations, activities and physical states. The resulting representation is made available to the user and to external developers. In the first case, a web interface allows the user to browse through her own personal data and to consult different facets of her HUM, in order to improve her self-awareness. In the latter, holistic user profiles are exposed through a REST interface and can be exploited by third-party applications to provide personalized services based on HUMs. In the experimental session, we evaluated usability and acceptability of the HUM in a user study which investigated how people were willing to use it. The results confirmed the effectiveness of our design choices and built the foundations for future usage of these profiles in personalized applications.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18

Similar content being viewed by others

Notes

  1. https://www.ibm.com/analytics/us/en/big-data/.

  2. Automated individual decision-making, including profiling. https://gdpr-info.eu/art-22-gdpr/.

  3. https://www.instagram.com/developer/.

  4. https://dev.fitbit.com/.

  5. http://www.foaf-project.org/.

  6. From now on, the term "posts'' is used to indistinctly refer to Facebook posts, Instagram posts and Tweets.

  7. http://90.147.102.243:9090.

  8. https://www.youtube.com/watch?v=3YRlcUhNZnQ.

  9. https://www.usability.gov/how-to-and-tools/methods/system-usability-scale.html.

  10. PRE-Q Questionnaire: https://forms.gle/zVaSaLRCyyu26urv9—POST-Q Questionnaire: https://forms.gle/4wvxhJU6JqEPLwjh6.

  11. https://www.bbc.com/news/topics/c81zyn0888lt/facebook-cambridge-analytica-data-scandal.

References

  • Abel, F., Gao, Q., Houben, G.J., Tao, K.: Analyzing user modeling on twitter for personalized news recommendations. In: International Conference on User Modeling, Adaptation, and Personalization, pp. 1–12. Springer (2011)

  • Abel, F., Herder, E., Houben, G.J., Henze, N., Krause, D.: Cross-system user modeling and personalization on the social web. User Model. User-Adap. Inter. 23(2–3), 169–209 (2013)

    Article  Google Scholar 

  • Abowd, G.D., Dey, A.K., Brown, P.J., Davies, N., Smith, M., Steggles, P.: Towards a better understanding of context and context-awareness. In: International Symposium on Handheld and Ubiquitous Computing, pp. 304–307. Springer (1999)

  • Angeletou, S., Rowe, M., Alani, H.: Modelling and analysis of user behaviour in online communities. In: International Semantic Web Conference, pp. 35–50. Springer (2011)

  • Ashbrook, D., Starner, T.: Learning significant locations and predicting user movement with gps. In: Proceedings on Sixth International Symposium on Wearable Computers, 2002 (ISWC 2002), pp. 101–108. IEEE (2002)

  • Atzori, L., Iera, A., Morabito, G.: The internet of things: a survey. Comput. Netw. 54(15), 2787–2805 (2010)

    Article  Google Scholar 

  • Ayalon, O., Toch, E.: Not even past: information aging and temporal privacy in online social networks. Hum. Comput. Interact. 32(2), 73–102 (2017)

    Article  Google Scholar 

  • Barua, D., Kay, J., Kummerfeld, B., Paris, C.: Theoretical foundations for user-controlled forgetting in scrutable long term user models. In: Proceedings of the 23rd Australian Computer–Human Interaction Conference, pp. 40–49 (2011)

  • Basile, P., Novielli, N.: Uniba at evalita 2014-sentipolc task: Predicting tweet sentiment polarity combining micro-blogging, lexicon and semantic features. In: Proceedings of EVALITA, pp. 58–63 (2014)

  • Bizer, C.: The emerging web of linked data. IEEE Intell. Syst. 24(5), 87–92 (2009)

    Article  Google Scholar 

  • Blei, D.M., Ng, A.Y., Jordan, M.I.: Latent Dirichlet allocation. J. Mach. Learn. Res. 3, 993–1022 (2003)

    MATH  Google Scholar 

  • Bontcheva, K., Rout, D.: Making sense of social media streams through semantics: a survey. Seman. Web 5(5), 373–403 (2014)

    Article  Google Scholar 

  • Brooke, J.: SUS: a retrospective. J. Usability Stud. 8(2), 29–40 (2013)

    Google Scholar 

  • Brooke, J., et al.: Sus—a quick and dirty usability scale. Usability Eval. Ind. 189(194), 4–7 (1996)

    Google Scholar 

  • Carmagnola, F., Vernero, F., Grillo, P.: Sonars: A social networks-based algorithm for social recommender systems. In: International Conference on User Modeling, Adaptation, and Personalization, pp. 223–234. Springer (2009)

  • Cena, F., Likavec, S., Rapp, A.: Real world user model: Evolution of user modeling triggered by advances in wearable and ubiquitous computing. Inform. Syst. Front. 21, 1085–1110 (2018)

    Article  Google Scholar 

  • de Barcelos Silva, A., Gomes, M.M., da Costa, C.A., da Rosa Righi, R., Barbosa, J.L.V., Pessin, G., De Doncker, G., Federizzi, G.: Intelligent personal assistants: a systematic literature review. Expert Systems with Applications, pp. 113–193 (2020)

  • Eppler, M.J., Mengis, J.: The concept of information overload: a review of literature from organization science, accounting, marketing, MIS, and related disciplines. Inf. Soc. 20(5), 325–344 (2004)

    Article  Google Scholar 

  • Golbeck, J., Robles, C., Turner, K.: Predicting personality with social media. In: CHI’11 Extended Abstracts on Human Factors in Computing Systems, pp. 253–262. ACM (2011)

  • Goldberg, L.R.: The structure of phenotypic personality traits. Am. Psychol. 48(1), 26 (1993)

    Article  Google Scholar 

  • Heckmann, D., Schwartz, T., Brandherm, B., Kröner, A.: Decentralized user modeling with UserML and GUMO. In: Decentralized, Agent Based and Social Approaches to User Modeling, Workshop DASUM-05 at 9th International Conference on User Modelling, UM2005, pp. 61–66 (2005)

  • Heckmann, D., Schwartz, T., Brandherm, B., Schmitz, M., von Wilamowitz-Moellendorff, M.: GUMO-the general user model ontology. In: International Conference on User Modeling, pp. 428–432. Springer (2005)

  • Hogan, R.: Development of an empathy scale. J. Consult. Clin. Psychol. 33(3), 307 (1969)

    Article  Google Scholar 

  • Hu, R., Liu, J., Wen, Y., Mao, Y.: User: A usage-based service recommendation approach. In: 2016 IEEE International Conference on Web Services (ICWS), pp. 716–719. IEEE (2016)

  • Kay, J.: The UM toolkit for cooperative user modelling. User Model. User-Adap. Inter. 4(3), 149–196 (1994)

    Article  Google Scholar 

  • Kay, J.: Scrutable adaptation: because we can and must. In: International Conference on Adaptive Hypermedia and Adaptive Web-Based Systems, pp. 11–19. Springer (2006)

  • Kay, J., Kummerfeld, B.: Lifelong user modelling goals, issues and challenges. In: Proceedings of the Lifelong User Modelling Workshop at UMAP, vol. 9, pp. 27–34. Citeseer (2009)

  • Kay, J., Kummerfeld, B.: Portme: Personal lifelong user modelling portal. Tech. Rep. TR647, School of Information Technologies, University of Sydney (2010)

  • Kay, J., Kummerfeld, B.: Creating personalized systems that people can scrutinize and control: drivers, principles and experience. ACM Trans. Interact. Intell. Syst. 2(4), 1–42 (2013)

    Article  Google Scholar 

  • Kay, J., Kummerfeld, B., Lauder, P.: Personis: a server for user models. In: International Conference on Adaptive Hypermedia and Adaptive Web-Based Systems, pp. 203–212. Springer (2002)

  • Kelly, D., Tangney, B.: Using multiple intelligence informed resources in an adaptive system. In: International Conference on Intelligent Tutoring Systems, pp. 412–421. Springer (2006)

  • Kobsa, A.: User modeling: Recent work, prospects and hazards. Hum. Factors Inform. Technol. 10, 111–111 (1993)

    Google Scholar 

  • Kobsa, A.: Generic user modeling systems. User Model. User-Adap. Inter. 11(1–2), 49–63 (2001)

    Article  Google Scholar 

  • Kobsa, A., Koenemann, J., Pohl, W.: Personalised hypermedia presentation techniques for improving online customer relationships. Knowl. Eng. Rev. 16(2), 111–155 (2001)

    Article  Google Scholar 

  • Kuflik, T., Kay, J., Kummerfeld, B.: Challenges and solutions of ubiquitous user modeling. In: Ubiquitous Display Environments, pp. 7–30. Springer (2012)

  • Kyriacou, D.: A scrutable user modelling infrastructure for enabling life-long user modelling. In: International Conference on Adaptive Hypermedia and Adaptive Web-Based Systems, pp. 421–425. Springer (2008)

  • Lepp, A., Barkley, J.E., Sanders, G.J., Rebold, M., Gates, P.: The relationship between cell phone use, physical and sedentary activity, and cardiorespiratory fitness in a sample of us college students. Int. J. Behav. Nutri. Phys. Act. 10(1), 79 (2013)

    Article  Google Scholar 

  • Linden, G., Smith, B., York, J.: Amazon.com recommendations: item-to-item collaborative filtering. IEEE Internet Comput. 1, 76–80 (2003)

    Article  Google Scholar 

  • Lops, P., De Gemmis, M., Semeraro, G., Narducci, F., Musto, C.: Leveraging the linkedin social network data for extracting content-based user profiles. In: Proceedings of the Fifth ACM conference on Recommender Systems, pp. 293–296. ACM (2011)

  • Lops, P., de Gemmis, M., Semeraro, G., Musto, C., Narducci, F., Bux, M.: A semantic content-based recommender system integrating folksonomies for personalized access. In: Web Personalization in Intelligent Environments, pp. 27–47. Springer (2009)

  • Manning, C.D., Schütze, H., et al.: Foundations of Statistical Natural Language Processing, vol. 999. MIT Press, London (1999)

    MATH  Google Scholar 

  • Musto, C., de Gemmis, M., Semeraro, G., Lops, P.: A multi-criteria recommender system exploiting aspect-based sentiment analysis of users’ reviews. In: Proceedings of the Eleventh ACM Conference on Recommender Systems, pp. 321–325 (2017)

  • Musto, C., Semeraro, G., Lops, P., De Gemmis, M., Narducci, F.: Leveraging social media sources to generate personalized music playlists. In: International Conference on Electronic Commerce and Web Technologies, pp. 112–123. Springer (2012)

  • Orlandi, F., Breslin, J., Passant, A.: Aggregated, interoperable and multi-domain user profiles for the social web. In: Proceedings of the 8th International Conference on Semantic Systems, pp. 41–48. ACM (2012)

  • Orwant, J.: Doppelgänger—a user modeling system. Ph.D. thesis, Massachusetts Institute of Technology (1991)

  • O’Reilly, T.: What is Web 2.0: Design patterns and business models for the next generation of software (2007)

  • Plumbaum, T., Wu, S., De Luca, E.W., Albayrak, S.: User modeling for the social semantic web. In: de Gemmis, M., De Luca, E.W., Di Noia, T., Gangemi, A., Hausenblas, P., Lops, M., Lukasiewicz, T., Plumbaum, T., Semeraro , G.(eds.) Semantic Personalized Information Management: Retrieval and Recommendation Workshop (SPIM 2011), CEUR, vol. 781, pp. 78–89 (2011)

  • Polignano, M., Basile, P., De Gemmis, M., Semeraro, G.: An emotion-driven approach for aspect-based opinion mining. In: Tonellotto, N., Becchetti, L., Tkalčič, M. (eds.) Proceedings of the 9th Italian Information Retrieval Workshop, vol. 2140 (2018). http://ceur-ws.org/Vol-2140/

  • Polignano, M., Basile, P., Rossiello, G., de Gemmis, M., Semeraro, G.: Learning inclination to empathy from social media footprints. In: Proceedings of the 25th Conference on User Modeling, Adaptation and Personalization, pp. 383–384. ACM (2017)

  • Rapp, A., Cena, F.: Self-monitoring and technology: challenges and open issues in personal informatics. In: International Conference on Universal Access in Human–Computer Interaction, pp. 613–622. Springer (2014)

  • Rapp, A., Cena, F.: Personal informatics for everyday life: how users without prior self-tracking experience engage with personal data. Int. J. Hum. Comput. Stud. 94, 1–17 (2016). https://doi.org/10.1016/j.ijhcs.2016.05.006

    Article  Google Scholar 

  • Rapp, A., Marcengo, A., Buriano, L., Ruffo, G., Lai, M., Cena, F.: Designing a personal informatics system for users without experience in self-tracking: a case study. Behav. Inform. Technol. 37(4), 335–366 (2018). https://doi.org/10.1080/0144929X.2018.1436592

    Article  Google Scholar 

  • Resnick, P., Varian, H.R.: Recommender systems. Commun. ACM 40(3), 56–58 (1997)

    Article  Google Scholar 

  • Rich, E.: User modeling via stereotypes. Cogn. Sci. 3(4), 329–354 (1979)

    Article  Google Scholar 

  • Rui, L., Zhang, X.: A tag-based recommendation algorithm integrating short-term and long-term interests of users. DEStech Transactions on Computer Science and Engineering (SMCE) (2017)

  • Russell, M.A.: Mining the Social Web: Data Mining Facebook, Twitter, LinkedIn, Google+, GitHub, and More. “O’Reilly Media, Inc.” (2013)

  • Semeraro, G., Lops, P., De Gemmis, M., Musto, C., Narducci, F.: A folksonomy-based recommender system for personalized access to digital artworks. J. Comput. Cult. Herit. 5(3), 1–22 (2012)

    Article  Google Scholar 

  • Seneviratne, S., Seneviratne, A., Mohapatra, P., Mahanti, A.: Predicting user traits from a snapshot of apps installed on a smartphone. ACM SIGMOBILE Mobile Comput. Commun. Rev. 18(2), 1–8 (2014)

    Article  Google Scholar 

  • Shapira, B., Rokach, L., Freilikhman, S.: Facebook single and cross domain data for recommendation systems. User Model. User-Adap. Inter. 23(2–3), 211–247 (2013)

    Article  Google Scholar 

  • Shen, X., Tan, B., Zhai, C.: Implicit user modeling for personalized search. In: Proceedings of the 14th ACM International Conference on Information and Knowledge Management, pp. 824–831. ACM (2005)

  • Shye, A., Scholbrock, B., Memik, G., Dinda, P.A.: Characterizing and modeling user activity on smartphones: summary. In: ACM SIGMETRICS Performance Evaluation Review, vol. 38, pp. 375–376. ACM (2010)

  • Swan, M.: The Quantified Self: Fundamental disruption in big data science and biological discovery. Big Data 1(2), 85–99 (2013)

    Article  Google Scholar 

  • Tkalčič, M., Burnik, U., Odić, A., Košir, A., Tasič, J.: Emotion-aware recommender systems—a framework and a case study. In: ICT Innovations 2012, pp. 141–150. Springer (2013)

  • Van Der Sluijs, K., Houben, G.J.: A generic component for exchanging user models between web-based systems. Int. J. Contin. Eng. Educ. Life Long Learn. 16(1–2), 64–76 (2006)

    Article  Google Scholar 

  • Verkasalo, H.: Analysis of smartphone user behavior. In: 2010 Ninth International Conference on Mobile Business and 2010 Ninth Global Mobility Roundtable (ICMB-GMR), pp. 258–263. IEEE (2010)

  • Wang, Y., Chan, S.C.F., Ngai, G.: Applicability of demographic recommender system to tourist attractions: a case study on trip advisor. In: Proceedings of the The 2012 IEEE/WIC/ACM International Joint Conferences on Web Intelligence and Intelligent Agent Technology-Volume 03, pp. 97–101. IEEE Computer Society (2012)

  • Zapata-Rivera, J.D., Greer, J.E.: Interacting with inspectable Bayesian student models. Int. J. Artif. Intell. Educ. 14(2), 127–163 (2004)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science, University of Bari ‘Aldo Moro’, Bari, Italy

    Cataldo Musto, Marco Polignano, Giovanni Semeraro, Marco de Gemmis & Pasquale Lops

Authors
  1. Cataldo Musto
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Marco Polignano
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Giovanni Semeraro
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Marco de Gemmis
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Pasquale Lops
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Cataldo Musto.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Musto, C., Polignano, M., Semeraro, G. et al. Myrror: a platform for holistic user modeling. User Model User-Adap Inter 30, 477–511 (2020). https://doi.org/10.1007/s11257-020-09272-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11257-020-09272-6

Keywords

Search

Navigation