Skip to main content
SpringerLink
Log in

Socialising around media

Improving the second screen experience through semantic analysis, context awareness and dynamic communities

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

SAM is a social media platform that enhances the experience of watching video content in a conventional living room setting, with a service that lets the viewer use a second screen (such as a smart phone) to interact with content, context and communities related to the main video content. This article describes three key functionalities used in the SAM platform in order to create an advanced interactive and social second screen experience for users: semantic analysis, context awareness and dynamic communities. Both dataset-based and end user evaluations of system functionalities are reported in order to determine the effectiveness and efficiency of the components directly involved and the platform as a whole.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Listing 1
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

Notes

  1. http://wiki.socialisingaroundmedia.com

  2. https://www.contentwise.tv/

  3. https://www.couchfunk.de/

  4. https://www.horizon.tv/

  5. https://www.leankr.com/

  6. https://www.monterosa.co/

  7. https://www.tivine.com/

  8. http://www.cyc.com/

  9. https://developers.google.com/freebase/

  10. https://wordnet.princeton.edu/

  11. https://www.weibo.com/

  12. The ontology definition and additional information, including a use case example, is available at https://github.com/perma-id/w3id.org/tree/master/media/dma

  13. http://labs.europeana.eu/api/linked-open-data-data-structure

  14. https://opennlp.apache.org/

  15. http://wiki.dbpedia.org/

  16. https://github.com/dbpedia/lookup/

  17. https://lucene.apache.org/

  18. In addition to allowing adjacent sequences of words (n-grams), skip-grams allow tokens to be skipped.

  19. https://neo4j.com/

  20. https://www.w3.org/TR/2016/CR-activitystreams-vocabulary-20160906/

  21. https://www.drools.org/

  22. http://www.imdb.com/

  23. http://alt.qcri.org/semeval2015/task13/index.php

  24. https://www.cs.york.ac.uk/semeval-2013/task2/

  25. http://www.metacritic.com/

  26. http://alt.qcri.org/semeval2014/task4/

  27. http://www.cs.waikato.ac.nz/ml/weka/

  28. http://jmeter.apache.org/

References

  1. (2012) Notube: bringing web and tv closer together. http://www.notube.tv/

  2. (2013) Limosine project integrates the studies of leading researchers over diverse topics with a view to enable new kinds of language-based technology search. http://limosine-project.eu/

  3. Abowd GD, Dey AK, Brown PJ, Davies N, Smith M, Steggles P (1999) Towards a better understanding of context and context-awareness. In: Gellersen HW (ed) Handheld and Ubiquitous Computing. springer, Berlin, pp 304–307

  4. Aisopos F, Valsamis A, Psychas A, Menychtas A, Varvarigou T (2016) Efficient context management and personalized user recommendations in a smart social tv environment. In: GECON - Conference on the Economics of Grids, Clouds, Systems, and Services (GECON)

  5. Akaike H (1974) A new look at the statistical model identification. IEEE Trans Autom Control 19(6):716–723. https://doi.org/10.1109/TAC.1974.1100705

    Article  MathSciNet  MATH  Google Scholar 

  6. Aroyo L, Nixon L, Miller L (2011) Notube: the television experience enhanced by online social and semantic data. In: 2011 IEEE International Conference on Consumer Electronics-berlin (ICCE-berlin), IEEE, pp 269–273

  7. Batra S, Tyagi C (2012) Comparative analysis of relational and graph databases. International Journal of Soft Computing and Engineering (IJSCE) 2(2):509–512

    Google Scholar 

  8. Breiman L (2001) Random forests. Mach Learn 45(1):5–32

    Article  MATH  Google Scholar 

  9. Cambria E, White B (2014) Jumping nlp curves: a review of natural language processing research. Comp Intell Mag 9(2):48–57

    Article  Google Scholar 

  10. Cesar P, Bulterman DC, Jansen A (2008) Usages of the secondary screen in an interactive television environment: control, enrich, share, and transfer television content. In: European Conference on Interactive Television, Springer, pp 168–177

  11. Chang CC, Lin CJ (2001) Libsvm - a library for support vector machines. http://www.csie.ntu.edu.tw/~cjlin/libsvm/

  12. Chang CC, Lin CJ (2011) Libsvm: a library for support vector machines. ACM Trans Intell Syst Technol (TIST) 2(3):27

    Google Scholar 

  13. Chorianopoulos K (2008) Personalized and mobile digital tv applications. Multimed Tools Appl 36(1-2):1–10

    Article  Google Scholar 

  14. Courtois C, D’heer E (2012) Second screen applications and tablet users: constellation, awareness, experience, and interest. In: Proceedings of the 10th European conference on Interactive tv and video, ACM, pp 153–156

  15. Damerau FJ (1964) A technique for computer detection and correction of spelling errors. Commun ACM 7(3):171–176

    Article  Google Scholar 

  16. Davis F (1986) A technology acceptance model for empirically testing new end-user information systems: Theory and results. Thesis, http://dspace.mit.edu/handle/1721.1/15192

  17. Fernández J, Gutiérrez Y, Tomás D, Gómez JM, Martínez-Barco P (2015) Evaluating a sentiment analysis approach from a business point of view. In: TASS at SEPLN, pp 93–98

  18. Fleiss JL (1971) Measuring nominal scale agreement among many raters. Psychol. Bull. 76(5):378

    Article  Google Scholar 

  19. Forgy CL (1982) Rete: a fast algorithm for the many pattern/many object pattern match problem. Artif. Intell. 19(1):17–37

    Article  Google Scholar 

  20. Geerts D, Leenheer R, De Grooff D, Negenman J, Heijstraten S (2014) In front of and behind the second screen: viewer and producer perspectives on a companion app. In: Proceedings of the 2014 ACM International Conference on Interactive Experiences for TV and Online Video, ACM, pp 95–102

  21. Giglietto F, Selva D (2014) Second screen and participation: a content analysis on a full season dataset of tweets. J Commun 64(2):260–277

    Article  Google Scholar 

  22. Girvan M, Newman MEJ (2002) Community structure in social and biological networks. Proc Natl Acad Sci 99(12):7821–7826

    Article  MathSciNet  MATH  Google Scholar 

  23. Greene D, Doyle D, Cunningham P (2010) Tracking the evolution of communities in dynamic social networks. In: 2010 International Conference on Advances in Social Networks Analysis and Mining (ASONAM), IEEE, pp 176–183

  24. Guthrie D, Allison B, Liu W, Guthrie L, Wilks Y (2006) A closer look at skip-gram modelling. In: Proceedings of the Fifth International Conference on Language Resources and Evaluation (LREC’06), European Language Resources Association (ELRA)

  25. Haykin S (1994) Neural networks: a comprehensive foundation. Prentice Hall PTR

  26. Holmes G, Hall M, Frank E (1999) Generating rule sets from model trees. In: Twelfth Australian Joint Conference on Artificial Intelligence, Springer, pp 1–12

  27. Holmes ME, Josephson S, Carney RE (2012) Visual attention to television programs with a second-screen application. In: Proceedings of the Symposium on eye Tracking Research and Applications, ACM, pp 397–400

  28. Hu H, Wen Y, Luan H, Chua TS, Li X (2014) Toward multiscreen social tv with geolocation-aware social sense. IEEE MultiMedia 21(3):10–19

    Article  Google Scholar 

  29. Hu H, Wen Y, Gao Y, Chua TS, Li X (2015) Toward an sdn-enabled big data platform for social tv analytics. IEEE Netw 29(5):43–49

    Article  Google Scholar 

  30. Jaiswal G, Agrawal AP (2013) Comparative analysis of relational and graph databases. IOSR Journal of Engineering (IOSRJEN)

  31. Joachims T (1998) Text categorization with support vector machines: Learning with many relevant features. In: European Conference on Machine Learning, Springer, pp 137–142

  32. Kaplan AM, Haenlein M (2010) Users of the world, unite! the challenges and opportunities of social media. Bus Horiz 53(1):59–68

    Article  Google Scholar 

  33. Karypis G, Kumar V (1998) Multilevel k-way partitioning scheme for irregular graphs. J Parallel Distrib Comput 48(1):96–129

    Article  MATH  Google Scholar 

  34. Kohavi R (1995) The power of decision tables. In: 8th European Conference on Machine Learning, Springer, pp 174–189

  35. Landis JR, Koch GG (1977) The measurement of observer agreement for categorical data. biometrics pp 159–174

  36. Leskovec J, Rajaraman A, Ullman J (2014) Mining of Massive Datasets, 2nd edn. Cambridge University Press, Cambridge

    Book  Google Scholar 

  37. Levenshtein VI (1966) Binary codes capable of correcting deletions, insertions and reversals. Sov Phys Dokl 10(8):707–710

    MathSciNet  Google Scholar 

  38. Martínez V, Berzal F, Cubero JC (2015) The noesis open source framework for network data mining. In: 2015 7Th International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management (IC3k), vol 01. pp 316–321

  39. McAuley J, Leskovec J (2014) Discovering social circles in ego networks. ACM Transaction on Knowledge Discovery from Data 8(1):4:1–4:28

    Google Scholar 

  40. Mitchell K, Jones A, Ishmael J, Race NJ (2010) Social tv: toward content navigation using social awareness. In: Proceedings of the 8th International Interactive Conference on Interactive TV&Video, ACM, pp 283–292

  41. Nadeau D, Sekine S (2007) A survey of named entity recognition and classification. Linguisticae Investigationes 30(1):3–26

    Article  Google Scholar 

  42. Nakov P, Rosenthal S, Kozareva Z, Stoyanov V, Ritter A, Wilson T (2013) SemEval-2013 Task 2: Sentiment Analysis in Twitter. Second Joint Conference on Lexical and Computational Semantics (*SEM). In: Proceedings of the Seventh International Workshop on Semantic Evaluation (SemEval 2013), vol 2. Association for Computational Linguistics, Atlanta, Georgia, USA, pp 312–320

  43. Ng HT, Zelle J (1997) Corpus-based approaches to semantic interpretation in nlp. AI Mag 18(4):45

    Google Scholar 

  44. Odijk D, Meij E, De Rijke M (2013) Feeding the second screen: Semantic linking based on subtitles. In: Proceedings of the 10th Conference on Open Research Areas in Information Retrieval, Le Centre De Hautes Etudes Internationales d’Informatique Documentaire, pp 9–16

  45. Paliouras G, Papadopoulos S, Vogiatzis D, Kompatsiaris Y (2015) User Community Discovery. Springer, Berlin

    Book  Google Scholar 

  46. Pang B, Lee L (2008) Opinion mining and sentiment analysis. Found Trends Inf Retr 2(1-2):1–135

    Article  Google Scholar 

  47. Papadopoulos S, Kompatsiaris Y, Vakali A, Spyridonos P (2012) Community detection in social media. Data Min Knowl Disc 24(3):515–554

    Article  Google Scholar 

  48. Pynta P, Seixas SA, Nield GE, Hier J, Millward E, Silberstein RB (2014) The power of social television: can social media build viewer engagement? J Advert Res 54(1):71–80

    Article  Google Scholar 

  49. Rao D, McNamee P, Dredze M (2013) Entity Linking: Finding Extracted Entities in a Knowledge Base. Springer, Berlin, pp 93–115

    Google Scholar 

  50. Rosenblatt F (1958) The perceptron: a probabilistic model for information storage and organization in the brain. Psychol Rev 65(6):386–408

    Article  Google Scholar 

  51. Satuluri V, Parthasarathy S (2009) Scalable graph clustering using stochastic flows: applications to community discovery. In: Proceedings of the 15th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, ACM, New York, KDD ’09, pp 737–746. https://doi.org/10.1145/1557019.1557101

  52. Snousy MBA, El-Deeb HM, Badran K, Khlil IAA (2011) Suite of decision tree-based classification algorithms on cancer gene expression data. Egyptian Informatics Journal 12(2):73–82. https://doi.org/10.1016/j.eij.2011.04.003

    Article  Google Scholar 

  53. Tang L, Liu H (2010) Community detection and mining in social media. Synthesis Lectures on Data Mining and Knowledge Discovery 2(1):1–137

    Article  MathSciNet  Google Scholar 

  54. Tantipathananandh C, Berger-Wolf TY (2011) Finding communities in dynamic social networks. In: IEEE 11th International Conference on Data Mining, pp 1236–1241. https://doi.org/10.1109/ICDM.2011.67

  55. Tomás D, Gutiérrez Y, Agulló F (2015) Entity linking in media content and user comments: connecting data to wikipedia and other knowledge bases. In: eChallenges e-2015 Conference, pp 1–10

  56. Vanattenhoven J, Geerts D (2017) Social experiences within the home using second screen tv applications. Multimed. Tools Appl. 76(4):5661–5689

    Article  Google Scholar 

  57. Villena-Román J, García-Morera J, Cumbreras MÁG, Martínez-Cámara E, Martín-Valdivia MT, López LAU (2015) Overview of tass 2015. In: TASS at SEPLN, pp 13–21

  58. Yang J, Leskovec J (2013) Overlapping community detection at scale: a nonnegative matrix factorization approach. In: ACM International Conference of Web Search and Data Mining

  59. Zhang Y (2005) Bayesian graphical models for adaptive information filtering. Thesis. https://users.soe.ucsc.edu/yiz/papers/data/YOWStudy

  60. Zhao S, Zhong L, Wickramasuriya J, Vasudevan V (2011) Analyzing twitter for social tv: Sentiment extraction for sports. In: Proceedings of the 2nd International Workshop on Future of Television, vol 2. pp 11–18

Download references

Acknowledgements

This work has been partially funded by the European Commission under the Seventh (FP7 2007-2013) Framework Programme for Research and Technological Development through the SAM (FP7-611312) project, by the Spanish Government under project REDES (TIN2015-65136-C2-2-R) and by the Generalitat Valenciana under project (PROMETEU/2018/089).

Author information

Authors and Affiliations

  1. Department of Software and Computing Systems, University of Alicante, Carretera San Vicente del Raspeig s/n, 03690, Alicante, Spain

    David Tomás & Yoan Gutiérrez

  2. Department of Computer Science, University of Reading, Reading, RG6 6AH, UK

    Atta Badii & Marco Tiemann

  3. Distributed Knowledge and Media Systems Group, National Technical University of Athens, Zografou Campus, Athens, 15773, Greece

    Fotis Aisopos

Authors
  1. David Tomás
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yoan Gutiérrez
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Atta Badii
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Marco Tiemann
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Fotis Aisopos
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Marco Tiemann.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Tomás, D., Gutiérrez, Y., Badii, A. et al. Socialising around media. Multimed Tools Appl 78, 25539–25568 (2019). https://doi.org/10.1007/s11042-019-7706-1

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-019-7706-1

Keywords

Search

Navigation