Multimedia Tools and Applications

, Volume 64, Issue 1, pp 141–170 | Cite as

Discovering relationship types between users using profiles and shared photos in a social network

  • Elie Raad
  • Richard Chbeir
  • Albert Dipanda


In this paper, we propose a new approach to discover the relationship types between a user and her contacts in a social network. This is of key importance for many applications in the domain of photo sharing, privacy protection, information enriching, etc. Our approach is based, on one hand, on information extracted from users’ profiles and their shared photos, and, on the other hand, on a set of predefined rules validated by the main user before being mined and derived according to her preferences and social network content. The contribution of our method is twofold: 1) it is user-based enabling the user to set her preferences and give her feedbacks on the derived rules and results, and 2) it is multi-criteria that exploits and combines several attributes and features from user profiles and shared photos respectively. It also allows the user to define new relationship types. We conducted a set of experiments to validate our approach. The obtained results show the accuracy of our approach in different scenarios.


Social networks Link type prediction Photo based inference User profile Photo metadata Rule mining 



We would like to thank Parag Singla, Henry Kautz, Jiebo Luo, Andrew Gallagher for providing us the set of rules they used in their work [30].


  1. 1.
    Adamic L, Adar E (2003) Friends and neighbors on the web. Social Networks 25(3):211–230CrossRefGoogle Scholar
  2. 2.
    Agrawal R, Srikant R (1994) Fast algorithms for mining association rules in large databases. Proceedings of the 20th International Conference on Very Large Data Bases:487–499Google Scholar
  3. 3.
    Baluja S, Rowley H (2007) Boosting sex identification performance. Int J Comput Vis 71(1):111–119CrossRefGoogle Scholar
  4. 4.
    Bilgic M, Namata G, Getoor L (2007) Combining collective classification and link prediction. Proceedings of the Seventh IEEE International Conference on Data Mining Workshops:381–386Google Scholar
  5. 5.
    Bojars U, Heitmann B, Oren E (2007) A prototype to explore content and context on social community sites. Proceedings of the International Conference on Social Semantic Web 47–58Google Scholar
  6. 6.
    Boyd D (2004) Friendster and publicly articulated social networking. CHI '04 extended abstracts on Human factors in computing systems: 1279–1282Google Scholar
  7. 7.
    Cohen WW, Minkov E (2006) A graph-search framework for associating gene identifiers with documents. BMC Bioinforma 7(1):440CrossRefGoogle Scholar
  8. 8.
    Elliott B, Özsoyoglu Z (2008) Annotation suggestion and search for personal multimedia objects on the web. Proceedings of the 2008 international conference on Content-based image and video retrieval:75–84Google Scholar
  9. 9.
    Gabrilovich E, Markovitch S (2007) Computing semantic relatedness using Wikipedia-based explicit semantic analysis. Proceedings of the 20th international joint conference on Artifical intelligence:1606–1611Google Scholar
  10. 10.
    Golbeck J, Rothstein M (2008) Linking social networks on the web with foaf: A semantic web case study. Proceedings of the 23 rd national conference on Artificial intelligence - Volume 2:1138–1143Google Scholar
  11. 11.
    Golder S (2008) Measuring social networks with digital photograph collections. Proceedings of the nineteenth ACM conference on Hypertext and hypermedia:43–48Google Scholar
  12. 12.
    Green T, Quigley A (2010) Perception of online social networks. Mining and analyzing social networks, vol 288. Springer Publishing Company, IncorporatedGoogle Scholar
  13. 13.
    Han J, Kamber M (2006) Data mining: concepts and techniques. Morgan KaufmannGoogle Scholar
  14. 14.
    Hogg T, Wilkinson D, Szabo G, Brzozowski M (2008) Multiple relationship types in online communities and social networks. Proceedings of the AAAI Symposium on Social Information Processing:30–35Google Scholar
  15. 15.
    Jaro M (1989) Advances in record-linkage methodology as applied to matching the 1985 census of Tampa, Florida. J Am Stat Assoc 84(406):414–420CrossRefGoogle Scholar
  16. 16.
    Jin Y, Matsuo Y, Ishizuka M (2007) Extracting social networks among various entities on the web, vol 4519. LNCS The Semantic Web: Research and Applications. Springer Berlin/HeidelbergGoogle Scholar
  17. 17.
    Kaplan AM, Haenlein M (2010) Users of the world, unite! The challenges and opportunities of social media. Bus Horizons 53(1):59–68CrossRefGoogle Scholar
  18. 18.
    Kautz H, Selman B, Shah M (1997) The hidden web. AI Mag 18(2):27–36Google Scholar
  19. 19.
    Lanitis A, Taylor C, Cootes T (2002) Toward automatic simulation of aging effects on face images. IEEE Trans Pattern Anal Mach Intell 24(4):442–455CrossRefGoogle Scholar
  20. 20.
    Lin M, Chen H (2008) Labeling categories and relationships in an evolving social network. Proceedings of the IR research, 30th European conference on Advances in information retrieval:77–88Google Scholar
  21. 21.
    Matsuo Y, Mori J, Hamasaki M, Nishimura T, Takeda H, Hasida K, Ishizuka M (2007) POLYPHONET: an advanced social network extraction system from the web. Web Semant Sci Serv Agents World Wide Web 5(4):262–278CrossRefGoogle Scholar
  22. 22.
    Mika P (2005) Flink: Semantic web technology for the extraction and analysis of social networks. Web Semant Sci Serv Agents World Wide Web 3(2–3):211–223CrossRefGoogle Scholar
  23. 23.
    Miki T, Nomura T, Ishida T (2005) Semantic web link analysis to discover social relationships in academic communities. Proceedings of the The 2005 Symposium on Applications and the Internet:38–45Google Scholar
  24. 24.
    Min J, Jang S, Cho S (2009) Mining and visualizing mobile social network based on Bayesian probabilistic model. Ubiquitous Intelligence and Computing:111–120Google Scholar
  25. 25.
    Mori J, Ishizuka M, Matsuo Y (2007) Extracting keyphrases to represent relations in social networks from web. Proceedings of the 20th international joint conference on Artifical intelligence:2820–2825Google Scholar
  26. 26.
    Poole D (2000) Logic, knowledge representation, and Bayesian decision theory. Computational Logic—CL 2000:70–86Google Scholar
  27. 27.
    Quinlan J (1986) Induction of decision trees. Mach Learn 1(1):81–106Google Scholar
  28. 28.
    Rowe R, Creamer G, Hershkop S, Stolfo S (2007) Automated social hierarchy detection through email network analysis. Proceedings of the 9th WebKDD and 1st SNA-KDD 2007 workshop on Web mining and social network analysis:109–117Google Scholar
  29. 29.
    Salton G, McGill MJ (1983) Introduction to modern information retrievalGoogle Scholar
  30. 30.
    Singla P, Kautz H, Luo J, Gallagher A (2008) Discovery of social relationships in consumer photo collections using markov logic. Computer Vision and Pattern Recognition Workshops:1–7Google Scholar
  31. 31.
    Stefanone M, Gay G (2008) Structural reproduction of social networks in computer-mediated communication forums. Behav Inform Technol 27(2):97–106CrossRefGoogle Scholar
  32. 32.
    Tyler J, Wilkinson D, Huberman B (2005) E-mail as spectroscopy: automated discovery of community structure within organizations. Inf Soc 21(2):143–153CrossRefGoogle Scholar
  33. 33.
    Vapnik V (1998) The Nature of statistical Learning Theory. Data mining and knowledge discovery:1–47Google Scholar
  34. 34.
    Wang C, Han J, Jia Y, Tang J, Zhang D, Yu Y, Guo J (2010) Mining advisor-advisee relationships from research publication networks. Proceedings of the 16th ACM SIGKDD international conference on Knowledge discovery and data mining:203–212Google Scholar
  35. 35.
    Wu P, Tretter D (2009) Close & closer: social cluster and closeness from photo collections. Proceedings of the seventeen ACM international conference on Multimedia:709–712Google Scholar
  36. 36.
    Yu K, Chu W, Yu S, Tresp V, Xu Z (2006) Stochastic relational models for discriminative link prediction. Adv Neural Inf Process Syst 19:1553–1560Google Scholar
  37. 37.
    Zhang T, Chao H, Willis C, Tretter D (2010) Consumer image retrieval by estimating relation tree from family photo collections. Proceedings of the ACM International Conference on Image and Video Retrieval:143–150Google Scholar
  38. 38.
    Zhao M, Cheng X, He Q (2009) An algorithm of mining class association rules. Proceedings of the 4th International Symposium on Advances in Computation and Intelligence:269–275Google Scholar

Copyright information

© Springer Science+Business Media, LLC 2011

Authors and Affiliations

  1. 1.LE2I-CNRSBourgogne UniversityDijonFrance

Personalised recommendations