Advertisement

GHio-Ca: An Android Application for Automatic Image Classification

  • Davide Polonio
  • Federico Tavella
  • Marco Zanella
  • Armir BujariEmail author
Conference paper
Part of the Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering book series (LNICST, volume 233)

Abstract

Online social networks (OSN) have revolutionized many aspects of our daily lives and have become the predominant platform where content is consumed and produced. This trend coupled with recent advances in the field of Artificial Intelligence (AI) have paved the way to many interesting features, enriching user experience in these social platforms. Photo sharing and tagging is an important activity contributing to the social media data ecosystem. These data once labeled constitute a fruitful input for the system which is exploited to better the services of interest to the user. However, these labeling activity is imperfect and user subjective, hence prone to errors inherent to the process. In this paper, we present the design and the analysis of an Android app (namely GHio-Ca), an automatic photo tagging service relying on state-of-the-art image recognition APIs. The application is presented to the user as a camera app used to share pictures on social networks while relying on external services to automatically retrieve tags best representing the picture theme. Along with the system description we present a user evaluation involving 30 subjects.

Keywords

Online social networks Social media sensing Computer vision Android Image recognition 

References

  1. 1.
    Bujari, A., Furini, M., Laina, N.: On using cashtags to predict companies stock trends. In: Proceedings of IEEE CCNC, Las Vegas, NV, USA, pp. 25–28 (2017)Google Scholar
  2. 2.
    Roccetti, M., Salomoni, P., Prandi, C., Marfia, G., Mirri, S.: On the interpretation of the effects of the infliximab treatment on Crohn’s disease patients from Facebook posts: a human vs. machine comparison. Netw. Model. Anal. Health Inf. Bioinf. 6(1), 11 (2017)CrossRefGoogle Scholar
  3. 3.
    Bujari, A., Licar, B., Palazzi, C.E.: Road crossing recognition through smartphone’s accelerometer. In: Proceedings of IFIP WD, Niagara Falls, ON, pp. 1–3 (2011)Google Scholar
  4. 4.
    Bujari, A., Ciman, M., Gaggi, O., Palazzi, C.E.: Using gamification to discover cultural heritage locations from geo-tagged photos. Pers. Ubiquit. Comput. 21(2), 235–252 (2017)CrossRefGoogle Scholar
  5. 5.
  6. 6.
  7. 7.
    Google reverse image search. https://images.google.com/
  8. 8.
  9. 9.
    Fu, X., Huang, J., Ding, X., Liao, Y., Paisley, J.: Clearing the skies: a deep network architecture for single-image rain removal. IEEE Trans. Image Process. 26(6), 2944–2956 (2017)MathSciNetCrossRefGoogle Scholar
  10. 10.
    Sabokrou, M., Fayyaz, M., Fathy, M., Klette, R.: Deep-cascade: cascading 3D deep neural networks for fast anomaly detection and localization in crowded scenes. IEEE Trans. Image Process. 26(4), 1992–2004 (2017)MathSciNetCrossRefGoogle Scholar
  11. 11.
    Cao, J., Pang, Y., Li, X.: Learning multilayer channel features for pedestrian detection. IEEE Trans. Image Process. 26(7), 3210–3220 (2017)MathSciNetCrossRefGoogle Scholar
  12. 12.
    Krishna, R., et al.: Visual genome: connecting language and vision using crowdsourced dense image annotations. Int. J. Comput. Vis. 123(1), 32–73 (2017)MathSciNetCrossRefGoogle Scholar
  13. 13.
    Russakovsky, O., et al.: ImageNet large scale visual recognition challenge. Int. J. Comput. Vis. 115(3), 211–252 (2015)MathSciNetCrossRefGoogle Scholar
  14. 14.
    Deng, J., Dong, W., Socher, R., Li, F.: ImageNet: a large-scale hierarchical image database. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, June 2009Google Scholar
  15. 15.
    GHio-Ca source code repository. https://github.com/Augugrumi/ghioca
  16. 16.
    Mason, W., Suri, S.: Conducting behavioral research on Amazon’s Mechanical Turk. Behav. Res. Methods 4(1), 1–23 (2012)CrossRefGoogle Scholar
  17. 17.
    LeCun, Y., et al.: Backpropagation applied to handwritten zip code recognition. Neural Comput. 1(4), 541–551 (1989)CrossRefGoogle Scholar
  18. 18.
    Lecun, Y., Bottou, L., Bengio, Y., Haffner, P.: Gradient-based learning applied to document recognition. In: Proceedings of IEEE, vol. 86, no. 11, pp. 2278–2324, November 1998Google Scholar

Copyright information

© ICST Institute for Computer Sciences, Social Informatics and Telecommunications Engineering 2018

Authors and Affiliations

  • Davide Polonio
    • 1
  • Federico Tavella
    • 1
  • Marco Zanella
    • 1
  • Armir Bujari
    • 1
    Email author
  1. 1.Department of MathematicsUniversity of PaduaPaduaItaly

Personalised recommendations