Multimedia Systems

, Volume 25, Issue 5, pp 513–523 | Cite as

Informative image selection for crowdsourcing-based mobile location recognition

  • Hao WangEmail author
  • Dong Zhao
  • Huadong Ma
Special Issue Paper


With the prevalence of smartphones, the demand of recognizing the location through their camera and sensors is paid abundant attentions. For constructing a location recognition image database, the crowdsourcing technology is introduced to collect images associated with other sensory data. However, as abundant crowdsourced images evolve, it is essential to select high-quality images to decrease the burden of storage when designing an offline location recognition system directly on mobile devices. To address this problem, we propose an image selection framework, i.e., Informative image Selection Framework (ISF), considering both the diversity in spatial distribution and representativeness of images with high quality. First, for the images corresponding to the same object, we propose the Self-adaptive Space Clustering algorithm to group them into several clusters for maintaining high diversity of the image database. Second, for every cluster, we propose the Crucial Part Feature Detection algorithm to detect representative images. Extensive experiments demonstrate that ISF is effective and efficient for image selection, outperforming other similar image selection schemes around 5%.


Image selection View direction Crowdsourcing Mobile location recognition 



This work is supported by the National Natural Science Foundation of China under Grant No. 61332005 and No. 61502051, the Funds for Creative Research Groups of China under Grant No. 61421061, the Cosponsored Project of Beijing Committee of Education, and the Beijing Training Project for the Leading Talents in S&T (ljrc201502).


  1. 1.
    Fang, Q., Sang, J.T., Xu, C.S.: Giant: Geo-informative attributes for location recognition and exploration. In: ACM International Conference on Multimedia, pp. 13–22 (2013)Google Scholar
  2. 2.
    Sang, J.T., Mei, T., Xu, Y.Q., Zhao, C., Xu, C.S., Li, S.P.: Interaction design for mobile visual search. IEEE Trans. Multimed. 15(6), 1665–1676 (2013)CrossRefGoogle Scholar
  3. 3.
    Sang, J.T., Fang, Q., Xu, C.S.: Exploiting Social-Mobile Information for Location Visualization. ACM Trans. Intell. Syst. Technol. 8(3), 39–58 (2017)CrossRefGoogle Scholar
  4. 4.
    Sang, J.T., Xu, C.S., Liu, J.: User-aware image tag re nement via ternary semantic analysis. IEEE Trans. Multimed. 14(3), 883–895 (2012)CrossRefGoogle Scholar
  5. 5.
    Wang, H., Zhao, D., Ma, H.D., Xu, H.Y., Hou, X.B.: Crowdsourcing based mobile location recognition with richer fingerprints from smartphone sensors. In: IEEE Conference on Parallel and Distributed Systems, pp. 156–163 (2015)Google Scholar
  6. 6.
    Zhao, D., Wang, H., Ma, H., Xu, H., Liu, L., Zhang, P.: CrowdOLR: Toward Object Location Recognition with crowdsourced fingerprints using smartphones. IEEE Transactions on Human-Machine Systems (2017). doi: 10.1109/THMS.2017.2700443 CrossRefGoogle Scholar
  7. 7.
    Ma, H.D., Zhao, D., Yuan P.Y.: Opportunities in mobile crowd sensing. IEEE Communica. Mag. 52(8), 29–35 (2014)CrossRefGoogle Scholar
  8. 8.
    Rudinac, S., Larson, M., Hanjalic, A.: Learning crowdsourced user preferences for visual summarization of image collections. IEEE Trans. Multimed. 15(6), 1231–1243 (2013)CrossRefGoogle Scholar
  9. 9.
    Guan, T., He, Y.F., Gao, J., Yang, J.Z., Yu, Q.: On-device mobile visual location recognition by integrating vision and inertial sensors. IEEE Trans. Multimed. 15(7), 1688–1699 (2013)CrossRefGoogle Scholar
  10. 10.
    Ji, R.R., Duan, L.Y., Chen, J., Yao, H.X., Yuan, J.S., Rui, Y., Gao, W.: Location discriminative vocabulary coding for mobile landmark search. Int. J. Comput. Vis. 96(3), 290–314 (2012)CrossRefGoogle Scholar
  11. 11.
    Li, X.W., Wu, C.C., Zach, C, Lazebnik, S., Frahm, J.M.: Modeling and recognition of landmark image collections using iconic scene graphs. In: European Conference on Computer Vision, pp. 427–440 (2008)Google Scholar
  12. 12.
    Wang H., Zhao D., Ma H., Xu H.: SSFS: A space-saliency fingerprint selection framework for crowdsourcing based mobile location recognition. In: Chen E., Gong Y., Tie Y. (eds) Advances in multimedia information processing - PCM 2016. PCM 2016. Lecture Notes in Computer Science, vol 9917, pp. 650–659. Springer, Cham (2016)Google Scholar
  13. 13.
    Rudinac, S., Hanjalic, A., Larson, M.: Generating visual summaries of geographic areas using community-contributed images. IEEE Trans. Multimed. 15(4), 921–932 (2013)CrossRefGoogle Scholar
  14. 14.
    Yang, X.Y., Qian, X.M., Xue, Y.: Scalable mobile image retrieval by exploring contextual saliency. IEEE Trans. Image Process. 24(6), 1709–1721 (2015)MathSciNetCrossRefGoogle Scholar
  15. 15.
    Ahn, L.V., Dabbish, L.: Labeling images with a computer game. In: Sigchi Conference on Human Factors in Computing Systems, pp. 319–326 (2004)Google Scholar
  16. 16.
    Wang, Y., Hu, W.J., Wu, Y.B., Cao, G.H.: SmartPhoto: a resource-aware crowdsourcing approach for image sensing with smartphones. In: International Symposium on Mobile Ad Hoc Networking and Computing, pp. 113–122 (2014)Google Scholar
  17. 17.
    Chen, H.H., Guo, B., Yu, Z.W., Chen, L.M.: CrowdPic: a multi-coverage picture collection framework for mobile crowd photographing. In: IEEE Conference on Ubiquitous Intelligence and Computing, pp. 68–76 (2015)Google Scholar
  18. 18.
    Raychoudhury, V., Shrivastav, S., Sandha, S.S.: Cao, J.n.:CROWD-PAN-360: crowdsourcing based context-aware panoramic map generation for smartphone users. IEEE Trans. Parallel Distrib. Syst. 26(8), 2208–2219 (2014)CrossRefGoogle Scholar
  19. 19.
    Bay, H., Tuytelarars, T., Gool,L.: SURF: speeded up robust features. In: Proceedings of European Conference on Computer Vision, pp. 404–417 (2006)CrossRefGoogle Scholar
  20. 20.
    Liu, W., Mei, T., Zhang, Y.: Instant mobile video search with layered audio-video indexing and progressive transmission. IEEE Trans. Multimed. 16(8), 2242–2255 (2014)CrossRefGoogle Scholar
  21. 21.
    Gao, G.Y., Liu, C.H., Chen, M., Guo, S., Leung, K.K.: Cloud-based actor identification with batch-orthogonal local-sensitive hashing and sparse representation. IEEE Trans. Multimed. 18(9), 1749–1761 (2016)CrossRefGoogle Scholar
  22. 22.
    Ji, J.Q., Yan, S.C., Li, J.M., Gao, G.Y., Tian, Q., Zhang, B.: Batch-orthogonal locality-sensitive hashing for angular similarity. IEEE Trans. Pattern Anal. Mach. Intell 36(10), 1963–1974 (2014)CrossRefGoogle Scholar
  23. 23.
    Muja, M., Lowe, D.G.: Fast approximate nearest neighbors with automatic algorithm configuration. In: International Conference on Computer Vision Theory and Applications, pp. 331–340 (2009)Google Scholar

Copyright information

© Springer-Verlag GmbH Germany 2017

Authors and Affiliations

  1. 1.Beijing Key Laboratory of Intelligent Telecommunications Software and Multimedia, School of Computer ScienceBeijing University of Posts and TelecommunicationsBeijingChina

Personalised recommendations