Accelerating Local Feature Extraction Using Two Stage Feature Selection and Partial Gradient Computation

  • Keundong Lee
  • Seungjae Lee
  • Weon-Geun Oh
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9010)


In this paper, we present a fast local feature extraction method, which is our contribution to ongoing MPEG standardization of compact descriptor for visual search (CDVS). To reduce time complexity of feature extraction, two-stage feature selection, which is based on the feature selection method of CDVS Test Model (TM), and partial gradient computation are introduced. The proposed method is examined on SIFT and compared to SIFT and SURF extractor with the previous feature selection method. In addition, the proposed method is compared to various feature extraction methods of the current CDVS TM 11 in CDVS evaluation framework. Experimental results show that the proposed method significantly reduces the time complexity while maintaining the matching and retrieval performance of previous work. For its efficiency, the proposed method has been integrated into CDVS TM since \(107^{\text {th}}\) MPEG meeting. This method will be also useful for feature extraction on mobile devices, where the use of computational resource is limited.


Feature Selection Time Complexity Memory Usage Feature Selection Method Feature Extraction Method 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.



This work was supported by the ICT R& D program of MSIP/IITP. [2014(R2012030111), Development of The Smart Mobile Search Technology based on UVD(Unified Visual Descriptor)]


  1. 1.
    Balestri, M., Francini, G., Lepsøy, S., Lee, K.D., Na, S.I., Lee, S.J.: CDVS: ETRI and TI’s response to CE1 - an invariant low memory implementation of the ALP detector with a simplified usage interface. In: 107th MPEG Meeting, M31987 (2014)Google Scholar
  2. 2.
    Ballocca, G., Mosca, A., Fiandrotti, A., Mattelliano, M.: CDVS: TM10 extraction evaluation on ARM architectures. In: 109th MPEG Meeting, M34086 (2014)Google Scholar
  3. 3.
    Bay, H., Ess, A., Tuytelaars, T., Van, G.L.: Speeded-up robust features (SURF). Comput. Vis. Image Underst. 110, 346–359 (2008)CrossRefGoogle Scholar
  4. 4.
    California Institute of Technology: Pasadena Buildings 2010 dataset. (accessed 2014)
  5. 5.
    Chen, J., Duan, L.Y., Huang, T., Gao, W., Kot, A.C., Balestri, M., Francini, G., Lepsøy, S.: CDVS CE1: a low complexity detector ALP BFLoG. In: 108th MPEG Meeting, M33159 (2014)Google Scholar
  6. 6.
    Francini, G., Balestri, M., Lepsøy, S.: CDVS: telecom Italia’s response to CE1 - interest point detection. In: 106th MPEG Meeting, M31369 (2013)Google Scholar
  7. 7.
    Francini, G., Lepsøy, S., Balestri, M.: Selection of local features for visual search. Signal Process. Image Commun. 28, 311–322 (2013)CrossRefGoogle Scholar
  8. 8.
    Jegou, H., Douze, M., Schmid, C.: Hamming embedding and weak geometric consistency for large scale image search. In: Forsyth, D., Torr, P., Zisserman, A. (eds.) ECCV 2008, Part I. LNCS, vol. 5302, pp. 304–317. Springer, Heidelberg (2008) CrossRefGoogle Scholar
  9. 9.
    ISO/IEC JTC1/SC29/WG11: Evaluation framework for compact descriptors for visual search. In: 97th MPEG Meeting, N12202 (2011)Google Scholar
  10. 10.
    ISO/IEC JTC1/SC29/WG11: Study text of ISO/IEC DIS 15938–13 compact descriptors for visual search. In: 109th MPEG Meeting, N14681 (2014)Google Scholar
  11. 11.
    ISO/IEC JTC1/SC29/WG11: Test Model 11: compact descriptors for visual search. In: 109th MPEG Meeting, N14682 (2014)Google Scholar
  12. 12.
    Lee, K.D., Na, S.I., Lee, S.J., Balestri, M., Francini, G., Lepsøy, S.: CDVS: ETRI and TI’s response to CE1 - a fast feature extraction based on ALP detector. In: 107th MPEG Meeting, M31991 (2014)Google Scholar
  13. 13.
    Lepsøy, S., Francini, G., Cordara, G., de Gusmao, P.P.B.: Statistical modelling of outliers for fast visual search. In: IEEE International Conference on Multimedia and Expo (ICME), pp. 1–6 (2011)Google Scholar
  14. 14.
    Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vision 60, 91–110 (2004)CrossRefGoogle Scholar
  15. 15.
    Microsoft: Counters in Process performance object. (accessed 2014)
  16. 16.
    OpenCV Library: (accessed 2014)
  17. 17.
    Telecom Italia: 201 Books, InternetArchive and DistractorPairs dataset. (accessed 2013)
  18. 18.
    University of Oxford: The Oxford Buildings Dataset. (accessed 2014)
  19. 19.
    VLFeat Library. (accessed 2014)

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  1. 1.ETRIDaejeonRepublic of Korea

Personalised recommendations