Pattern Analysis and Applications

, Volume 10, Issue 3, pp 247–263 | Cite as

Automated image-orientation detection: a scalable boosting approach

Industrial & Commercial Application


With the proliferation of digital cameras and self-publishing of photos, automatic detection of image orientation has become an important part of photo-management systems. In this paper, we present a novel system, based on combining the outputs of hundreds of classifiers trained with AdaBoost, to determine the upright orientation of an image. We thoroughly test our system on photos gathered from professional and amateur photo collections that have been taken with a variety of cameras (digital, film, camera phones). The test images include photos that are in color and black and white, realistic and abstract, and outdoor and indoor. As this system is intended for mass consumer deployment, efficiency in use and accessibility is paramount. Results show that the presented method surpasses similar methods based on Support Vector Machines, in terms of both accuracy and feasibility of deployment.


  1. 1.
    Vailaya A, Zhang H, Yang C, Liu F, Jain A (2002) Automatic image orientation detection. IEEE Trans Image Process 11:7CrossRefGoogle Scholar
  2. 2.
    Wang Y, Zhang H (2001) Content-based image orientation detection with support vector machines. In: IEEE workshop on content-based access of image and video libraries, pp 17–23Google Scholar
  3. 3.
    Wang Y, Zhang H (2004) Detecting image orientation based on low level visual content. Comput Vis Image Underst 93(3):328–346Google Scholar
  4. 4.
    Zhang, L, Li M, Zhang, H (2002) Boosting image orientation detection with indoor versus outdoor classification. In: Workshop on application of computer visionGoogle Scholar
  5. 5.
    Luo J, Boutell M (2005) A probabilistic approach to image orientation detection via confidence-based integration of low level and semantic cues. IEEE Trans Pattern Anal Mach Intell 27(5):715–726CrossRefGoogle Scholar
  6. 6.
    Lyu S (2005) Automatic image orientation determination with natural image statistics. In: Proceedings of the thirteenth annual ACM international conference on multimedia, pp 491–494Google Scholar
  7. 7.
    Wang L, Liu X, Xia, L, Xu G, Bruckstein A (2003) Image orientation detection with integrated human perception cues (or which way is up). ICIPGoogle Scholar
  8. 8.
    Baluja S, Rowley HA (2005) Boosting sex identification performance. In: Proceedings of the twentieth national conference on artificial intelligence and the seventeenth innovative applications of artificial intelligence conference, pp 1508–1513Google Scholar
  9. 9.
    LeCun Y, Bottou L, Bengio Y, Haffner P (1998) Gradient based learning applied to document recognition. Proc IEEE 86:11CrossRefGoogle Scholar
  10. 10.
    Rowley H, Baluja S, Kanade T (1998) Neural network-based face detection. IEEE Trans Pattern Anal Mach Intell 20(1):23–28Google Scholar
  11. 11.
    Viola P, Jones MJ (2001) Rapid object detection using a boosted cascade of simple features. In: 2001 IEEE computer society conference on computer vision and pattern recognition (CVPR’01), p 511Google Scholar
  12. 12.
    Freund Y, Schapire R (1996) Experiments with a new boosting algorithm. In: Machine learning, proceedings of the thirteenth international conferenceGoogle Scholar
  13. 13.
    Wu J, Rehg J, Mullins M (2003) Learning a rare event detection cascade by direct feature selection. Neural Inf Process Syst 16Google Scholar
  14. 14.
    Cortes C, Vapnik V (1995) Support-vector-networks. Mach Learn 20(3):273–297Google Scholar
  15. 15.
    Joachims T (1999) Making large-scale SVM learning practical. In: Schölkopf B, Burges C, Smola A (eds) Advances in Kernel methods—support vector learningGoogle Scholar
  16. 16.
    Corel-Gallery 1,300,000 (1999) Image gallery—16 CD Set—JB #40629Google Scholar
  17. 17.
    Shapiro L (2002) University of Washington image database for content-based image retrieval. available from
  18. 18.
    Dietterich TG (2000) Ensemble methods in machine learning. In: Roli I, Kittler J (eds) First international workshop on multiple classifier systems. Lecture notes in computer science. Springer, Berlin Heidelberg New York, pp 1–15Google Scholar
  19. 19.
    Ghosh J (2002) MultiClassifier systems: back to the future. In: Roli I, Kittler J (eds) Multiple classifier systems. LNCS 2364:1–15Google Scholar
  20. 20.
    Luo J, Crandall D, Singhal A, Boutell M, Gray R (2003) Psychophysical study of image orientation perception. Spat Vis 16(5):429–457Google Scholar
  21. 21.
    Adobe Inc., Adobe Photoshop Elements, 4.0,
  22. 22.
    Google, Inc., Picasa Photo Management Software, 2.0.

Copyright information

© Springer-Verlag London Limited 2006

Authors and Affiliations

  1. 1.Google, Inc.Mountain ViewUSA

Personalised recommendations