Performance Evaluation of Text Detection and Tracking in Video

  • Vasant Manohar
  • Padmanabhan Soundararajan
  • Matthew Boonstra
  • Harish Raju
  • Dmitry Goldgof
  • Rangachar Kasturi
  • John Garofolo
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3872)


Text detection and tracking is an important step in a video content analysis system as it brings important semantic clues which is a vital supplemental source of index information. While there has been a significant amount of research done on video text detection and tracking, there are very few works on performance evaluation of such systems. Evaluations of this nature have not been attempted because of the extensive effort required to establish a reliable ground truth even for a moderate video dataset. However, such ventures are gaining importance now.

In this paper, we propose a generic method for evaluation of object detection and tracking systems in video domains where ground truth objects can be bounded by simple geometric shapes (polygons, ellipses). Two comprehensive measures, one each for detection and tracking, are proposed and substantiated to capture different aspects of the task in a single score. We choose text detection and tracking tasks to show the effectiveness of our evaluation framework. Results are presented from evaluations of existing algorithms using real world data and the metrics are shown to be effective in measuring the total accuracy of these detection and tracking algorithms.


False Alarm Ground Truth Object Detection Tracking Task Text Region 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Jung, K., Kim, K.I., Jain, A.K.: Text information extraction in images and video: a survey. Pattern Recognition 37, 977–997 (2004)CrossRefGoogle Scholar
  2. 2.
    Antani, S., Crandall, D., Narasimhamurthy, A., Mariano, V.Y., Kasturi, R.: Evaluation of Methods for Detection and Localization of Text in Video. In: Proceedings in International Workshop on Document Analysis Systems, pp. 507–514 (2000)Google Scholar
  3. 3.
    Black, J., Ellis, T.J., Rosin, P.: A Novel Method for Video Tracking Performance Evaluation. In: Proceedings of IEEE PETS Workshop (2003)Google Scholar
  4. 4.
    Brown, L.M., Senior, A.W., Tian, Y., Connell, J., Hampapur, A., Shu, C., Merkl, H., Lu, M.: Performance Evaluation of Surveillance Systems Under Varying Conditions. In: Proceedings of IEEE PETS Workshop (2005)Google Scholar
  5. 5.
    Collins, R., Zhou, X., Teh, S.: An Open Source Tracking Testbed and Evaluation Web Site. In: Proceedings of IEEE PETS Workshop (2005)Google Scholar
  6. 6.
    Hua, X., Wenyin, L., Zhang, H.: Automatic Performance Evaluation for Video Text Detection. In: Proc. International Conference on Document Analysis and Recognition, pp. 545–550 (2001)Google Scholar
  7. 7.
    Nascimento, J., Marques, J.: New Performance Evaluation Metrics for Object Detection Algorithms. In: Proceedings of IEEE PETS Workshop (2004)Google Scholar
  8. 8.
    Smith, K., Gatica-Perez, D., Odobez, J., Ba, S.: Evaluating Multi-Object Tracking. In: Proceedings of IEEE Empirical Evaluation Methods in Computer Vision Workshop (2005)Google Scholar
  9. 9.
    Manohar, V., Soundararajan, P., Raju, H., Goldgof, D., Kasturi, R., Garofolo, J.: Performance Evaluation of Object Detection and Tracking in Video. In: Proceedings of Asian Conference on Computer Vision, pp. 151–161 (2006)Google Scholar
  10. 10.
    Doermann, D., Mihalcik, D.: Tools and Techniques for Video Performance Evaluation. In: ICPR, pp. 167–170 (2000)Google Scholar
  11. 11.
    Papadimitriou, C.H., Steiglitz, K.: Combinatorial optimization: algorithms and complexity. Prentice-Hall, Inc., Upper Saddle River (1982)Google Scholar
  12. 12.
    Munkres, J.R.: Algorithms for the Assignment and Transportation Problems. J. SIAM 5, 32–38 (1957)zbMATHMathSciNetGoogle Scholar
  13. 13.
    Fredman, M.L., Tarjan, R.E.: Fibonacci Heaps and their uses in Improved Network Optimization Algorithms. Journal of ACM 34, 596–615 (1987)CrossRefMathSciNetGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Vasant Manohar
    • 1
  • Padmanabhan Soundararajan
    • 1
  • Matthew Boonstra
    • 1
  • Harish Raju
    • 2
  • Dmitry Goldgof
    • 1
  • Rangachar Kasturi
    • 1
  • John Garofolo
    • 3
  1. 1.University of South FloridaTampa
  2. 2.Advanced Interfaces Inc.State College
  3. 3.National Institute of Standards and TechnologyGaithersburg

Personalised recommendations