Skip to main content

A Method for Camera-Based Interactive Whiteboard Reading

  • Conference paper

Part of the Lecture Notes in Computer Science book series (LNIP,volume 7139)

Abstract

Recognizing mind maps written on a whiteboard is a challenging task due to the unconstrained handwritten text and the different graphical elements — i.e. lines, circles and arrows — available in a mind map. In this paper we propose a prototype system to recognize and visualize such mind maps written on whiteboards. After the image acquisition by a camera, a binarization process is performed, and the different connected components are extracted. Without presuming any prior knowledge about the document, its style, layout, etc., the analysis starts with connected components, labeling them as text, lines, circles or arrows based on a neural network classifier trained on some statistical features extracted from the components. Once the text patches are identified, word detection is performed, modeling the text patches by their gravity centers and grouping them into possible words by density based clustering. Finally, the grouped connected components are recognized by a Hidden Markov Model based recognizer. The paper also presents a software tool integrating all these processing stages, allowing a digital transcription of the mind map and the interaction between the user, the mind map, and the whiteboard.

Keywords

  • whiteboard reading
  • unconstrained document layout analysis
  • handwriting recognition

This is a preview of subscription content, access via your institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (Canada)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   54.99
Price excludes VAT (Canada)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   69.99
Price excludes VAT (Canada)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. openCV (Open Source Computer Vision) library, http://opencv.willowgarage.com/wiki/

  2. Ester, M., Kriegel, H.P., Sander, J., Xu, X.: A density-based algorithm for discovering clusters in large spatial databases with noise. In: International Conference on Knowledge Discovery and Data Mining, pp. 226–231 (1996)

    Google Scholar 

  3. Farrand, P., Hussain, F., Henessy, E.: The efficiency of the ”mind map” study technique. Journal of Medical Education 36(5), 426–431 (2003)

    CrossRef  Google Scholar 

  4. Fink, G.A.: Markov Models for Pattern Recognition, From Theory to Applications. Springer, Heidelberg (2008)

    MATH  Google Scholar 

  5. Fletcher, L., Kasturi, R.: A robust algorithm for text string separation from mixed text/graphics images. IEEE Trans. on Pattern Analysis and Machine Intelligence 10(6), 910–918 (1988)

    CrossRef  Google Scholar 

  6. Gonzalez, R.C., Woods, R.E.: Digital Image Processing, 2nd edn. Addison-Wesley Longman Publishing Co., Inc., Boston (2001)

    Google Scholar 

  7. Liwicki, M., Bunke, H.: Handwriting recognition of whiteboard notes. In: Conference of the International Graphonomics Society, pp. 118–122 (2005)

    Google Scholar 

  8. Liwicki, M., Bunke, H.: Handwriting recognition of whiteboard notes – studying the influence of training set size and type. International Journal of Pattern Recognition and Artificial Intelligence 21(1), 83–98 (2007)

    CrossRef  Google Scholar 

  9. Lucas, S.M.: Text locating competition results. In: International Conference on Document Analysis and Recognition, pp. 80–85 (2005)

    Google Scholar 

  10. Niblack, W.: An introduction to digital image processing. Strandberg Publishing Company, Birkeroed (1985)

    Google Scholar 

  11. Plötz, T., Thurau, C., Fink, G.A.: Camera-based whiteboard reading: New approaches to a challenging task. In: International Conference on Frontiers in Handwriting Recognition, pp. 385–390 (2008)

    Google Scholar 

  12. Plötz, T., Fink, G.A.: Markov models for offline handwriting recognition: a survey. International Journal on Document Analysis and Recognition 12(4), 269–298 (2009)

    CrossRef  Google Scholar 

  13. Vajda, S., Plötz, T., Fink, G.A.: Layout analysis for camera-based whiteboard notes. Journal of Universal Computer Science 15(18), 3307–3324 (2009)

    Google Scholar 

  14. Vajda, S., Roy, K., Pal, U., Chaudhuri, B.B., Belaid, A.: Automation of Indian postal documents written in Bangla and English. International Journal of Pattern Recognition and Artificial Intelligence 23(8), 1599–1632 (2009)

    CrossRef  Google Scholar 

  15. Weber, M., Eichenberger-Liwicki, M., Dengel, A.: A.scatch - a sketch-based retrieval for architectural floor plans. In: International Conference on Frontiers of Handwriting Recognition, pp. 289–294 (2010)

    Google Scholar 

  16. Wienecke, M., Fink, G.A., Sagerer, G.: Towards automatic video-based whiteboard reading. In: International Conference on Document Analysis and Recognition, Washington, DC, USA, pp. 87–91 (2003)

    Google Scholar 

  17. Wienecke, M., Fink, G.A., Sagerer, G.: Toward automatic video-based whiteboard reading. International Journal on Document Analysis and Recognition 7(2-3), 188–200 (2005)

    CrossRef  Google Scholar 

  18. Yoshida, D., Tsuruoka, S., Kawanaka, H., Shinogi, T.: Keywords recognition of handwritten character string on whiteboard using word dictionary for e-learning. In: Proceedings of the 2006 International Conference on Hybrid Information Technology, ICHIT 2006, vol. 01, pp. 140–145. IEEE Computer Society, Washington, DC, USA (2006)

    Google Scholar 

  19. Yoshida, D., Tsuruoka, S., Kawanaka, H., Shinogi, T.: Keywords recognition of handwritten character string on whiteboard using word dictionary for e-learning. In: International Conference on Hybrid Information Technology, pp. 140–145 (2006)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and Permissions

Copyright information

© 2012 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Vajda, S., Rothacker, L., Fink, G.A. (2012). A Method for Camera-Based Interactive Whiteboard Reading. In: Iwamura, M., Shafait, F. (eds) Camera-Based Document Analysis and Recognition. CBDAR 2011. Lecture Notes in Computer Science, vol 7139. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-29364-1_9

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-29364-1_9

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-29363-4

  • Online ISBN: 978-3-642-29364-1

  • eBook Packages: Computer ScienceComputer Science (R0)