Instant Scene Recognition on Mobile Platform
Scene recognition is extremely useful to improve different tasks involved in the Image Generation Pipeline of single sensor mobile devices (e.g., white balancing, autoexposure, etc). This demo showcases our scene recognition engine implemented on a Nokia N900 smartphone. The engine exploits an image representation directly obtainable in the IGP of mobile devices. The demo works in realtime and it is able to discriminate among different classes of scenes. The framework is built by employing the FCam API to have an easy and precise control of the mobile digital camera. Each acquired image (or frame of a video) is holistically represented starting from the statistics collected on DCT domain. This allow instant and “free of charge” feature extraction process since the DCT is always computed into the IGP of a mobile for storage purposes (i.e., JPEG or MPEG format). A SVM classifier is used to perform the final inference about the context of the scene.
KeywordsScene Recognition DCT Features FCam Mobile Platform
Unable to display preview. Download preview PDF.
- 3.Battiato, S., Farinella, G.M., Gallo, G., Ravì, D.: Exploiting textons distributions on spatial hierarchy for scene classification. Journal on Image and Video Processing 2010, 7:1–7:13 (2010)Google Scholar
- 5.Adams, A., Talvala, E.V., Park, S.H., Jacobs, D.E., Ajdin, B., Gelfand, N., Dolson, J., Vaquero, D., Baek, J., Tico, M., Lensch, H.P.A., Matusik, W., Pulli, K., Horowitz, M., Levoy, M.: The frankencamera: an experimental platform for computational photography. ACM Transactions on Graphics - Proceedings of ACM SIGGRAPH 2010 29, 29:1–29:12 (2010)Google Scholar
- 6.FCam Garage: FCam API (2012), http://fcam.garage.maemo.org/
- 7.Willow Garage: OpenCV: Open source computer vision library (2012), http://opencv.willowgarage.com/wiki/
- 8.Chang, C.C., Lin, C.J.: LIBSVM: A library for support vector machines (2012), http://www.csie.ntu.edu.tw/~cjlin/libsvm/