Abstract
Local image descriptors provide robust descriptions of image localities. Their geometric arrangement provides additional information about the image they describe, a fact often ignored when employing them to that wide slew of tasks from image registration to scene classification. On the premise that descriptor quality could be assessed in terms of its expressiveness of image content, we investigate the use of the described as well as that additional geometric information to the task of recovering the image from its local descriptors. This paper uses Local Binary Patterns, an operator nested in a dense geometry, to study how this additional information in the form of constraints among pixels dictates the intensity estimated for a pixel. We determine that constraints propagate from regional extrema to regions around them that observe the same constraint class, and that the intensity for any of the region’s pixels influences that for all others. We build a directed constraint graph of pixel nodes such that the arcs on the graph are strongly k-consistent, and propagate intensity estimates from extremum nodes. Evaluations are run on the SIPI texture and the BSD500 datasets. The estimates preserve the local structure of the image, as shown by the Mean Absolute Error of about \(15\%\) and \(18\%\) respectively and Structural Texture SIMilarity of about \(92\%\) for both datasets, in addition to observing \(100\%\) constraint satisfaction.
T.Q. Syed and S.I. Behlim—Equal contribution.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Yao, C.-H., Chen, S.-Y.: Retrieval of translated, rotated and scaled color textures. Pattern Recognition 36(4), 913–929 (2003)
Wang, H., Ullah, M.M., Klaser, A., Laptev, I., Schmid, C: Evaluation of local spatio-temporal features for action recognition. In: Procedings of the British Machine Vision Conference 2009, pp. 124.1–124.11 (2009)
Kellokumpu, V., Zhao, G., Li, S.Z., Pietikäinen, M.: Dynamic Texture Based Gait Recognition, pp. 1000–1009 (2009)
Zhao, G., Chen, J., Pietikäinen, M.: An improved local descriptor and threshold learning for unsupervised dynamic texture segmentation. In: Proc. 2nd IEEE International Workshop on Machine Learning for Vision-based Motion Analysis (MLVMA 2009), Kyoto, Japan, pp. 460–467 (2009)
Mikolajczyk, K., Schmid, C.: A Performance Evaluation of Local Descriptors. IEEE Transaction on Pattern Analysis and Machine Intelligence 27, 1615–1630 (2005)
Weinzaepfel, P., Jégou, H., Pérez, P.: Reconstructing an image from its local descriptors. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 337–344 (2011)
Daneshi, M., Guo, J.: Image reconstruction based on local feature descriptors (2011)
Wu, J., Rehg, J.M.: CENTRIST: A Visual Descriptor for Scene Categorization. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1–14, December 2010
Waller, B.M., Nixon, M.S., Carter, J.N.: Image reconstruction from local binary patterns. In: 2013 International Conference on Signal-Image Technology & Internet-Based Systems, pp. 118–123. IEEE, December 2013
Gudmundsson, B., Kruse, B., Antonsson, D.: PICAP and Relational Neighborhood Processing in FIP
Lindahl, T:. Study of Local Binary Patterns Study of Local Binary Patterns Examensarbete utfört i medieteknik Tobias Lindahl (2007)
Timo, O., Pietikätinen, M., Harwood, D.: A comparative study of texture measures with classification based on featured distributions. Pattern Recognition 29(1), 51–59 (1996)
Qing, X., Yang, J., Ding, S.: Texture segmentation using lbp embedded region competition. Electronic Letters on Computer Vision and Image Analysis 5(1), 41–47 (2005)
Mackworth, A.: Consistency in networks of relations. Artificial Intelligence 8(1), 99–118 (1977)
Freuder, C.E.: Synthesizing constraint expressions. Commun. ACM 21(11), 958–966 (1978)
Freuder, E.C.: A sufficient condition for backtrack-free search. J. ACM 29(1), 24–32 (1982)
Zujovic, J., Pappas, T.N., Neuhoff, D.L.: Structural similarity metrics for texture analysis and retrieval. In: 2009 16th IEEE International Conference on Image Processing (ICIP), vol. 22(7), pp. 2545–2558 (2009)
Ortiz, R.: Freak: Fast retina keypoint. In: Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2012, pp. 510–517. IEEE Computer Society, Washington, DC (2012)
Calonder, M., Lepetit, V., Strecha, C., Fua, P.: BRIEF: Binary robust independent elementary features. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010, Part IV. LNCS, vol. 6314, pp. 778–792. Springer, Heidelberg (2010)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Syed, T.Q., Behlim, S.I., Merchant, A.K., Thomas, A., Khan, F.M. (2015). Leveraging Mutual Information in Local Descriptions: From Local Binary Patterns to the Image. In: Murino, V., Puppo, E. (eds) Image Analysis and Processing — ICIAP 2015. ICIAP 2015. Lecture Notes in Computer Science(), vol 9280. Springer, Cham. https://doi.org/10.1007/978-3-319-23234-8_23
Download citation
DOI: https://doi.org/10.1007/978-3-319-23234-8_23
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-23233-1
Online ISBN: 978-3-319-23234-8
eBook Packages: Computer ScienceComputer Science (R0)