Tracking and Identification via Object Reflectance Using a Hyperspectral Video Camera
Recent advances in electronics and sensor design have enabled the development of a hyperspectral video camera that can capture hyperspectral datacubes at near video rates. The sensor offers the potential for novel and robust methods for surveillance by combining methods from computer vision and hyperspectral image analysis. Here, we focus on the problem of tracking objects through challenging conditions, such as rapid illumination and pose changes, occlusions, and in the presence of confusers. A new framework that incorporates radiative transfer theory to estimate object reflectance and particle filters to simultaneously track and identify an object based on its reflectance spectra is proposed. By exploiting high-resolution spectral features in the visible and near-infrared regimes, the framework is able to track objects that appear featureless to the human eye. For example, we demonstrate that near-IR spectra of human skin can also be used to distinguish different people in a video sequence. These capabilities are illustrated using experiments conducted on real hyperspectral video data.
KeywordsHyperspectral Video tracking ID Reflectance Particle filter
This research was supported by a Grant from JHU/Applied Physics Laboratory and the ONR MURI Grant N00014-08-1-0638.
- 1.Finlayson, G.D.: Computational color constancy. In: International Conference on Pattern Recognition, vol. 1, p. 1191 (2000)Google Scholar
- 7.Jurie, F., Dhome, M.: A simple and efficient template matching algorithm. In: ICCV, pp. 544–549 (2001)Google Scholar
- 9.Manolakis, D.: Detection algorithms for hyperspectral imaging applications: a signal processing perspective, pp. 378–384 (2003)Google Scholar
- 13.Piech, K.R., Walker, J.E.: Interpretation of soils. Photogrammetric Eng. 40, 87–94 (1974)Google Scholar
- 14.Szeredi, T., Lefebvre, J., Neville, R.A., Staenz, K., Hauff, P.: Automatic endmember extraction from hyperspectral data for mineral exploration. In: 4th International Airborne Remote Sensing Conference Exhibition/21st Canadian Symposium on Remote Sensing, Ottawa, Ontario, Canada, pp. 891–896 (1999)Google Scholar
- 15.Satter, R.G.: 65 million in jewelry stolen from London store. http://abcnews.go.com/International/wireStory?id=8302495, Aug. 2009 (2009)
- 16.Schott, J.R.: Remote Sensing: The Image Chain Approach, 2nd edn. Oxford University Press, New York (2007)Google Scholar