Integrated Sensing and Processing for Hyperspectral Imagery

  • Robert Muise
  • Abhijit Mahalanobis
Part of the Augmented Vision and Reality book series (Augment Vis Real, volume 3)


In this chapter, we present an information sensing system which integrates sensing and processing resulting in the direct collection of data which is relevant to the application. Broadly, integrated sensing and processing (ISP) considers algorithms that are integrated with the collection of data. That is, traditional sensor development tries to come up with the “best” sensor in terms of SNR, resolution, data rates, integration time, and so forth, while traditional algorithm development tasks might wish to optimize probability of detection, false alarm rate, and class separability. For a typical automatic target recognition (ATR) problem, the goal of ISP is to field algorithms which “tell” the sensor what kind of data to collect next and the sensor alters its parameters to collect the “best” information in order that the algorithm performs optimally. We illustrate the concept of ISP using a near Infrared (NIR) hyperspectral imaging sensor. This prototype sensor incorporates a digital mirror array (DMA) device in order to realize a Hadamard multiplexed imaging system. Specific Hadamard codes can be sent to the sensor to realize inner products of the underlying scene rather than the scene itself. The developed ISP algorithms utilize these codes to overcome issues traditionally associated with hyperspectral imaging (i.e. Data Glut and SNR issues) while also performing a object detection task. The underlying integration of the sensing and processing results in algorithms which have better overall performance while collecting less data.


Hyperspectral imaging Adaptive imaging Compressive imaging Hadamard multiplexing 


  1. 1.
    Harwit, M., Sloane, N.J.A.: Hadamard Transform Optics. Academic Press, New York (1979)zbMATHGoogle Scholar
  2. 2.
    DeVerse, R.A., Hammaker, R.M., Fately, W.G.: Realization of the Hadamard multiplex advantage using a programmable optical mask in a dispersive flat-field near-infrared spectrometer. Appl. Spectrosc. 54(12), 1751–1758 (2000)CrossRefGoogle Scholar
  3. 3.
    Wuttig, A., Riesenberg, R.: Sensitive Hadamard transform imaging spectrometer with a simple MEMS. In: Proceedings of SPIE 4881, pp. 167–178 (2003)Google Scholar
  4. 4.
    Donoho, D.L.: Compressed sensing, Stanford University: Department of Statistics report 2004-25, October, 2004Google Scholar
  5. 5.
    Candès, E., Romberg, J., Tao, T.: Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information. IEEE Trans. Inf. Theory 52, 489–509 (2006)CrossRefGoogle Scholar
  6. 6.
    Neifeld, M.A., Shankar, P.: Feature-specific imaging. Appl. Opt. 42, 3379–3389 (2003)CrossRefGoogle Scholar
  7. 7.
    Mahalanobis, A., Daniell, C.: Data compression and correlation filtering: a seamless approach to pattern recognition. In: Javidi, B. (ed.) Smart Imaging Systems. SPIE Press, Bellingham (2001)Google Scholar
  8. 8.
    Mahalanobis, A., Vijaya Kumar, B.V.K., Song, S., Sims, S.R.F., Epperson, J.F.: Unconstrained correlation filters. App. Opt. 33(17), 3751–3759 (1994)CrossRefGoogle Scholar
  9. 9.
    Fateley, W.G., Coifman, R.R., Geshwind, F., DeVerse, R.A.: System and method for encoded spatio-spectral information processing. US Patent # 6,859,275, February 2005Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  1. 1.Lockheed Martin Missiles and Fire ControOrlandoUSA

Personalised recommendations