Optical Remote Sensing

Volume 3 of the series Augmented Vision and Reality pp 49-64


Integrated Sensing and Processing for Hyperspectral Imagery

  • Robert MuiseAffiliated withLockheed Martin Missiles and Fire Contro Email author 
  • , Abhijit MahalanobisAffiliated withLockheed Martin Missiles and Fire Contro

* Final gross prices may vary according to local VAT.

Get Access


In this chapter, we present an information sensing system which integrates sensing and processing resulting in the direct collection of data which is relevant to the application. Broadly, integrated sensing and processing (ISP) considers algorithms that are integrated with the collection of data. That is, traditional sensor development tries to come up with the “best” sensor in terms of SNR, resolution, data rates, integration time, and so forth, while traditional algorithm development tasks might wish to optimize probability of detection, false alarm rate, and class separability. For a typical automatic target recognition (ATR) problem, the goal of ISP is to field algorithms which “tell” the sensor what kind of data to collect next and the sensor alters its parameters to collect the “best” information in order that the algorithm performs optimally. We illustrate the concept of ISP using a near Infrared (NIR) hyperspectral imaging sensor. This prototype sensor incorporates a digital mirror array (DMA) device in order to realize a Hadamard multiplexed imaging system. Specific Hadamard codes can be sent to the sensor to realize inner products of the underlying scene rather than the scene itself. The developed ISP algorithms utilize these codes to overcome issues traditionally associated with hyperspectral imaging (i.e. Data Glut and SNR issues) while also performing a object detection task. The underlying integration of the sensing and processing results in algorithms which have better overall performance while collecting less data.


Hyperspectral imaging Adaptive imaging Compressive imaging Hadamard multiplexing