Advertisement

Evaluation of Image Fusion Performance with Visible Differences

  • Vladimir Petrović
  • Costas Xydeas
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3023)

Abstract

Multisensor signal-level image fusion has attracted considerable research attention recently. Whereas it is relatively straightforward to obtain a fused image, e.g. a simple but crude method is to average the input signals, assessing the performance of fusion algorithms is much harder in practice. This is particularly true in widespread “fusion for display” applications where multisensor images are fused and the resulting image is presented to a human operator. As recent studies have shown, the most direct and reliable image fusion evaluation method, subjective tests with a representative sample of potential users are expensive in terms of both time/effort and equipment required. This paper presents an investigation into the application of the Visible signal Differences Prediction modelling, to the objective evaluation of the performance of fusion algorithms. Thus given a pair of input images and a resulting fused image, the Visual Difference Prediction process evaluates the probability that a signal difference between each of the inputs and the fused image can be detected by the human visual system. The resulting probability maps are used to form objective fusion performance metrics and are also integrated with more complex fusion performance measures. Experimental results indicate that the inclusion of visible differences information in fusion assessment yields metrics whose accuracy, with reference to subjective results, is superior to that obtained from the state of the art objective fusion performance measures.

Keywords

Input Image Image Fusion Fusion Evaluation Visible Difference Fusion Algorithm 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

References

  1. 1.
    Zhang, Z., Blum, R.: A Categorization of Multiscale-Decomposition-Based Image Fusion Schemes with a Performance Study for a Digital Camera Application. Proceedings of the IEEE 87(8), 1315–1326 (1999)CrossRefGoogle Scholar
  2. 2.
    Rockinger, O., Fechner, T.: Pixel-Level Image Fusion: The Case of Image Sequences. In: Proc. SPIE, vol. 3374, pp. 378–388 (1998)Google Scholar
  3. 3.
    Li, H., Munjanath, B., Mitra, S.: Multisensor Image Fusion Using the Wavelet Transform. Graphical Models and Image Proc. 57(3), 235–245 (1995)CrossRefGoogle Scholar
  4. 4.
    Chibani, Y., Houacine, A.: Multiscale versus Multiresolution Analysis for Multisensor Image Fusion. In: Proc. Eusipco 1998, Rhodes (1998)Google Scholar
  5. 5.
    Petrović, V., Xydeas, C.: Computationally Efficient Pixel-level Image Fusion. In: Proceedings of Eurofusion 1999, Stratford-upon-Avon, October 1999, pp. 177–184 (1999)Google Scholar
  6. 6.
    Toet, A., Schoumans, N., Ijspeert, J.: Perceptual Evaluation of Different Nighttime Imaging Modalities. In: Proc. Fusion 2000, Paris, pp. TuD3-17 – TuD3-23 (2000)Google Scholar
  7. 7.
    Toet, A., Ijspeert, J.K.: Perceptual evaluation of different image fusion schemes. In: Proc. SPIE, pp. 436-441 (2001)Google Scholar
  8. 8.
    Steele, P., Perconti, P.: Part task investigation of multispectral image fusion using gray scale and synthetic color night vision sensor imagery for helicopter pilotage. In: Proc. SPIE, vol. 3062, pp. 88–100 (1997)Google Scholar
  9. 9.
    Sims, R., Phillips, M.: Target signature consistency of image data fusion alternatives. Optical Engineering 36(3), 743–754 (1997)CrossRefGoogle Scholar
  10. 10.
    Ulug, M., McCullough, C.: A quantitative metric for comparison of night vision fusion algorithms. In: Proc. SPIE, vol. 4051, pp. 80–88 (2000)Google Scholar
  11. 11.
    Handee, W., Wells, P.: The Perception of Visual Information. Springer, New York (1997)Google Scholar
  12. 12.
    Qu, G., Zhang, D., Yan, P.: Information measure for performance of image fusion. Electronic Letters 38(7), 313–315Google Scholar
  13. 13.
    Chin, F.: Objective Image Quality Assessment and Spatial Adaptive JPEG Image Coding. MPhil thesis, University of Lancaster (April 2002)Google Scholar
  14. 14.
    Daly, S.: The visible differences predictor: an algorithm for the assessment of image fidelity. In: Digital images and human vision. MIT Press, Cambridge (1993)Google Scholar
  15. 15.
    Xydeas, C., Petrović, V.: Objective Image Fusion Performance Measure. Electronics Letters 36(4), 308–309 (2000)CrossRefGoogle Scholar
  16. 16.
    ITU-R BT.500-10: Methodology for the subjective assessment of the quality of television pictures, ITU Radiocommunication Assembly (1974-2000)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2004

Authors and Affiliations

  • Vladimir Petrović
    • 1
  • Costas Xydeas
    • 2
  1. 1.Imaging Science Biomedical EngineeringUniversity of ManchesterManchesterUK
  2. 2.Dept. Communication SystemsUniversity of LancasterLancasterUK

Personalised recommendations