A MAP Estimator for Simultaneous Superresolution and Detector Nonunifomity Correction
- 1.9k Downloads
During digital video acquisition, imagery may be degraded by a number of phenomena including undersampling, blur, and noise. Many systems, particularly those containing infrared focal plane array (FPA) sensors, are also subject to detector nonuniformity. Nonuniformity, or fixed pattern noise, results from nonuniform responsivity of the photodetectors that make up the FPA. Here we propose a maximum a posteriori (MAP) estimation framework for simultaneously addressing undersampling, linear blur, additive noise, and bias nonuniformity. In particular, we jointly estimate a superresolution (SR) image and detector bias nonuniformity parameters from a sequence of observed frames. This algorithm can be applied to video in a variety of ways including using a moving temporal window of frames to process successive groups of frames. By combining SR and nonuniformity correction (NUC) in this fashion, we demonstrate that superior results are possible compared with the more conventional approach of performing scene-based NUC followed by independent SR. The proposed MAP algorithm can be applied with or without SR, depending on the application and computational resources available. Even without SR, we believe that the proposed algorithm represents a novel and promising scene-based NUC technique. We present a number of experimental results to demonstrate the efficacy of the proposed algorithm. These include simulated imagery for quantitative analysis and real infrared video for qualitative analysis.
KeywordsUndersampling Focal Plane Array Fixed Pattern Pattern Noise Estimation Framework
- 8.Harris JG, Chiang Y-M: Nonuniformity correction using the constant-statistics constraint: analog and digital implementations. In Infrared Technology and Applications XXIII, April 1997, Orlando, Fla, USA, Proceedings of SPIE Edited by: Andresen BF, Strojnik M. 3061: 895–905.Google Scholar
- 10.Scribner DA, Sarkady KA, Caulfield JT, et al.: Nonuniformity correction for staring IR focal plane arrays using scene-based techniques. In Infrared Detectors and Focal Plane Arrays, April 1990, Orlando, Fla, USA, Proceedings of SPIE Edited by: Dereniak EL, Sampson RE. 1308: 224–233.Google Scholar
- 11.Scribner DA, Sarkady KA, Kruer MR, Caulfield JT, Hunt JD, Herman C: Adaptive nonuniformity correction for IR focal-plane arrays using neural networks. In Infrared Sensors: Detectors, Electronics, and Signal Processing, July 1991, San Diego, Calif, USA, Proceedings of SPIE Edited by: Jayadev TS. 1541: 100–109.CrossRefGoogle Scholar
- 16.Hardie RC, Hayat MM: A nonlinear-filter based approach to detector nonuniformity correction. Proceedings of IEEE-EURASIP Workshop on Nonlinear Signal and Image Processing, June 2001, Baltimore, Md, USA 66–85.Google Scholar
- 17.O'Neil WF: Dithered scan detector compensation. Proceedings of the Infrared Information Symposium (IRIS) Specialty Group on Passive Sensors, 1993, Ann Arbor, Mich, USAGoogle Scholar
- 18.O'Neil WF: Experimental verification of dither scan non-uniformity correction. Proceedings of the Infrared Information Symposium (IRIS) Specialty Group on Passive Sensors, 1997, Monterey, Calif, USA 1: 329–339.Google Scholar
- 25.Borman S: Topics in multiframe superresolution restoration, Ph.D. dissertation.Google Scholar
- 27.Cheeseman P, Kanefsky B, Kraft R, Stutz J, Hanson R: Super-resolved surface reconstruction from multiple images. In Tech. Rep. FIA-94-12. NASA, Moffett Field, Calif, USA; 1994.Google Scholar
- 28.Cain SC, Hardie RC, Armstrong EE: Restoration of aliased video sequences via a maximum-likelihood approach. Proceedings of National Infrared Information Symposium (IRIS) on Passive Sensors, March 1996, Monterey, Calif, USA 230–251.Google Scholar
- 31.Armstrong EE, Hayat MM, Hardie RC, Torres SN, Yasuda BJ: Nonuniformity correction for improved registration and high-resolution image reconstruction in IR imagery. In Applications of Digital Image Processing XXII, July 1999, Denver, Colo, USA, Proceedings of SPIE Edited by: Tescher AG. 3808: 150–161.CrossRefGoogle Scholar
- 32.Armstrong EE, Hayat MM, Hardie RC, Torres SN, Yasuda B: The advantage of non-uniformity correction pre-processing on infrared image registration. Application of Digital Image Processing XXII, July 1999, Denver, Colo, USA, Proceedings of SPIE 3808:Google Scholar
- 33.Cain S, Armstrong EE, Yasuda B: Joint estimation of image, shifts, and nonuniformities from IR images. In Infrared Information Symposium (IRIS) on Passive Sensors, 1997, Ann Arbor, Mich, USA. Infrared Information Analysis Center, ERIM International;Google Scholar
- 39.Irani M, Peleg S: Improving resolution by image registration. CVGIP: Graphical Models and Image Processing 1991,53(3):231-239. 10.1016/1049-9652(91)90045-LGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 2.0 International License (https://doi.org/creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.