Abstract
This paper presents a video context enhancement method for night surveillance. The basic idea is to extract and fuse the meaningful information of video sequence captured from a fixed camera under different illuminations. A unique characteristic of the algorithm is to separate the image context into two classes and estimate them in different ways. One class contains basic surrounding scene information and scene model, which is obtained via background modeling and object tracking in daytime video sequence. The other class is extracted from nighttime video, including frequently moving region, high illumination region and high gradient region. The scene model and pixel-wise difference method are used to segment the three regions. A shift-invariant discrete wavelet based image fusion technique is used to integral all those context information in the final result. Experiment results demonstrate that the proposed approach can provide much more details and meaningful information for nighttime video.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
A. Ilie, R. Raskar, and J. Yu. Gradient domain context enhancement for fixed cameras. International Journal of Pattern Recognition and Artificial Intelligence, 19(2005)4, 533–549.
R. Raskar, A. Ilie, and J. Yu. Image fusion for context enhancement and video surrealism. The 3rd International Symposium on Non-photorealistic Animation and Rendering, Annecy, France, June 7–9, 2004, 85–94.
E. P. Bennett and L. McMillan. Video enhancement using per-pixel virtual exposures. ACM Transactions on Graphics, 24(2005)3, 845–852.
G. Mittal, S. Locharam, S. Sasi, G. R. Shaffer, and A. K. Kumar. An efficient video enhancement method using LA*B* analysis. IEEE International Conference on Video and Signal Based Surveillance, Sydney, Australia, November 22–24, 2006, 66–71.
D. Sale, R. Schultz, and J. Szczerba. Super-resolution enhancement of night vision image sequences. IEEE International Conference on Systems, Man, and Cybernetics, Nashville, TN, USA, 2000, 1633–1638.
S. Lee. An efficient content-based image enhancement in the compressed domain using retinex theory. IEEE Transactions on Circuits and Systems for Video Technology, 17(2007)2, 199–213.
S. Agaian, K. Panetta, and A. Grigoryan. Transform-based image enhancement algorithms with performance measure. IEEE Transactions on Image Processing, 10(2001)3, 367–382.
C. Stauffer, W. Eric, and L. Grimson. Learning patterns of activity using real-time tracking. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22(2000)8, 747–757.
T. Yang, S. Z. Li, Q. Pan, and J. Li. Real-time multiple object tracking with occlusion handling in dynamic scenes. IEEE Computer Vision and Pattern Recognition Conference, San Diego, CA, USA, June 20–25, 2005, 970–975.
G. Piella. A general framework for multiresolution image fusion: from pixels to regions. Elsevier Science, Information fusion, 4(2003)4, 259–280.
O. Rockinger. Image sequence fusion using a shift-invariant wavelet transform, International Conference on Image Processing, Washington DC, USA, October 26–29, 1997, 288–291.
C. M. Pun and M. C. Lee. Extraction of shift invariant wavelet features for classification of images with different sizes. IEEE Transactions on Pattern Analysis and Machine Intelligence, 26(2004)9, 1228–1233.
Author information
Authors and Affiliations
Corresponding author
Additional information
Supported by the National Natural Science Foundation of China (No.60634030 and No.60372085).
Communication author: Li Jing, born in 1979, female, lecturer.
About this article
Cite this article
Li, J., Yang, T., Pan, Q. et al. Combining scene model and fusion for night video enhancement. J. Electron.(China) 26, 88–93 (2009). https://doi.org/10.1007/s11767-007-0052-x
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11767-007-0052-x