Abstract
Based on the consideration of easy achievement in modern sensors, this paper further exploits the possibility of the recovery of high-speed video (HSV) by a single flutter shutter camera. Taking into account different degrees of smoothness along the spatial and temporal dimensions of HSV, this paper proposes to use a three-dimensional hyperbolic wavelet basis based on Kronecker product to jointly model the spatial and temporal redundancy of HSV. Besides, we incorporate the total variation of temporal correlations in HSV as a prior knowledge to further enhance our reconstruction quality. We recover the underlying HSV frames from the observed low-speed coded video by solving a convex minimization problem. The experimental results on simulated and real-world videos both demonstrate the validity of the proposed method.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
X. Wu and R. Pournaghi: Proc. 17th IEEE Int. Conf. Image Processing, 2010, p. 577.
B. Wilburn, N. Joshi, V. Vaish, E. Talvala, E. Antunez, A. Barth, A. Adams, M. Horowitz, and M. Levoy: ACM SIGGRAPH, 2005, p. 765.
E. Shechtman, Y. Caspi, and M. Irani: IEEE Trans. Pattern Anal. Mach. Intell. 27 (2005) 531.
A. Agrawal, M. Gupta, A. Veeraraghavan, and S. G. Narasimhan: Proc. 23rd IEEE Int. Conf. CVPR, 2010, p. 599.
R. Raskar, A. Agrawal, and J. Tumblin: ACM SIGGRAPH, 2006, p. 795.
A. Veeraraghavan, D. Reddy, and R. Raskar: IEEE Trans. Pattern Anal. Mach. Intell. 33 (2011) 671.
J. Holloway, A. C. Sankaranarayanan, A. Veeraraghavan, and S. Tambe: Proc. IEEE Int. Conf. Computational Photography, 2012, p. 1.
D. Reddy, A. Veeraraghavan, and R. Chellappa: Proc. IEEE Int. Conf. CVPR, 2011, p. 329.
Y. Hitomi, J. Gu, M. Gupta, T. Mitsunaga, and S. K. Nayar: Proc. IEEE Int. Conf. Computer Vision, 2011, p. 287.
D. Liu, J. Gu, Y. Hitomi, M. Gupta, T. Mitsunaga, and S. K. Nayar: IEEE Trans. Pattern Anal. Mach. Intell. 36 (2014) 248.
T. Portz, L. Zhang, and H. Jiang: Proc. IEEE Int. Conf. Computational Photography, 2013, p. 1.
C. F. Caiafa and A. Cichocki: Neural Comput. 25 (2013) 186.
M. F. Duarte and R. G. Baraniuk: IEEE Trans. Image Process. 21 (2012) 494.
A. C. Sankaranarayanan, C. Studer, and R. G. Baraniuk: Proc. IEEE Int. Conf. Computational Photography, 2012, p. 1.
A. Agrawal and R. Raskar: Proc. IEEE Int. Conf. CVPR, 2009, p. 2560.
Y. Zhang: Rice University Tech. Rep. 08-11 (2008).
R. Baraniuk, H. Choi, R. Neelamani, V. Ribeiro, J. Romberg, H. Guo, F. Fernandes, B. Hendricks, R. Gopinath, M. Lang, J. E. Odegard, and D. Wei: Rice Wavelet Toolbox (RWT), [http://dsp.rice.edu/software/rice-wavelet-toolbox].
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Huang, K., Zhang, J. & Hou, J. High-speed video capture by a single flutter shutter camera using three-dimensional hyperbolic wavelets. OPT REV 21, 509–515 (2014). https://doi.org/10.1007/s10043-014-0080-3
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10043-014-0080-3