Abstract
Media capture of live events such as concerts can be improved by including user generated content, adding more perspectives and possibly covering scenes outside the scope of professional coverage. In this paper we propose methods for visual quality analysis on mobile devices, in order to provide direct feedback to the contributing user about the quality of the captured content. Thus, wasting bandwidth and battery for uploading/streaming low-quality content can be avoided. We focus on real-time quality analysis that complements information that can be obtained from other sensors (e.g., stability). The proposed methods include real-time capable algorithms for sharpness, noise and over-/ underexposure which are integrated in a capture app for Android. Objective evaluation results show that our algorithms are competitive to state-of-the art quality algorithms while enabling real-time quality feedback on mobile devices.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Bosco, A., Bruna, A., Messina, G., Spampinato, G.: Fast method for noise level estimation and integrated noise reduction. IEEE Trans. Consum. Electron. 51(3), 1028–1033 (2005)
Fassold, H., Wechtitsch, S., Hofmann, A., Bailer, W., Schallauer, P., Borgotallo, R., Messina, A., Liu, M., Ndjiki-Nya, P., Altendorf, P.: Automated visual quality analysis for media production. In: IEEE International Symposium on Multimedia (2012)
Feichtenhofer, C., Fassold, H., Schallauer, P.: A perceptual image sharpness metric based on local edge gradient analysis. IEEE Sig. Proc. Letters 20(4), 379–382 (2013)
Ferzli, R., Karam, L.J.: A no-reference objective image sharpness metric based on the notion of just noticeable blur (JNB). IEEE Trans. Image Process. 18(4), 717–728 (2009)
Hassen, R., Wang, Z., Salama, M.: No-reference image sharpness assessment based on local phase coherence measurement. In: IEEE ICASSP (2010)
Hou, L., Ji, H., Shen, Z.: Recovering over-/underexposed regions in photographs. SIAM J. Imaging Sci. 6(4), 2213–2235 (2013)
Ko, J., Kim, C.: Low cost blur image detection and estimation for mobile devices. In: 11th ICACT, vol. 3 (2009)
Schallauer, P., Mörzinger, R.: Film grain synthesis and its application to re-graining. In: SPIE Electronic Imaging (2006)
Sheikh, H., Wang, Z., Cormack, L., Bovik, A.: LIVE image quality assessment database, release 2 [Online]. http://live.ece.utexas.edu/research/quality
Vlachos, T.: Flicker correction for archived film sequences using a nonlinear model. IEEE Trans. Circuits Syst. Video Tech. 14(4), 508–516 (2004)
Yoon, Y.-J., Byun, K.-Y., Lee, D.-H., Jung, S.-W., Ko, S.-J.: A new human perception-based over-exposure detection method for color images. Sensors 14(9), 17159–17173 (2014)
Yousefi, S., Rabiee, H.R., Mianjy, P.: Optimal exposure detection function for digital and smart-phone camera applications. In: IEEE ICCE (2012)
Zlokolica, V., Pizurica, A., Philips, W.: Noise estimation for video processing based on spatio-temporal gradients. IEEE Sig. Proc. Lett. 13(6), 337–340 (2006)
Acknowledgements
The authors would like to thank their project partners bitmovin for providing the video streaming implementation and VRT for the graphics design. The research leading to these results has received funding from the European Union’s Seventh Framework Programme (FP7/2007-2013) under grant agreement n\(^\circ \) 610370, ICoSOLE (“Immersive Coverage of Spatially Outspread Live Events”, http://www.icosole.eu).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this paper
Cite this paper
Wechtitsch, S., Fassold, H., Thaler, M., Kozłowski, K., Bailer, W. (2016). Quality Analysis on Mobile Devices for Real-Time Feedback. In: Tian, Q., Sebe, N., Qi, GJ., Huet, B., Hong, R., Liu, X. (eds) MultiMedia Modeling. MMM 2016. Lecture Notes in Computer Science(), vol 9516. Springer, Cham. https://doi.org/10.1007/978-3-319-27671-7_30
Download citation
DOI: https://doi.org/10.1007/978-3-319-27671-7_30
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-27670-0
Online ISBN: 978-3-319-27671-7
eBook Packages: Computer ScienceComputer Science (R0)