Abstract
Deep images store multiple fragments perpixel, each of which includes colour and depth, unlike traditional 2D flat images which store only a single colour value and possibly a depth value. Recently, deep images have found use in an increasing number of applications, including ones using transparency and compositing. A step in compositing deep images requires merging per-pixel fragment lists in depth order; little work has so far been presented on fast approaches.
This paper explores GPU based merging of deep images using different memory layouts for fragment lists: linked lists, linearised arrays, and interleaved arrays. We also report performance improvements using techniques which leverage GPU memory hierarchy by processing blocks of fragment data using fast registers, following similar techniques used to improve performance of transparency rendering. We report results for compositing from two deep images or saving the resulting deep image before compositing, as well as for an iterated pairwise merge of multiple deep images. Our results show a 2 to 6 fold improvement by combining efficient memory layout with fast register based merging.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
Heckenberg, D.; Saam, J.; Doncaster, C.; Cooper, C. Deep compositing. 2010. Available at https://doi.org/www.johannessaam.com/deepImage.pdf.
Duff, T. Deep compositing using lie algebras. ACM Transactions on Graphics Vol. 36, No. 3, Article No. 26, 2017.
Maule, M.; Comba, J. L. D.; Torchelsen, R.; Bastos, R. Memory-efficient order-independent transparency with dynamic fragment buffer. In: Proceedings of the 25th SIBGRAPI Conference on Graphics, Patterns and Images, 134–141, 2012.
Knowles, P.; Leach, G.; Zambetta, F. Efficient layered fragment buffer techniques. In: OpenGL Insights. Cozzi, P.; Riccio, C. Eds. CRC Press, 279–292, 2012.
Knowles, P.; Leach, G.; Zambetta, F. Fast sorting for exact OIT of complex scenes. The Visual Computer Vol. 30, Nos. 6–8, 603–613, 2014.
Porter, T.; Duff, T. Compositing digital images. In: Proceedings of the 11th Annual Conference on Computer Graphics and Interactive Techniques, 253–259, 1984.
Egstad, J.; Davis, M.; Lacewell, D. Improved deep image compositing using subpixel masks. In: Proceedings of the 2015 Symposium on Digital Production, 21–27, 2015.
Hillman, P. The theory of OpenEXR deep samples. Technical Report. Weta Digital Ltd., 2013.
Knowles, P.; Leach, G.; Zambetta, F. Backwards memory allocation and improved OIT. In: Proceedings of the Pacific Graphics, 59–64, 2013.
McGuire, M. Computer graphics archive. 2017. Available at https://doi.org/casual-effects.com/data.
Acknowledgements
The authors would like to thank Pyar Knowles for his original deep image software on which this work is based. It is available at https://doi.org/github.com/pknowles/lfb.
Author information
Authors and Affiliations
Corresponding author
Additional information
Jesse Archer is a Ph.D. student at RMIT University, Melbourne. His research interests are in realtime computer graphics and GPU computing. He completed his bachelor of computer science in 2008, bachelor of IT (games and graphics programming) in 2010, and honours in computer science in 2015 at RMIT University.
Geoff Leach is a lecturer in the School of Science at RMIT University. His major research interests include computer graphics, computational science, and GPU computing. He mostly teaches computer graphics, and has been using OpenGL since version 1.1. He holds a M.App.Sci. degree from RMIT University.
Ron van Schyndel is a senior lecturer from School of Science (formerly School of Computer Science and IT) at RMIT University. He is and has been an active researcher in the domain of digital watermarking for more than 2 decades, and is co-author to some of the most cited papers in the field. He obtained his Ph.D. degree from Monash University on the then nascent topic of digital watermarking, and has obtained many industry grants on watermarking and other applications. His other research interests beyond digital watermarking include signal, image, and vision processing, as well as software infrastructure specifically as applied to mobile navigation for the blind and visually impaired.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made.
The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder.
To view a copy of this licence, visit https://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Archer, J., Leach, G. & van Schyndel, R. GPU based techniques for deep image merging. Comp. Visual Media 4, 277–285 (2018). https://doi.org/10.1007/s41095-018-0118-8
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s41095-018-0118-8