Abstract
In this paper, a software system for image processing with parallel computing based on the geometrized histograms method developed for the concise description and segmentation of color images and for designing real-time image understanding systems is described. The parallel processing leans on the fact that, in contrast to the majority of the existing image segmentation methods, the proposed method is designed so that the most labor-consuming operations with the pixel array can be executed using n independent threads. The principles of designing programs for data processing in separate threads in which the program produces a substantial, compressed description of an image (a frame of a video sequence) that preserves the geometrical relations of the source image but has a dimension by several orders of magnitude less than the original image are described. The main operations of the segmentation and image understanding systems are executed without using the image pixel array—only using the designed concise description. These operations require a short execution time (on the average less than 10 ms for the whole set of tasks) on standard modern personal computers, even for HD video. In this paper, a multithreaded implementation of constructing a concise description of an image (a frame) is considered that allows one to enhance the operation speed, which is already fairly high, up to the record productivity figures. The application to systems for understanding road scenes, such as systems for finding the road region, its roadsides, the sky region, to systems for detecting and understanding road markings (permanent white and temporary colored), as well as to finding signal lamps of helicopters, are also described. Examples of processing results for particular road scenes are presented and discussed, and estimates of the operation speed for video sequences of real road scenes are given.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
REFERENCES
Felzenszwalb, P.F. and Huttenlocher, D.P., Efficient graph-based image segmentation, Int. J. Comput. Vision, 2004, vol. 59, no. 2, pp. 167–181.
Shotton, J., Winn, J., Rother, C., and Criminisi, C.A., Texstonboost for image understanding multi-class objects recognition and segmentation by jointly modeling texture, layout, and context, Int. J. Comput. Vision, 2007, vol. 81, no. 1, pp. 2–23.
Badrinarayanan, V., Kendall, A., and Cipola, R., Segnet: a deep convolutional encoder-decoder architecture for image segmentation, IEEE Trans. PAMI, 2017, vol. 39, no. 12, pp. 2481–2495.
Tian, Y., Gelernter, J., and Wang, X., Lane marking detection via deep convolutional neural network, Neurocomputing, 2018, vol. 280, pp. 46–55.
Lin, G., Santoso, P.S., Lin, C., Tsai, C., and Guo, J., One stage detection network with an auxiliary classifier for real-time road marks detection, Proc. of the Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC), 2018, pp. 1379–1382.
Norote, S.P., Bhujbal, P.N., Norote, A.S., and Dhane, D.M., A review of recent advances in lane detection and departure warning system, Pattern Recognit., 2018, vol. 73, no. 2, pp. 216–234.
Son, J., Yoo, H., Kim, S., and Sohn, K., Real-time invariant lane detection for lane departure warning system, Expert Syst. Appl., 2015, vol. 42, pp. 1816–24.
Chen, L., Li, J., Zhou, J., and Jiang, M., Multithreading method to perform the parallel image registration, Proc. of the International Conference on Computational Intelligence and Software Engineering, 2009, pp. 1–4.
Saaidon, N. and Sediono, W., Multicolour object detection using multithreading, Proc. of the IEEE Symposium on Computer Applications & Industrial Electronics (ISCAIE), 2015, pp. 48–52.
Kiy, K.I., A new real-time method for description and generalized segmentation of color images, Pattern Recognit. Image Anal., 2010, vol. 20, no. 2, pp. 398–401.
Kiy, K.I., Segmentation and detection of contrast objects and their application in robot navigation, Pattern Recognit. Image Anal., 2015, vol. 25, no. 2, pp. 338–346.
Kiy, K.I., A new method of global image analysis and its application in understanding road scenes, Pattern Recognit. Image Anal., 2018, vol. 28, no. 3, pp. 483–494.
Kiy, K.I., An image understanding system based on the geometrized histograms method: finding the sky in road scenes, CEUR Workshop Proceedings, vol. 2210. pp. 291–299. http://ceur-ws.org/Vol-2210/paper38.pdf/. Cited August 10, 2020.
Dosaev, R.V. and Kiy, K.I. A new real-time method for finding temporary and permanent road marking CEUR Workshop Proceedings, vol. 2391, pp. 86–96. http://ceur-ws.org/Vol-2391/paper12.pdf/. Cited August 10, 2020.
Podoprosvetov, A.V., Pavlovskiy, V.E., Kiy, K.I., and Anokhin, D.A., Development of complex control system for the autonomous vehicle Niva, Proc. of the XXI International Conference Complex Systems: Control and Modeling Problems (CSCMP), 2019, pp. 311-315. https://ieeexplore.ieee.org/xpl/conhome/8962908/proceeding. Cited August 10, 2020.
http://video.mail.ru/mail/kikip_46/_myvideo/. Cited August 10, 2020.
www.facebook.com/100004887018729/videos. Cited August 10, 2020.
http://project1054516.tilda.ws/. Cited August 10, 2020.
Author information
Authors and Affiliations
Corresponding authors
Additional information
Translated by A. Klimontovich
Rights and permissions
About this article
Cite this article
Kiy, K.I., Anokhin, D.A. & Podoprosvetov, A.V. A Software System for Processing Images with Parallel Computing. Program Comput Soft 46, 406–417 (2020). https://doi.org/10.1134/S0361768820060043
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1134/S0361768820060043