Abstract
In recent days, compressive video sensing combined both compression and video sensing into a single process, and has gained immense popularity in directly attaining compressed video data through arbitrary projections of each frame. However, it is a major issue in generating sophisticated videos. This paper devises a technique, namely a Shuffled sailfish optimizer (SSFO) for compressive video sensing using an encoder and decoder. The input video is divided into various Groups of Pictures and non-key frames. The video frames are divided into non-over-blocking blocks and every block is termed a vectorized column. The measurement vectors are quantized with Space Time Quantization and the bits linked with GOP are crowded in the packet and fed to the decoder once undergoing Huffman encoding. Once the decoder obtains the packet, it rebuilds GOP, and then the joint reconstruction is done with the proposed SSFO technique. Here, the proposed SSFO is obtained by combining the shuffled shepherd optimization algorithm, and the Sailfish optimizer. It utilizes a similar measurement matrix. The proposed SSFO outperformed with the highest Peak signal to noise ratio of 54.362 dB, Second derivative like measure of enhancement of 58.081 dB and structural similarity index measure of 0.927.
Similar content being viewed by others
Data availability
Five videos from the Sports-1 M dataset taken from, “https://cs.stanford.edu/people/karpathy/deepvideo/”, accessed on August 2020.
References
Li, R., Liu, H., Xue, R., Li, Y.: Compressive-sensing-based video codec by autoregressive prediction and adaptive residual recovery. Int. J. Distrib. Sensor Netw. 11(8), 562840 (2015)
Chen, C., Wu, Y., Zhou, C., Zhang, D.: JsrNet: a joint sampling-reconstruction frameworkfor distributed compressive video sensing. Sensors 20(1), 206 (2020)
Iliadis, M., Spinoulas, L., Katsaggelos, A.K.: Deepbinarymask: learning a binary mask for video compressive sensing. Digit. Signal Process. 96, 102591 (2020)
Song, Y., Zhang, D., Tang, Q., Tang, S., Yang, K.: Local and nonlocal constraints for compressed sensing video and multi-view image recovery. Neurocomputing 406, 34–48 (2020)
Shi, W., Liu, S., Jiang, F., Zhao, D.: Video compressed sensing using a convolutional neural network. IEEE Trans. Circuits Syst. Video Technol. 31(2), 425–438 (2020)
Chen, J., Chen, Z., Su, K., Peng, Z., Ling, N.: Video compressed sensing reconstruction based on structural groupsparsity and successive approximation estimation model. J. Vis. Commun. Image Represent. 66, 102734 (2020)
Zhou, C., Chen, C., Zhang, Y., Ding, F., Zhang, D.: MH-Net: a learnable multi-hypothesis networkfor compressed video sensing. IEEE Access 7, 166606–166613 (2019)
Hadizadeh, H., Bajic, I. V.: Soft video multicasting using adaptive compressed sensing. In: IEEE transactions on multimedia, pp 1–1, (2020)
Chen, J., Chen, Y., Qin, D., Kuo, Y.: An elastic net-based hybrid hypothesis methodfor compressed video sensing. Multimed. Tools Appl. 74(6), 2085–2108 (2015)
Gan, L.: Block compressed sensing of natural images. In: IEEE 15th International conference on digital signal processing, pp 403–406, (2007)
Angayarkanni, V., Radha, S., Akshaya, V.: Multi-view video codec using compressive sensing for wireless video sensor networks. Int. J. Mobile Commun. 17(6), 727–745 (2019)
Ji, B., Li, R., Wu, C.: Rate-distortion and rate-energy-distortion evaluations of compressive-sensing video coding. Int. J. Digit. Multimed. Broadcast. (2017). https://doi.org/10.1155/2017/4589124
Li, X., Lan, X., Yang, M., Xue, J., Zheng, N.: A new compressive sensing video coding framework based on Gaussian mixture model. Signal Process.: Image Commun. 55, 66–79 (2017)
Kuo, Y., Gao, Y., Zhang, X., Chen, J.: A new multiple frames decoding and frame wise measurement for compressed video sensing. Multimed. Tools Appl. 76(5), 7321–7339 (2017)
Liu, Y., Zhu, X., Zhang, L., Cho, S.H.: Distributed compressed video sensing in camera sensor networks. Int. J. Distrib. Sens. Netw. 8(12), 352167 (2012)
Di Laura, C., Pajuelo, D., Kemper, G.: A novel steganography technique for SDTV-H.264/AVC encoded video. Int. J. Digit. Multimed. Broadcast. (2016). https://doi.org/10.1155/2016/6950592
Estes, J.E.: Geographic applications of remotely sensed data. Proc. IEEE 73(6), 1097–1107 (1985)
Kumar, R., Sawhney, H., Samarasekera, S., Hsu, S., Tao, H., Guo, Y., Hanna, K., Pope, A., Wildes, R., Hirvonen, D., Hansen, M.: Aerial video surveillance and exploitation. Proc. IEEE 89(10), 1518–1539 (2001)
Do, T.T., Gan, L., Nguyen, N.H., Tran, T.D.: Fast and efficient compressive sensing using structurally random matrices. IEEE Trans. Signal Process. 60(1), 139–154 (2011)
Kang, L.W., Lu, C.S.:Distributed compressive video sensing. In: IEEE international conference on acoustics, speech and signal processing, pp 1169–1172, (2009)
Do, T.T., Chen, Y., Nguyen, D.T., Nguyen, N., Gan, L., Tran, T.D.: Distributed compressed video sensing. In: IEEE 16th international conference on image processing (ICIP), pp 1393–1396, (2009)
Prades-Nebot, J., Ma, Y., Huang, T.: Distributed video coding using compressive sampling, In: IEEE Picture Coding Symposium, pp 1–4, (2009)
Liu, Y., Li, M., Pados, D.A.: Motion-aware decoding of compressed-sensed video. IEEE Trans. Circuits Syst. Video Technol. 23(3), 438–444 (2012)
Kaveh, A., Zaerreza, A.: Shuffled shepherdoptimization method: a newMeta-heuristic algorithm. Eng. Comput. 37(7), 2357–2389 (2020)
Shadravan, S., Naji, H.R., Bardsiri, V.K.: The sailfish optimizer: a novel natureinspired metaheuristic algorithm forsolving constrained engineering optimization problems. Eng. Appl. Artif. Intell. 80, 20–34 (2019)
Five videos from Sports-1M dataset taken from, https://cs.stanford.edu/people/karpathy/deepvideo/, Accessed on August 2020
Li, R., Liu, H., He, W., Ma, X.: Space-time quantization and motion-aligned reconstruction for block-based compressive video sensing. KSII Trans. Internet Inf. Syst. (TIIS) 10(1), 321–340 (2016)
Sekar, R., Ravi, G.: Differential pulse code modulation and motion aligned optimal reconstruction for block-based compressive video sensing using conditional autoregressive-salp swarm algorithm. Int. J. Wavelets Multiresolution Inf. Process. 19(6), 2150021 (2021)
Acknowledgements
I would like to express my very great appreciation to the co-authors of this manuscript for their valuable and constructive suggestions during the planning and development of this research work.
Funding
This research did not receive any specific funding.
Author information
Authors and Affiliations
Contributions
All authors have made substantial contributions to the conception and design, revising the manuscript, and the final approval of the version to be published. Also, all authors agreed to be accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved. Mrs. D. Gayathri conceived the presented idea and designed the analysis. Also, she carried out the experiment and wrote the manuscript with support from Dr. R. PushpaLakshmi. All authors discussed the results and contributed to the final manuscript. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Conflict of interest
The authors declare no conflict of interest.
Ethical approval
Not Applicable.
Informed consent
Not Applicable.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Gayathri, D., PushpaLakshmi, R. Design and development of compressed video sensing technique using shuffled sailfish optimization algorithm. SIViP 18, 3537–3551 (2024). https://doi.org/10.1007/s11760-024-03019-1
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11760-024-03019-1