Skip to main content
SpringerLink
Log in

STKVS: secure technique for keyframes-based video summarization model

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Video security has emerged as an essential study inultimedia security in recent years because videos are the most effective and widely used multimedia format and immediately establish a connection with users. It is necessary to prevent sensitive information from being stolen or destroyed in various domains, including the military, finance, and education. The proposed STKVS framework ensures the summarized video’s security in secret keyframes (SK) rather than securing the whole video to reduce the computation, complexity, and processing needs and recover lossless SK. STKVS framework consists of a secure keyframes-based generic Video Summarization (VS) model to generate a secure video summary. It extracts SK from the video using the proposed Probability-Based VS (PBVS). Then, it utilizes the proposed BEMSS (Blockwise Encryption-based Multi Secret Sharing) scheme to provide multi-secret image sharing to the SK. The proposed model PBVS achieved an average F-score of 0.73 and 0.76 on two benchmark (OV and YT) datasets, respectively, showing its effectiveness in producing informative video summaries. Additionally, BEMSS outperforms the other related security models.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Algorithm 1
Fig. 4
Fig. 5
Algorithm 2
Algorithm 3
Algorithm 4
Algorithm 5
Algorithm 6
Algorithm 7
Algorithm 8
Algorithm 9
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13

Similar content being viewed by others

Availability of supporting data

NA

References

  1. Sajitha AS, Shobha Rekh A (2022) Review on various image encryption schemes. Mater Today Proc 58:529–534

    Article  Google Scholar 

  2. Saini P, Kumar K, Kashid S et al (2023) Video summarization using deep learning techniques: a detailed analysis and investigation. Artif Intell Rev

  3. Kumar K, Shrimankar DD, Singh N (2018) Eratosthenes sieve based keyframe extraction technique for event summarization in videos. Multimed Tools Appl 77(6):7383–7404

    Article  Google Scholar 

  4. Kumar K, Shrimankar DD, Singh N (2016) Equal partition based clustering approach for event summarization in videos. In: 2016 12th International conference on Signal-Image Technology & Internet-Based Systems (SITIS). IEEE, pp 119–126

  5. Negi A, Kumar K, Saini P (2023) Object of interest and unsupervised learning-based framework for an effective video summarization using deep learning. IETE J Res 1–12

  6. Negi A, Kumar K, Chauhan P, Saini P, Kashid S (2022) Resource utilization tracking for fine-tuning based event detection and summarization over cloud. International Conference on Deep Learning. Artificial Intelligence and Robotics. Springer International Publishing, Cham, pp 73–83

    Google Scholar 

  7. Negi A, Kumar K, Saini P, Kashid S (2022) Object detection based approach for an efficient video summarization with system statistics over cloud. In: 2022 IEEE 9th Uttar Pradesh Section International Conference on Electrical, Electronics and Computer Engineering (UPCON). IEEE, pp 1–6

  8. Chattopadhyay AK et al (2021) A verifiable multi-secret image sharing scheme using XOR operation and hash function. Multimed Tools Appl 80(28):35051–35080

    Article  Google Scholar 

  9. Shamir A (1979) How to share a secret. Commun ACM 22:612–613

    Article  MathSciNet  Google Scholar 

  10. Blakley G (1979) Safeguarding cryptographic keys. In: Proc. AFIPS 1979 Natl. Conf., New York, pp 313–317

  11. Gutub A, Al-Ghamdi M (2020) Hiding shares by multimedia image steganography for optimized counting-based secret sharing. Multimed Tools Appl 79(11):7951–7985

    Article  Google Scholar 

  12. Naor M, Shamir A (1994) Visual cryptography. Workshop on the Theory and Application of of Cryptographic Techniques, Springer, Berlin, Heidelberg

    Google Scholar 

  13. Yan X et al (2020) Reversible image secret sharing. IEEE Trans Infor Forens Sec 15:3848–3858

    Google Scholar 

  14. Shankar K, Elhoseny M, Kumar RS, Lakshmanaprabu SK, Yuan X (2020) Secret image sharing scheme with encrypted shadow images using optimal homomorphic encryption technique. J Amb Intell Hum Comput 11(5):1821–1833

    Article  Google Scholar 

  15. Ye G, Pan C, Dong Y, Jiao K, Huang X (2021) A novel multi-image visually meaningful encryption algorithm based on compressive sensing and Schur decomposition. Trans Emerg Telecom Technol 32(2):e4071

  16. Kannojia SP, Kumar J (2021) XOR-based visual secret sharing scheme using pixel vectorization. Multimed Tools Appl 80(10):14609–14635

    Article  Google Scholar 

  17. Bhowmik A, Karforma S (2022) An approach of secret sharing technique based on convolution neural network and DNA sequence for data security in wireless communication. Wirel Personal Commun 1–32

  18. Naskar PK, Bhattacharyya S, Mahatab KC, Dhal KG, Chaudhuri A (2021) An efficient block-level image encryption scheme based on multi-chaotic maps with DNA encoding. Nonlinear Dynam 105(4):3673–3698

    Article  Google Scholar 

  19. Tiwari V, Bhatnagar C (2021) A survey of recent work on video summarization: approaches and techniques. Multimed Tools Appl 80(1)8:27187-27221

  20. Sharma S, Kumar K (2018) GUESS: genetic uses in video encryption with secret sharing. In: Proceedings of 2nd international conference on computer vision and image processing. Springer, Singapore, pp 51-62

  21. Ajmal M, Ashraf MH, Shakir M, Abbas Y, Shah FA (2012) Video summarization: techniques and classification. International conference on computer vision and graphics. Springer, Berlin, Heidelberg, pp 1–13

    Google Scholar 

  22. Apostolidis E, Adamantidou E, Metsai AI, Mezaris V, Patras I (2021) Video summarization using deep neural networks: a survey. Proc IEEE 109(11):1838–1863

    Article  Google Scholar 

  23. Basavarajaiah M, Sharma P (2021) GVSUM: generic video summarization using deep visual features. Multimed Tools Appl 80:14459–14476. https://doi.org/10.1007/s11042-020-10460-0

    Article  Google Scholar 

  24. Muhammad K, Hussain T, Baik SW (2020) Efficient CNN based summarization of surveillance videos for resource-constrained devices. Pattern Recognit Lett 130:370–375

    Article  Google Scholar 

  25. Nair MS, Mohan J (2021) Static video summarization using multi-CNN with sparse autoencoder and random forest classifier. SIViP 15:735–742. https://doi.org/10.1007/s11760-020-01791-4

    Article  Google Scholar 

  26. Zhao H, Wang W-J, Wang T, Chang Z-B, Zeng X-Y (2019) Keyframe extraction based on HSV histogram and adaptive clustering. Math Prob Eng 2019

  27. Mahasseni B, Lam B, Todorovic S (2017) Unsupervised video summarization with adversarial LSTM networks. In: Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Honolulu, HI, USA, vol. 1. pp 2982–2991

  28. Asim M, Almaadeed N, Al-Máadeed S, Bouridane A, Beghdadi A (2018) A key frame based video summarization using color features. In: 2018 Colour and Visual Computing Symposium (CVCS). IEEE, pp 1–6

  29. Muhammad K, Hussain T, Tanveer M, Sannino G, de Albuquerque VHC (2019) Cost-effective video summarization using deep CNN with hierarchical weighted fusion for IoT surveillance networks. IEEE Internet Things J 7(5):4455–4463

    Article  Google Scholar 

  30. Muhammad K et al (2019) DeepReS: a deep learning- based video summarization strategy for resource- constrained industrial surveillance scenarios. IEEE Trans Indus Inf 16.9:5938–5947

    Google Scholar 

  31. Khurana K, Deshpande U (2023) Two stream multi-layer convolutional network for keyframe-based video summarization. Multimed Tools Appl 1–42

  32. Archana N, Malmurugan N (2020) Multi-edge optimized LSTM RNN for video summarization. J Ambient Intell Humaniz Comput. https://doi.org/10.1007/s12652-020-02025-8

  33. Fei M, Jiang W, Mao W (2017) Memorable and rich video summarization. J Vis Commun Image Repr 42:207–217

    Article  Google Scholar 

  34. John Blesswin A, Selva Mary G, Manoj Kumar S (2022) Multiple secret image communication using visual cryptography. Wireless Pers Commun 122(4):3085–3103

    Article  Google Scholar 

  35. Agarwal A, Deshmukh M, Singh M (2020) Object detection framework to generate secret shares. Multimed Tools Appl 79(33):24685–24706

    Article  Google Scholar 

  36. Khan M, Masood F, Alghafis A, Amin M, Batool Naqvi SI (2019) A novel image encryption technique using hybrid method of discrete dynamical chaotic maps and Brownian motion. PLoS ONE 14(12):e0225031

    Article  Google Scholar 

  37. Saini P, Kumar K, Kashid S, Negi A (2022) MEVSS: modulo encryption based visual secret sharing scheme for securing visual content. International conference on deep learning, artificial intelligence and robotics. Springer International Publishing, Cham, pp 24–35

    Google Scholar 

  38. Elkandoz MT, Alexan W (2022) Image encryption based on a combination of multiple chaotic maps. Multimed Tools Appl 1–22

  39. Koppanati RK, Kumar K, Qamar S (2019) E-MOC: an efficient secret sharing model for multimedia on cloud. In: International conference on deep learning, artificial intelligence and robotics. Springer, Cham, pp 246–260

  40. Chen C-C, Wu W-J, Chen J-L (2016) Highly efficient and secure multi-secret image sharing scheme. Multimed Tools Appl 75(12):7113–7128

    Article  Google Scholar 

  41. Deshmukh M, Nain N, Ahmed M (2017) A novel approach for sharing multiple color images by employing Chinese Remainder Theorem. J Vis Commun Image Represent 49:291–302

    Article  Google Scholar 

  42. Bisht K, Deshmukh M (2021) A novel approach for multilevel multi-secret image sharing scheme. J Supercomput 77(10):12157–12191

    Article  Google Scholar 

  43. Bhat K, Kumar U, Reddy KR, Kumar HSR, Mahto D (2021) A novel scheme for lossless authenticated multiple secret images sharing using polynomials and extended visual cryptography. IET Inf Sec 15(1):13–22

    Article  Google Scholar 

  44. Sun Y, Lu Y, Yan X, Liu L, Li L (2021) Robust secret image sharing scheme against noise in shadow images. IEEE Access 9:23284–23300

    Article  Google Scholar 

  45. Yadav M, Singh R (2022) Essential secret image sharing approach with same size of meaningful shares. Multimed Tools Appl 81(16):22677–22694

    Article  Google Scholar 

  46. Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. arXiv:1409.1556

  47. Deng J, Dong W, Socher R, Li LJ, Li K, Fei-Fei L (2009) Imagenet: a large-scale hierarchical image database. In: IEEE Conference on computer vision and pattern recognition, 2009. CVPR 2009. IEEE, pp 248–255

  48. Otani M, Nakashima Y, Rahtu E, Heikkila J (2019) Rethinking the evaluation of video summaries. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. pp 7596–7604

  49. De Avila SEF, Lopes APB, da Luz Jr A, de Albuquerque Araújo A (2011) VSUMM: a mechanism designed to produce static video summaries and a novel evaluation method. Pattern Recognit Lett 32(1):56–68

  50. Mundur P, Rao Y, Yesha Y (2006) Keyframe-based video summarization using delaunay clustering. Int J Digit Libr 6(2):219–232

    Article  Google Scholar 

  51. Furini M, Geraci F, Montangero M, Pellegrini M (2010) STIMO: STIll and MOving video storyboard for the web scenario. Multimed Tools Appl 46(1):47–69

    Article  Google Scholar 

  52. DeMenthon D, Kobla V, Doermann D (1998) Video summarization by curve simplification. In: Proceedings of the sixth ACM international conference on multimedia. pp 211–218

  53. Jin H, Yu Y, Li Y, Xiao Z (2022) Network video summarization based on key frame extraction via superpixel segmentation. Trans Emerg Telecomm Technol 33(6):e3940

    Article  Google Scholar 

  54. Wang D, Zhang L, Ma N, Li X (2007) Two secret sharing schemes based on Boolean operations. Pattern Recogn 40(10):2776–2785

    Article  Google Scholar 

  55. Feng J-B, Wu H-C, Tsai C-S, Chang Y-F, Chu Y-P (2008) Visual secret sharing for multiple secrets. Pattern Recogn 41(12):3572–3581

    Article  Google Scholar 

  56. Faraoun KM (2017) Design of a new efficient and secure multi-secret images sharing scheme. Multimed Tools Appl 76(5):6247–6261

    Article  Google Scholar 

  57. Kashid S, Kumar K, Saini P, Negi A, Saini A (2022) Approach of a multilevel secret sharing scheme for extracted text data. In: 2022 IEEE Students Conference on Engineering and Systems (SCES). IEEE, pp 1–5

  58. Kashid S, Awasthi LK, Kumar K, Saini P (2023) NS4: a novel security approach for extracted video keyframes using secret sharing scheme. In: 2023 International Conference on Computer, Electronics & Electrical Engineering & their Applications (IC2E3). IEEE, pp 1–6

Download references

Acknowledgements

The authors thank the DST GoI for sponsoring this work under DST/ICPS/General/2018.

Author information

Author notes

  1. Krishan Berwal, Shamal Kashid and Alok Negi contributed equally to this work.

Authors and Affiliations

  1. Department of Computer Science Engineering, NIT Uttarakhand, Srinagar, Uttarakhand, India

    Parul Saini & Shamal Kashid

  2. Military College of Telecommunication Engineering, Dr. Ambedkar Nagar, India

    Krishan Berwal

  3. UPES University, Dehradun, India

    Alok Negi

Authors
  1. Parul Saini
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Krishan Berwal
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Shamal Kashid
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Alok Negi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Parul Saini.

Ethics declarations

Conflicts of interest

None

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Saini, P., Berwal, K., Kashid, S. et al. STKVS: secure technique for keyframes-based video summarization model. Multimed Tools Appl (2024). https://doi.org/10.1007/s11042-024-18909-2

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s11042-024-18909-2

Keywords

Search

Navigation