Skip to main content
SpringerLink
Log in

Video shot boundary detection using hybrid dual tree complex wavelet transform with Walsh Hadamard transform

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Shot boundary detection (SBD) is the initial process in the video analysis, indexing, summarization, and retrieval. Detection of correct transition from a video sequence and the feature extraction and their effectiveness of presenting the visual content of the video frames are the main factors in SBD. In this paper, the Hybrid Dual-Tree Complex Wavelet Transform with Walsh Hadamard transform (DTCWT-WHT) and the optimized Deep belief network (DBN) are proposed for the SBD. A new feature extraction technique is developed for extracting the feature vector from each block of the image frames. Preprocessing is the initial step to remove the illumination noise in the video frames. In preprocessing, the Fast Averaging Peer Group filter is designed, and the significant feature of this filter is the computational efficiency. After preprocessing, the distance of the adjacent frame is computed using HSV color histogram distance. Hybrid approach is proposed to extract feature and the edge boundaries from the frames, and the continuity signal is constructed. Then, the extracted features are fed to the DBN for the classification process. Social ski driver optimization algorithm (SSDOA) is utilized to update the weights of DBN. Finally, this proposed method detects the abrupt (cut) and gradual (fade in and fade out) transitions from the video frames. Four well-known datasets such as TRECVID 2016, 2017, 2018 and 2019 datasets are utilized to examine the proposed framework. The capability of proposed work is reinforced by performing the comparison with the recent techniques. The experimental outcomes showed the efficiency of the proposed framework by comparing with the existing techniques.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13

Similar content being viewed by others

References

  1. Abdulhussain SH, Mahmmod BM, Saripan MI, Al-Haddad SAR, Jassim WA (2019) Shot boundary detection based on orthogonal polynomial. Multimed Tools Appl 78(14):20361–20382

    Article  Google Scholar 

  2. Asha D, Latha YM (2019) Content-based video shot boundary detection using multiple Haar transform features. In: Soft computing and signal processing. Springer, Singapore, pp 703–713

    Chapter  Google Scholar 

  3. Bhaumik H, Bhattacharyya S, Chakraborty S (2019) A vague set approach for identifying shot transition in videos using multiple feature amalgamation. Appl Soft Comput 75:633–651

    Article  Google Scholar 

  4. Bi C, Yuan Y, Zhang J, Shi Y, Xiang Y, Wang Y, Zhang R (2018) Dynamic mode decomposition based video shot detection. IEEE Access 6:21397–21407

    Article  Google Scholar 

  5. Chakraborty S, Thounaojam DM (2019) A novel shot boundary detection system using hybrid optimization technique. Appl Intell 49(9):3207–3220

    Article  Google Scholar 

  6. Chakraborty S, Thounaojam DM (2020) SBD-duo: a dual stage shot boundary detection technique robust to motion and illumination effect. Multimed Tools Appl 80(2):3071–3087

  7. Chen Y, Shi L, Feng Q, Yang J, Shu H, Luo L, Coatrieux JL, Chen W (2014) Artifact suppressed dictionary learning for low-dose CT image processing. IEEE Trans Med Imaging 33(12):2271–2292

    Article  Google Scholar 

  8. Fan J, Zhou S, Siddique MA (2017) Fuzzy color distribution chart-based shot boundary detection. Multimed Tools Appl 76(7):10169–10190

    Article  Google Scholar 

  9. Gygli M (2018) Ridiculously fast shot boundary detection with fully convolutional neural networks. In 2018 International Conference on Content-Based Multimedia Indexing (CBMI), pp. 1–4. IEEE.

  10. Hannane R, Elboushaki A, Afdel K, Naghabhushan P, Javed M (2016) An efficient method for video shot boundary detection and keyframe extraction using SIFT-point distribution histogram. Int J Multimed Inf Retr 5(2):89–104

    Article  Google Scholar 

  11. Kar T, Kanungo P (2017) A motion and illumination resilient framework for automatic shot boundary detection. SIViP 11(7):1237–1244

    Article  Google Scholar 

  12. Kumar GN, Reddy VSK, Kumar SS (2018) Video shot boundary detection and key frame extraction for video retrieval. In Proceedings of the Second International Conference on Computational Intelligence and Informatics, Springer, Singapore, 557–567.

  13. Kumar R, Ray S, Sharma M, Kumar B (2020) Abrupt scene change detection using spatiotemporal regularity of video cube. In: Advances in VLSI, communication, and signal processing. Springer, Singapore, pp 991–1002

    Chapter  Google Scholar 

  14. Li Y, Xia R, Huang Q, Xie W, Li X (2017) Survey of spatio-temporal interest point detection algorithms in video. IEEE Access 5:10323–10331

    Article  Google Scholar 

  15. Liang R, Zhu Q, Wei H, Liao S (2017) A video shot boundary detection approach based on CNN feature. In 2017 IEEE International Symposium on Multimedia (ISM) 489-494.

  16. Liu F, Wan Y (2015) Improving the video shot boundary detection using the HSV color space and image subsampling. In 2015 seventh international conference on advanced computational intelligence (ICACI), IEEE, 351-354.

  17. Malinski L, Smolka B (2016) Fast averaging peer group filter for the impulsive noise removal in color images. J Real-Time Image Proc 11(3):427–444

    Article  Google Scholar 

  18. Mondal J, Kundu MK, Das S, Chowdhury M (2018) Video shot boundary detection using multiscale geometric analysis of nsct and least squares support vector machine. Multimed Tools Appl 77(7):8139–8161

    Article  Google Scholar 

  19. Parmar M, Angelides MC (2015) MAC-REALM: a video content feature extraction and modelling framework. Comput J 58(9):2135–2171

    Article  Google Scholar 

  20. Prabavathy AK, Shree JD (2019) Histogram difference with fuzzy rule base modeling for gradual shot boundary detection in video cloud applications. Clust Comput 22(1):1211–1218

    Google Scholar 

  21. Prathiba T, Kumari RSS (2021) Eagle eye CBVR based on unique key frame extraction and deep belief neural network. Wirel Pers Commun 116(1):411–441

    Article  Google Scholar 

  22. Rashmi BS, Nagendraswamy HS (2020) Video shot boundary detection using block based cumulative approach. Multimed Tools Appl 80(1):641–664

  23. Sasithradevi A, Roomi SMM (2020) A new pyramidal opponent color-shape model based video shot boundary detection. J Vis Commun Image Represent 67:102754

    Article  Google Scholar 

  24. Singh A, Thounaojam DM, Chakraborty S (2019) A novel automatic shot boundary detection algorithm: robust to illumination and motion effect. SIViP 1–9

  25. Tharwat A, Gabel T (2019) Parameters optimization of support vector machines for imbalanced data using social ski driver algorithm. Neural Comput Applic 32(11):6925–6938

  26. Thounaojam DM, Khelchandra T, Singh K, Roy S (2016) A genetic algorithm and fuzzy logic approach for video shot boundary detection. Comput Intell Neurosci 2016:1–11

    Article  Google Scholar 

  27. Tippaya S, Sitjongsataporn S, Tan T, Khan MM, Chamnongthai K (2017) Multi-modal visual features-based video shot boundary detection. IEEE Access 5:12563–12575

    Article  Google Scholar 

  28. Wu L, Zhang S, Jian M, Lu Z, Wang D (2019) Two stage shot boundary detection via feature fusion and spatial-temporal convolutional neural networks. IEEE Access 7:77268–77276

    Article  Google Scholar 

  29. Xu J, Song L, Xie R (2016) Shot boundary detection using convolutional neural networks. In 2016 visual communications and image processing (VCIP), IEEE, 1–4.

  30. Yang SH, Lin YN, Chiou GJ, Chen MK, Shen VR, Tseng HY (2019) Novel shot boundary detection in news streams based on fuzzy petri nets. Appl Artif Intell 33(12):1035–1057

    Article  Google Scholar 

  31. Youssef B, Fedwa E, Driss A, Ahmed S (2017) Shot boundary detection via adaptive low rank and svd-updating. Comput Vis Image Underst 161:20–28

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Electronics and Telecommunication, G H Raisoni Institute of Engineering and Technology, Nagpur, India

    Ravi Mishra

Authors
  1. Ravi Mishra
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ravi Mishra.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Mishra, R. Video shot boundary detection using hybrid dual tree complex wavelet transform with Walsh Hadamard transform. Multimed Tools Appl 80, 28109–28135 (2021). https://doi.org/10.1007/s11042-021-11052-2

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-021-11052-2

Keywords

Search

Navigation