Video Tampering Detection for Decentralized Video Transcoding Networks

Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 12131)


This paper introduces a complete methodology based on Machine Learning and Computer Vision techniques for the verification of video transcoding computations in decentralized networks, particularly the Open Source project Livepeer. A base video dataset is presented, with over 180k samples transcoded using the x264 codec. As a novelty, we propose a set of four features computed as a full reference comparison between the source and the rendered videos. Using these features, a One Class Support Vector Machine is trained to identify good encodings with a high accuracy. Experimental results are presented and the particular constraints of this use case are explained.


Decentralized networks Novelty detection Computer vision feature extraction 


  1. 1.
    Aggarwal, R.D.S.N.: Video content authentication techniques: a comprehensive survey. Multimedia Syst. 24(2), 211–240 (2017).
  2. 2.
    Aiyer, A.S., Alvisi, L., Clement, A., Dahlin, M., Martin, J.P., Porth, C.: BAR fault tolerance for cooperative services. ACM SIGOPS Oper. Syst. Rev. 39(5), 45 (2005).
  3. 3.
    Bampis, C.G., Bovik, A.C.: Feature-based prediction of streaming video QoE: distortions stalling and memory. Sig. Process.: Image Commun. 68, 218–228 (2018).
  4. 4.
    Crowcroft, J., Moreton, T.D., Pratt, I., Twigg, A.: Peer-to-peer systems and the grid. In: The Grid 2e: Blueprint for a New Computing Infrastructure. University of Cambridge Computer Laboratory (2003)Google Scholar
  5. 5.
    Duanmu, Z., Rehman, A., Wang, Z.: A quality-of-experience database for adaptive video streaming. IEEE Trans. Broadcast. 64(2), 474–487 (2018).
  6. 6.
    Farid, H.: Image forgery detection [a survey]. IEEE Sig. Process. Mag. 26, 2 (2009). Accessed 27 Dec 2019
  7. 7.
    Fedak, G., He, H., Moca, M., Bendella, W., Alves, E.: Blockchain-based decentralized cloud computing. Technical report, iExec (2018). Accessed 27 Dec 2019
  8. 8.
    Google: Choose live encoder settings, bitrates, and resolutions (2020).
  9. 9.
    Hammad, R.A.M.: Image quality and forgery detection copula-based algorithms. Ph.D. thesis, Cairo University (2008).
  10. 10.
    Milani, S., et al.: An overview on video forensics. APSIPA Trans. Sig. Inf. Process. 1, e2 (2012). Scholar
  11. 11.
    Nielson, S.J., Crosby, S.A., Wallach, D.S.: A taxonomy of rational attacks. In: Castro, M., van Renesse, R. (eds.) IPTPS 2005. LNCS, vol. 3640, pp. 36–46. Springer, Heidelberg (2005). Scholar
  12. 12.
    Petkanics, D., Tang, E.: Livepeer white paper. Technical report, Livepeer (2018). Accessed 27 Dec 2019
  13. 13.
    Pinson, M.H.: The consumer digital video library [best of the web]. IEEE Sig. Process. Mag. 30(4), 172–174 (2013).
  14. 14.
    Rao, K., Yip, P.: Chapter 1 - discrete cosine transform. In: Rao, K., Yip, P. (eds.) Discrete Cosine Transform, pp. 1–6. Academic Press, San Diego (1990).
  15. 15.
    Schölkopf, B., Williamson, R., Smola, A., Shawe-Taylor, J., Platt, J.: Support vector method for novelty detection. In: Proceedings of the 12th International Conference on Neural Information Processing, NIPS 1999, vol. 12, pp. 582–588 (1999)Google Scholar
  16. 16.
    Smith, A.R.: Color gamut transform pairs. ACM SIGGRAPH Comput. Graph. 12(3), 12–19 (1978).
  17. 17.
    Teutsch, J., Reitwießner, C.: A scalable verification solution for blockchains. ArXiv abs/1908.04756 (2019)Google Scholar
  18. 18.
    Timmerer, C., Smole, M., Mueller, C.: Efficient multi-codec support for OTT services: HEVC/h.265 and/or AV1? In: 2018 NAB BEIT Proceedings, p. 5. National Association of Broadcasters (NAB), Washington DC, USA, April 2018Google Scholar
  19. 19.
    Van der Walt, S., et al.: scikit-image: image processing in python. PeerJ 2, e453 (2014)CrossRefGoogle Scholar
  20. 20.
    Wang, H., et al.: Videoset: a large-scale compressed video quality dataset based on JND measurement. J. Vis. Commun. Image Represent. 46, 292–302 (2017).,
  21. 21.
    Wang, Y., Inguva, S., Adsumilli, B.: YouTube UGC dataset for video compression research. In: 2019 IEEE 21st International Workshop on Multimedia Signal Processing (MMSP). IEEE, September 2019.

Copyright information

© Springer Nature Switzerland AG 2020

Authors and Affiliations

  1. 1.HaivisionMontrealCanada
  2. 2.LivepeerNew YorkUSA

Personalised recommendations