A New Algorithm for Multimodal Soft Coupling

Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10169)


In this paper, the problem of multimodal soft coupling under the Bayesian framework when variance of probabilistic model is unknown is investigated. Similarity of shared factors resulted from Nonnegative Matrix Factorization (NMF) of multimodal data sets is controlled in a soft manner by using a probabilistic model. In previous works, it is supposed that the probabilistic model and its parameters are known. However, this assumption does not always hold. In this paper it is supposed that the probabilistic model is already known but its variance is unknown. So the proposed algorithm estimates the variance of the probabilistic model along with the other parameters during the factorization procedure. Simulation results with synthetic data confirm the effectiveness of the proposed algorithm.


Nonnegative matrix factorization Bayesian framework Soft coupling 


  1. 1.
    Lahat, D., Adalı, T., Jutten, C.: Challenges in multimodal data fusion. In: 2014 22nd European Signal Processing Conference (EUSIPCO), pp. 101–105 September 2014Google Scholar
  2. 2.
    Acar, E., Kolda, T.G., Dunlavy, D.M.: All-at-once optimization for coupled matrix and tensor factorizations. arXiv preprint arXiv:1105.3422 (2011)
  3. 3.
    Acar, E., Rasmussen, M.A., Savorani, F., Næs, T., Bro, R.: Understanding data fusion within the framework of coupled matrix and tensor factorizations. Chemometr. Intell. Lab. Syst. 129, 53–63 (2013)CrossRefGoogle Scholar
  4. 4.
    Seichepine, N., Essid, S., Févotte, C., Cappé, O.: Soft nonnegative matrix co-factorization. IEEE Trans. Signal Process. 62(22), 5940–5949 (2014)MathSciNetCrossRefGoogle Scholar
  5. 5.
    Rivet, B., Duda, M., Guérin-Dugué, A., Jutten, C., Comon, P.: Multimodal approach to estimate the ocular movements during EEG recordings: a coupled tensor factorization method. In: 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), pp. 6983–6986 (2015)Google Scholar
  6. 6.
    Lee, D.D., Seung, H.S.: Algorithms for non-negative matrix factorization. In: Advances in Neural Information Processing Systems, pp. 556–562 (2001)Google Scholar
  7. 7.
    Farias, R.C., Cohen, J.E., Comon, P.: Exploring multimodal data fusion through joint decompositions with flexible couplings. IEEE Trans. Signal Process. 64(18), 4830–4844 (2016)MathSciNetCrossRefGoogle Scholar
  8. 8.
    Ozerov, A., Févotte, C.: Multichannel nonnegative matrix factorization in convolutive mixtures for audio source separation. IEEE Trans. Audio Speech Lang. Process. 18(3), 550–563 (2010)CrossRefGoogle Scholar
  9. 9.
    Seichepine, N., Essid, S., Févotte, C., Cappé, O.: Soft nonnegative matrix co-factorizationwith application to multimodal speaker diarization. In: 2013 IEEE International Conference on Acoustics, Speech and Signal Processing, pp. 3537–3541, May 2013Google Scholar
  10. 10.
    Sawada, H., Kameoka, H., Araki, S., Ueda, N.: Multichannel extensions of nonnegative matrix factorization with complex-valued data. IEEE Trans. Audio Speech Lang. Process. 21(5), 971–982 (2013)CrossRefGoogle Scholar
  11. 11.
    Févotte, C., Bertin, N., Durrieu, J.L.: Nonnegative matrix factorization with the itakura-saito divergence: with application to music analysis. Neural Comput. 21(3), 793–830 (2009)CrossRefzbMATHGoogle Scholar
  12. 12.
    Févotte, C.: Majorization-minimization algorithm for smooth itakura-saito nonnegative matrix factorization. In: 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 1980–1983, May 2011Google Scholar

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  1. 1.Department of Electrical EngineeringSharif University of TechnologyTehranIran
  2. 2.GIPSA-lab, CNRS, Univ. Grenoble Alpes, Grenoble INPGrenobleFrance

Personalised recommendations