Data Mining and Knowledge Discovery

, Volume 25, Issue 2, pp 298–324

Tensor factorization using auxiliary information


  • Atsuhiro Narita
    • Department of Mathematical InformaticsThe University of Tokyo
  • Kohei Hayashi
    • Department of Mathematical InformaticsThe University of Tokyo
  • Ryota Tomioka
    • Department of Mathematical InformaticsThe University of Tokyo
    • Department of Mathematical InformaticsThe University of Tokyo
    • Basic Research Programs PRESTOSynthesis of Knowledge for Information Oriented Society
Open AccessArticle

DOI: 10.1007/s10618-012-0280-z

Cite this article as:
Narita, A., Hayashi, K., Tomioka, R. et al. Data Min Knowl Disc (2012) 25: 298. doi:10.1007/s10618-012-0280-z


Most of the existing analysis methods for tensors (or multi-way arrays) only assume that tensors to be completed are of low rank. However, for example, when they are applied to tensor completion problems, their prediction accuracy tends to be significantly worse when only a limited number of entries are observed. In this paper, we propose to use relationships among data as auxiliary information in addition to the low-rank assumption to improve the quality of tensor decomposition. We introduce two regularization approaches using graph Laplacians induced from the relationships, one for moderately sparse cases and the other for extremely sparse cases. We also give present two kinds of iterative algorithms for approximate solutions: one based on an EM-like algorithms which is stable but not so scalable, and the other based on gradient-based optimization which is applicable to large scale datasets. Numerical experiments on tensor completion using synthetic and benchmark datasets show that the use of auxiliary information improves completion accuracy over the existing methods based only on the low-rank assumption, especially when observations are sparse.


Tensors Multi-way arrays CP-decomposition Tucker decomposition Side information

Copyright information

© The Author(s) 2012