Advertisement

Automatic Model Selection in Archetype Analysis

  • Sandhya Prabhakaran
  • Sudhir Raman
  • Julia E. Vogt
  • Volker Roth
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7476)

Abstract

Archetype analysis involves the identification of representative objects from amongst a set of multivariate data such that the data can be expressed as a convex combination of these representative objects. Existing methods for archetype analysis assume a fixed number of archetypes a priori. Multiple runs of these methods for different choices of archetypes are required for model selection. Not only is this computationally infeasible for larger datasets, in heavy-noise settings model selection becomes cumbersome. In this paper, we present a novel extension to these existing methods with the specific focus of relaxing the need to provide a fixed number of archetypes beforehand. Our fast iterative optimization algorithm is devised to automatically select the right model using BIC scores and can easily be scaled to noisy, large datasets. These benefits are achieved by introducing a Group-Lasso component popular for sparse linear regression. The usefulness of the approach is demonstrated through simulations and on a real world application of document analysis for identifying topics.

Keywords

Model Selection Convex Hull Bayesian Information Criterion Solution Path Inverse Document Frequency 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Bauckhage, C., Thurau, C.: Making Archetypal Analysis Practical. In: Denzler, J., Notni, G., Süße, H. (eds.) DAGM 2009. LNCS, vol. 5748, pp. 272–281. Springer, Heidelberg (2009)CrossRefGoogle Scholar
  2. 2.
    Chan, B.H.P., Mitchell, D.A., Cram, L.E.: Archetypal analysis of galaxy spectra. Monthly Notices of the Royal Astronomical Society 338(3), 790–795 (2003)CrossRefGoogle Scholar
  3. 3.
    Cutler, A., Breiman, L.: Archetypal analysis. Technometrics, 338–347 (1994)Google Scholar
  4. 4.
    Hastie, T., Taylor, J., Tibshirani, R., Walther, G.: Forward stagewise regression and the monotone Lasso. Electronic Journal of Statistics 1, 2007 (2006)Google Scholar
  5. 5.
    Huggins, P., Pachter, L., Sturmfels, B.: Toward the human genotope. Bulletin of Mathematical Biology 69, 2723–2735 (2007)MathSciNetzbMATHCrossRefGoogle Scholar
  6. 6.
    Lewis, D.D., Yang, Y., Rose, T.G., Li, F., Dietterich, G., Li, F.: RCV1: A new benchmark collection for text categorization research. Journal of Machine Learning Research 5, 361–397 (2004)Google Scholar
  7. 7.
    Morup, M., Hansen, L.K.: Archetypal analysis for machine learning and data mining. Neurocomputing 80, 54–63 (2012)CrossRefGoogle Scholar
  8. 8.
    Roth, V., Fischer, B.: The Group-Lasso for generalized linear models: uniqueness of solutions and efficient algorithms. In: ICML 2008, pp. 848–855. ACM (2008)Google Scholar
  9. 9.
    Skiena, S.S.: The Algorithm Design Manual. Springer, New York (1997)zbMATHGoogle Scholar
  10. 10.
    Xu, H., Caramanis, C., Sanghavi, S.: Robust PCA via outlier pursuit. In: Lafferty, J., Williams, C.K.I., Shawe-Taylor, J., Zemel, R.S., Culotta, A. (eds.) Advances in Neural Information Processing Systems 23, pp. 2496–2504 (2010)Google Scholar
  11. 11.
    Yuan, M., Lin, Y.: Model selection and estimation in regression with grouped variables. J. Roy. Stat. Soc. B, 49–67 (2006)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Sandhya Prabhakaran
    • 1
  • Sudhir Raman
    • 1
  • Julia E. Vogt
    • 1
  • Volker Roth
    • 1
  1. 1.Department of Mathematics and Computer ScienceUniversity of BaselBaselSwitzerland

Personalised recommendations