Advertisement

A Hybrid Approach to Time Series Classification with Shapelets

  • David Guijo-RubioEmail author
  • Pedro A. Gutiérrez
  • Romain Tavenard
  • Anthony Bagnall
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11871)

Abstract

Shapelets are phase independent subseries that can be used to discriminate between time series. Shapelets have proved to be very effective primitives for time series classification. The two most prominent shapelet based classification algorithms are the shapelet transform (ST) and learned shapelets (LS). One significant difference between these approaches is that ST is data driven, whereas LS searches the entire shapelet space through stochastic gradient descent. The weakness of the former is that full enumeration of possible shapelets is very time consuming. The problem with the latter is that it is very dependent on the initialisation of the shapelets. We propose hybridising the two approaches through a pipeline that includes a time constrained data driven shapelet search which is then passed to a neural network architecture of learned shapelets for tuning. The tuned shapelets are extracted and formed into a transform, which is then classified with a rotation forest. We show that this hybrid approach is significantly better than either approach in isolation, and that the resulting classifier is not significantly worse than a full shapelet search.

Keywords

Time series classification Shapelets Convolutional neural networks 

Notes

Acknowledgement

This research has been partially supported by the Ministerio de Economía, Industria y Competitividad of Spain (Grant Refs. TIN2017-85887-C2-1-P and TIN2017-90567-REDT) as well as Agence Nationale de la Recherche through MATS project (ANR-18-CE23-0006). D. Guijo-Rubio’s research has been supported by the FPU Predoctoral and Short Placements Programs from Ministerio de Educación y Ciencia of Spain (Grants Ref. FPU16/02128 and EST18/00280, respectively). Some experiments used a Titan X Pascal donated by the NVIDIA Corporation.

References

  1. 1.
    Ye, L., Keogh, E.: Time series shapelets: a novel technique that allows accurate, interpretable and fast classification. Data Min. Knowl. Disc. 22(1–2), 149–182 (2011)MathSciNetCrossRefGoogle Scholar
  2. 2.
    Bagnall, A., Lines, J., Bostrom, A., Large, J., Keogh, E.: The great time series classification bake off: a review and experimental evaluation of recent algorithmic advances. Data Min. Knowl. Disc. 31(3), 606–660 (2017)MathSciNetCrossRefGoogle Scholar
  3. 3.
    Mueen, A., Keogh, E., Young, N.: Logical-shapelets: an expressive primitive for time series classification. In: Proceedings of the 17th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (2011)Google Scholar
  4. 4.
    Lines, J., Davis, L., Hills, J., Bagnall, A.: A shapelet transform for time series classification. In: Proceedings of the 18th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (2012)Google Scholar
  5. 5.
    Bostrom, A., Bagnall, A.: Binary shapelet transform for multiclass time series classification. Trans. Large-Scale Data Knowl. Cent. Syst. 32, 24–46 (2017)Google Scholar
  6. 6.
    Grabocka, J., Schilling, N., Wistuba, M., Schmidt-Thieme, L.: Learning time-series shapelets. In: Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (2014)Google Scholar
  7. 7.
    Tavenard, R.: tslearn: a machine learning toolkit dedicated to time-series data (2017). https://github.com/rtavenar/tslearn
  8. 8.
    Dau, H., et al.: The UCR time series archive. arXiv e-prints arXiv:1810.07758 (2018)
  9. 9.
    Lines, J., Taylor, S., Bagnall, A.: Time series classification with HIVE-COTE: the hierarchical vote collective of transformation-based ensembles. ACM Trans. Knowl. Discov. Data 12(5), 1–35 (2018) CrossRefGoogle Scholar
  10. 10.
    Hills, J., Lines, J., Baranauskas, E., Mapp, J., Bagnall, A.: Classification of time series by shapelet transformation. Data Min. Knowl. Disc. 28(4), 851–881 (2014)MathSciNetCrossRefGoogle Scholar
  11. 11.
    Rodriguez, J., Kuncheva, L., Alonso, C.: Rotation forest: a new classifier ensemble method. IEEE Trans. Pattern Anal. Mach. Intell. 28(10), 1619–1630 (2006)CrossRefGoogle Scholar
  12. 12.
    Bagnall, A., Bostrom, A., Cawley, G., Flynn, M., Large, J., Lines, J.: Is rotation forest the best classifier for problems with continuous features? arxiv e-prints arXiv:1809.06705 (2018)
  13. 13.
    Duchi, J., Hazan, E., Singer, Y.: Adaptive subgradient methods for online learning and stochastic optimization. J. Mach. Learn. Res. 12(July), 2121–2159 (2011)MathSciNetzbMATHGoogle Scholar
  14. 14.
    Demšar, J.: Statistical comparisons of classifiers over multiple data sets. J. Mach. Learn. Res. 7, 1–30 (2006)MathSciNetzbMATHGoogle Scholar
  15. 15.
    UEA TSC: A weka compatible toolkit for time series classification and clustering (2019). https://github.com/TonyBagnall/uea-tsc
  16. 16.
    sktime: A toolbox for data science with time series (2019). https://github.com/alan-turing-institute/sktime

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  • David Guijo-Rubio
    • 1
    • 2
    Email author
  • Pedro A. Gutiérrez
    • 1
  • Romain Tavenard
    • 3
  • Anthony Bagnall
    • 2
  1. 1.Department of Computer SciencesUniversidad de CórdobaCórdobaSpain
  2. 2.University of East AngliaNorwichUK
  3. 3.Univ. Rennes, CNRS, LETG/IRISARennesFrance

Personalised recommendations