Skip to main content

Sample-Label View Transfer Active Learning for Time Series Classification

  • Conference paper
  • First Online:
Artificial Neural Networks and Machine Learning – ICANN 2021 (ICANN 2021)

Abstract

In many real-world applications, Time Series Data are captured over the course of time and exhibit temporal dependencies that cause two or otherwise identical points of time to belong to different classes or exhibit different characteristic. Although time series classification has attracted increasing attention in recent years, it remains a challenging task considering the nature of data dimensionality, voluminousness and continuous updates. Most of existing Deep Learning methods often depend on hand-crafted feature extraction techniques, that are expensive for real-world time series data mining applications which in addition, require expert knowledge. In practice, training a quality classifier is highly dependent on large number of labeled samples which is mostly inadequate in real-world time series datasets. In this paper, we present a novel Deep Learning approach for time series classification problems, called Transfer Active Learning (TAL) which jointly evaluates informativeness and representativeness of a candidate sample-label pair. TAL learns to map each input into a latent space from both sample and sample-label views which is more effective. For similar tasks, TAL is able to reuse model skill with further reduction on feature extraction costs. Extensive experiments on both classification datasets and real-world prediction tasks demonstrate the efficiency of the proposed approach on exponential reduction of training cost .

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    http://www.timeseriesclassification.com/.

  2. 2.

    https://www.kaggle.com/jsphyg/weather-dataset-rattle-package.

  3. 3.

    https://www.kaggle.com/usdot/flight-delays.

References

  1. Gikunda, P.K., Jouandeau, N.: State-of-the-art convolutional neural networks for smart farms: a review. In: Arai, K., Bhatia, R., Kapoor, S. (eds.) CompCom 2019. AISC, vol. 997, pp. 763–775. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-22871-2_53

    Chapter  Google Scholar 

  2. Szegedy, C., et al.: The inception architecture for computer vision. In: Conference on Computer Vision and Pattern Recognition (CCVPR 2016), pp. 2818–2826. IEEE (2016)

    Google Scholar 

  3. Krizhevsky, A., Sutskever, I., Hinton, G.E.: ImageNet classification with deep convolutional neural networks. Commun. ACM 60(6), 84–90 (2017)

    Article  Google Scholar 

  4. Torres, J.F., et al.: A deep learning for time series forecasting: a survey. Big Data 9(1), 3–21 (2021)

    Article  Google Scholar 

  5. Gavves, E., et al.: Active transfer learning with zero-shot priors: reusing past datasets for future tasks. In: International Conference on Computer Vision (ICCV 2015), pp. 2731–2739. IEEE (2015)

    Google Scholar 

  6. Raina, R., et al.: Self-taught learning: transfer learning from unlabeled data. In: International Conference on Machine Learning, pp. 759–766. ACM (2017)

    Google Scholar 

  7. Fu, Y., Zhu, X., Li, B.: A survey on instance selection for active learning. Knowl. Inf. Syst. 35, 49–283 (2013). https://doi.org/10.1007/s10115-012-0507-8

    Article  Google Scholar 

  8. Settles, B.: Active learning literature survey. Computer Sciences Technical Report 1648, University of Wisconsin-Madison, Madison (2009)

    Google Scholar 

  9. Li, X., Guo, Y.: Adaptive active learning for image classification. In: Conference on Computer Vision and Pattern Recognition (CCVPR 2013), pp. 859–866. IEEE (2013)

    Google Scholar 

  10. Lewis, D.D., Catlett, J.: Heterogeneous uncertainty sampling for supervised learning. In: Machine Learning Proceedings, pp. 148–156 (1994)

    Google Scholar 

  11. Langkvist, M., Karlsson, L., Loutfi, A.: A review of unsupervised feature learning and deep learning for time-series modeling. Pattern Recogn. Lett. 42, 11–24 (2014)

    Article  Google Scholar 

  12. Pascanu, R., Mikolov, T., Bengio, Y.: Understanding the exploding gradient problem. CoRR, abs/1211.5063, vol. 417 (2012)

    Google Scholar 

  13. Pascanu, R., Mikolov, T., Bengio, Y.: On the difficulty of training recurrent neural networks. In: International Conference on Machine Learning, pp. 1310–1318. ACM (2013)

    Google Scholar 

  14. Lewis, D.D., Gale, W.A.: A sequential algorithm for training text classifiers. In: Croft, B.W., van Rijsbergen, C.J. (eds.) SIGIR 1994, pp. 3–12. Springer, London (1994). https://doi.org/10.1007/978-1-4471-2099-5_1

  15. Settles, B., Craven, M.: An analysis of active learning strategies for sequence labeling tasks. In: Conference on Empirical Methods in Natural Language Processing, pp. 1070–1079 (2008)

    Google Scholar 

  16. Huang, S.J., Jin, R., Zhou, Z.H.: Active learning by querying informative and representative examples. IEEE Trans. Pattern Anal. Mach. Intell. 36(10), 1936–1949 (2014)

    Article  Google Scholar 

  17. Natarajan, A., Laftchiev, E.: A transfer active learning framework to predict thermal comfort. Int. J. Prognostics Health Manage. 10(3), 1–13 (2019)

    Google Scholar 

  18. Peng, F., Luo, Q., Ni, L.M.: ACTS: an active learning method for time series classification. In: International Conference on Data Engineering (ICDE 2017), pp. 175–178 (2017)

    Google Scholar 

  19. Gikunda, P.K., Jouandeau, N.: Cost-based budget active learning for deep learning. In: 9th European Starting AI Researchers’ Symposium co-located with 24th European Conference on Artificial Intelligence (ECAI 2020), vol. 2655 (2020)

    Google Scholar 

  20. Wang, Z., Yan, W., Oates, T.: May. time series classification from scratch with deep neural networks: a strong baseline. In: International Joint Conference on Neural Networks (IJCNN 2017), pp. 1578–1585 (2017)

    Google Scholar 

  21. Fawaz, H.I., et al.: Deep learning for time series classification: a review. Data Min. Knowl. Discov. 33(4), 917–963 (2019)

    Article  MathSciNet  Google Scholar 

  22. He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Conference on Computer Vision and Pattern Recognition (CVPR 2016), pp. 770–778 (2016)

    Google Scholar 

  23. Deng, Y., Chen, K., Shen, Y., Jin, H.: Adversarial active learning for sequences labeling and generation. In: International Joint Conference on Artificial Intelligence (IJCAI 2018), pp. 4012–4018 (2018). https://doi.org/10.24963/ijcai.2018/558

  24. Sener, O., Savarese, S.: Active learning for convolutional neural networks: a core-set approach. In: 6th International Conference on Learning Representations (ICLR 2018)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Patrick Kinyua .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Kinyua, P., Jouandeau, N. (2021). Sample-Label View Transfer Active Learning for Time Series Classification. In: Farkaš, I., Masulli, P., Otte, S., Wermter, S. (eds) Artificial Neural Networks and Machine Learning – ICANN 2021. ICANN 2021. Lecture Notes in Computer Science(), vol 12895. Springer, Cham. https://doi.org/10.1007/978-3-030-86383-8_48

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-86383-8_48

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-86382-1

  • Online ISBN: 978-3-030-86383-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics