Abstract
In many real-world applications, Time Series Data are captured over the course of time and exhibit temporal dependencies that cause two or otherwise identical points of time to belong to different classes or exhibit different characteristic. Although time series classification has attracted increasing attention in recent years, it remains a challenging task considering the nature of data dimensionality, voluminousness and continuous updates. Most of existing Deep Learning methods often depend on hand-crafted feature extraction techniques, that are expensive for real-world time series data mining applications which in addition, require expert knowledge. In practice, training a quality classifier is highly dependent on large number of labeled samples which is mostly inadequate in real-world time series datasets. In this paper, we present a novel Deep Learning approach for time series classification problems, called Transfer Active Learning (TAL) which jointly evaluates informativeness and representativeness of a candidate sample-label pair. TAL learns to map each input into a latent space from both sample and sample-label views which is more effective. For similar tasks, TAL is able to reuse model skill with further reduction on feature extraction costs. Extensive experiments on both classification datasets and real-world prediction tasks demonstrate the efficiency of the proposed approach on exponential reduction of training cost .
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Gikunda, P.K., Jouandeau, N.: State-of-the-art convolutional neural networks for smart farms: a review. In: Arai, K., Bhatia, R., Kapoor, S. (eds.) CompCom 2019. AISC, vol. 997, pp. 763–775. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-22871-2_53
Szegedy, C., et al.: The inception architecture for computer vision. In: Conference on Computer Vision and Pattern Recognition (CCVPR 2016), pp. 2818–2826. IEEE (2016)
Krizhevsky, A., Sutskever, I., Hinton, G.E.: ImageNet classification with deep convolutional neural networks. Commun. ACM 60(6), 84–90 (2017)
Torres, J.F., et al.: A deep learning for time series forecasting: a survey. Big Data 9(1), 3–21 (2021)
Gavves, E., et al.: Active transfer learning with zero-shot priors: reusing past datasets for future tasks. In: International Conference on Computer Vision (ICCV 2015), pp. 2731–2739. IEEE (2015)
Raina, R., et al.: Self-taught learning: transfer learning from unlabeled data. In: International Conference on Machine Learning, pp. 759–766. ACM (2017)
Fu, Y., Zhu, X., Li, B.: A survey on instance selection for active learning. Knowl. Inf. Syst. 35, 49–283 (2013). https://doi.org/10.1007/s10115-012-0507-8
Settles, B.: Active learning literature survey. Computer Sciences Technical Report 1648, University of Wisconsin-Madison, Madison (2009)
Li, X., Guo, Y.: Adaptive active learning for image classification. In: Conference on Computer Vision and Pattern Recognition (CCVPR 2013), pp. 859–866. IEEE (2013)
Lewis, D.D., Catlett, J.: Heterogeneous uncertainty sampling for supervised learning. In: Machine Learning Proceedings, pp. 148–156 (1994)
Langkvist, M., Karlsson, L., Loutfi, A.: A review of unsupervised feature learning and deep learning for time-series modeling. Pattern Recogn. Lett. 42, 11–24 (2014)
Pascanu, R., Mikolov, T., Bengio, Y.: Understanding the exploding gradient problem. CoRR, abs/1211.5063, vol. 417 (2012)
Pascanu, R., Mikolov, T., Bengio, Y.: On the difficulty of training recurrent neural networks. In: International Conference on Machine Learning, pp. 1310–1318. ACM (2013)
Lewis, D.D., Gale, W.A.: A sequential algorithm for training text classifiers. In: Croft, B.W., van Rijsbergen, C.J. (eds.) SIGIR 1994, pp. 3–12. Springer, London (1994). https://doi.org/10.1007/978-1-4471-2099-5_1
Settles, B., Craven, M.: An analysis of active learning strategies for sequence labeling tasks. In: Conference on Empirical Methods in Natural Language Processing, pp. 1070–1079 (2008)
Huang, S.J., Jin, R., Zhou, Z.H.: Active learning by querying informative and representative examples. IEEE Trans. Pattern Anal. Mach. Intell. 36(10), 1936–1949 (2014)
Natarajan, A., Laftchiev, E.: A transfer active learning framework to predict thermal comfort. Int. J. Prognostics Health Manage. 10(3), 1–13 (2019)
Peng, F., Luo, Q., Ni, L.M.: ACTS: an active learning method for time series classification. In: International Conference on Data Engineering (ICDE 2017), pp. 175–178 (2017)
Gikunda, P.K., Jouandeau, N.: Cost-based budget active learning for deep learning. In: 9th European Starting AI Researchers’ Symposium co-located with 24th European Conference on Artificial Intelligence (ECAI 2020), vol. 2655 (2020)
Wang, Z., Yan, W., Oates, T.: May. time series classification from scratch with deep neural networks: a strong baseline. In: International Joint Conference on Neural Networks (IJCNN 2017), pp. 1578–1585 (2017)
Fawaz, H.I., et al.: Deep learning for time series classification: a review. Data Min. Knowl. Discov. 33(4), 917–963 (2019)
He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Conference on Computer Vision and Pattern Recognition (CVPR 2016), pp. 770–778 (2016)
Deng, Y., Chen, K., Shen, Y., Jin, H.: Adversarial active learning for sequences labeling and generation. In: International Joint Conference on Artificial Intelligence (IJCAI 2018), pp. 4012–4018 (2018). https://doi.org/10.24963/ijcai.2018/558
Sener, O., Savarese, S.: Active learning for convolutional neural networks: a core-set approach. In: 6th International Conference on Learning Representations (ICLR 2018)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Kinyua, P., Jouandeau, N. (2021). Sample-Label View Transfer Active Learning for Time Series Classification. In: Farkaš, I., Masulli, P., Otte, S., Wermter, S. (eds) Artificial Neural Networks and Machine Learning – ICANN 2021. ICANN 2021. Lecture Notes in Computer Science(), vol 12895. Springer, Cham. https://doi.org/10.1007/978-3-030-86383-8_48
Download citation
DOI: https://doi.org/10.1007/978-3-030-86383-8_48
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-86382-1
Online ISBN: 978-3-030-86383-8
eBook Packages: Computer ScienceComputer Science (R0)