Skip to main content

Extracting Knowledge from Sensor Signals for Case-Based Reasoning with Longitudinal Time Series Data

  • Chapter
Case-Based Reasoning on Images and Signals

Part of the book series: Studies in Computational Intelligence ((SCI,volume 73))

Summary

In many industrial and medical diagnosis problems it is essential to investigate time series measurements collected to recognize existing or potential faults/diseases. Today this is usually done manually by humans. However the lengthy and complex nature of signals in practice often makes it a tedious and hard task to analyze and interpret available data properly even by experts with rich experiences. The incorporation of intelligent data analysis method such as case-based reasoning is showing strong benefit in offering decision support to technicians and clinicians for more reliable and efficient judgments.

This chapter addresses a general framework enabling more compact and efficient representation of practical time series cases capturing the most important characteristics while ignoring irrelevant trivialities. Our aim is to extract a set of qualitative, interpretable features from original, and usually real-valued time series data. These features should on one hand convey significant information to human experts enabling potential discoveries/findings and on the other hand facilitate much simplified case indexing and similarity matching in case-based reasoning. The road map to achieve this goal consists of two subsequent stages. In the first stage it is tasked to transform the time series of real numbers into a symbolic series by temporal abstraction or symbolic approximation. A few different methods are available at this stage and they are introduced in this chapter. Then in the second stage we use knowledge discovery method to identify key sequences from the transformed symbolic series in terms of their cooccurrences with certain classes. Such key sequences are valuable in providing concise and important features to characterize dynamic properties of the original time series signals. Four alternative ways to index time series cases using discovered key sequences are discussed in this chapter.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. A. Aamodt and E. Plaza. Case-based reasoning: foundational issues, methodological variations and systems approaches. AI Communications, 7:39–59, 1994.

    Google Scholar 

  2. Agrawal, R., Srikant, R.: Mining sequential patterns. In: Proceedings of the 11th International Conference on Data Engineering. (1995) 3–14

    Google Scholar 

  3. A. Apostolico, M.E. Bock, and S. Lonardi. Monotony of surprise and large-scale quest for unusual words. In: Proceedings of the 6th International conference on Research in Computational Molecular Biology, Washington, DC, pp. 22–31, 2002.

    Google Scholar 

  4. Bar-Shalom, Y. and X. Li, Estimation and Tracking: Principles, Techniques, and Software, Artech House, Boston, 1993.

    Google Scholar 

  5. E. Beckenstein, G. Bachman and L. Narici. Fourier and Wavelet Analysis, Springer, 2000.

    Google Scholar 

  6. R. Bellazzi, C. Larizza, ans A. Riva. Temporal abstractions for interpreting diabetic patients monitoring data. Intelligent Data Analysis, 2: 97–122, 1998.

    Article  Google Scholar 

  7. I. Bichindaritz and E. Conlon. Temporal knowledge representation and organization for case-based reasoning. In Proc. TIME-96, IEEE Computer Society Press, Washington, DC, 1996, pp. 152–159.

    Google Scholar 

  8. H.A. Braun et al. Low-Dimensional Dynamics in Sensory Biology 2: Facial Cold Receptors of the Rat. J. of Comp. Neuroscience 7(1), pp. 17–32, 1999.

    Article  MATH  Google Scholar 

  9. Chan, K.P., Fu, A.W.: Efficient time series matching by wavelets. In: Proceedings of the International Conference on Data Engineering. (1999) 126–133

    Google Scholar 

  10. J.P. Crutchfield and K. Young. Inferring statistical complexity. Phys. Rev. Lett., Vol. 63, No. 2, pp. 105–108, 1989.

    Article  MathSciNet  Google Scholar 

  11. Daw, C.S., Finney, C.E.A.: A review of symbolic analysis of experimental data. Review of Scientific Instruments, 74(2): 915–930, 2003.

    Article  Google Scholar 

  12. Fayyad, U., Piatetsky-Shapiro, G., Smyth, P.: From data mining to knowledge discovery. In: Advances in Knowledge Discovery and Data Mining. MIT Press (1996) 1–36

    Google Scholar 

  13. Garofalakis, M.N., Rajeev, R., Shim, K.: SPIRIT: Sequential sequential pattern mining with regular expression constraints. In: Proceedings of the 25th International Conference on Very Large Databases. (1999) 223–234

    Google Scholar 

  14. J. Godelle and C. Letellier. Symbolic sequence statistical analysis for free liquid jets. Phys. Rev. E 62, Issue 6, pp. 7973–7981, 2000.

    Google Scholar 

  15. Gordon, N., A. Marrs and D. Salmond, Sequential Analysis of Nonlinear Dynamic Systems Using Particles and Mixtures, in: Nonlinear and Nonstationary Signal Processing, W. Fitzgerald, R. Smith, A. Walden, and P. Young, ed., Chapter 2, Cambridge University Press, Cambridge, 2001.

    Google Scholar 

  16. Hayashi, A., Mizuhara, Y., Suematsu, N.: Embedding time series data for classification. In: Perner, P., Imiya, A. (eds.): Proceedings of the IAPR International Conference on Machine Learning and Data Mining in Pattern Recognition. Leipzig (2005) 356–365

    Google Scholar 

  17. Hetland, M.L.: A survey of recent methods for efficient retrieval of similar time sequences. In: Last, M., Kandel, A., Bunke, H. (eds.): Data Mining in Time Series Databases. World Scientific (2004)

    Google Scholar 

  18. L.M. Hively, V.A. Protopopescu, and P.C. Gailey. Timely detection of dynamical change in scalp EEG signals. Chaos, Vol. 10, Issue 4, pp. 864–875, 2000.

    Article  MATH  MathSciNet  Google Scholar 

  19. M. Holschneider. Wavelet – An Analysis Tool. Oxford Science publications, 1995.

    Google Scholar 

  20. Huang, C.F., Chen, Y.C., Chen, A.P.: An association mining method for time series and its application in the stock prices of TFT-LCD industry. In: Perner, P. (ed.): Proceedings of the 4th Industrial Conference on Data Mining. Leipzig (2004)

    Google Scholar 

  21. Huhtala, Y., Kärkkäinen, J., Toivonen, H.: Mining for similarities in aligned time series using wavelets. In: Data Mining and Knowledge Discovery: Theory, Tools, and Technology. SPIE Proceedings Series, Vol. 3695. Orlando, FL (1999) 150–160

    Google Scholar 

  22. M.D. Jaere, A. Aamodt, and P. Skalle. Representing temporal knowledge for case-based prediction. In S. Craw and A. Preece, editors, Proceeding of the European Conference on Case-Based Reasoning, 2002, pp. 174–188.

    Google Scholar 

  23. J. Jarmulak, S. Craw, and R. Rowe. Genetic algorithms to optimize CBR retrieval. In E. Blanzieri and L. Portinale, editors, Proceedings of the European Conference on Case-Based Reasoning, pages 136–147. Springer, 2000.

    Google Scholar 

  24. S. Kadar, J. Wang, and K. Showalter. Noise-supported travelling waves in sub-excitable media. Nature 391, pp. 770–772, 1998.

    Article  Google Scholar 

  25. Keogh, E., Chakrabarti, K., Pazzani, M., Mehrotra, S.: Locally adaptive dimensionality reduction for indexing large time series databases. In: Proceedings of ACM SIGMOD Conference on Management of Data. Santa Barbara, CA (2001) 151–162

    Google Scholar 

  26. Keogh, E., Chakrabarti, K., Pazzani, M., Mehrotra, S.: Dimensionality reduction for fast similarity search in large time series databases. Journal of Knowledge and Information Systems (2001)

    Google Scholar 

  27. J.-S. Kim et al. Decreased entropy of symbolic heart rate dynamics during daily activity as a predictor of positive head-up tilt test in patients with alleged neurocardiogenic syncope. Phys. Med. Biol. 45, pp. 3403–3412, 2000.

    Article  Google Scholar 

  28. Last, M., Klein, Y., Kandel, A.: Knowledge discovery in time series databases. IEEE Trans. Systems, Man, and Cybernetics — Part B: Cybernetics 31 (2001) 160–169

    Google Scholar 

  29. Lee, S.K., White P.R.: The Enhancement of Impulse Noise And Vibration Signals For Fault Detection in Rotating and Reciprocating Machinery, Journal of Sound and Vibration 217 (1998), 485–505.

    Article  Google Scholar 

  30. Lin, J.: Feature Extraction of Machine Sound Using Wavelet and Its Application in Fault Diagnosis, NDT&E International 34 (2001), 25–30.

    Article  Google Scholar 

  31. S. Lonardi. Global detectors of unusual words: Design, implementation, and applications to pattern discovery in biosequences. Ph.D thesis, Department of Computer Sciences, Purdue University, 2001.

    Google Scholar 

  32. D. McSherry. Explaining the Pros andv Cons of conclusions in CBR. In P. Funk and P.A.G. Calero, editors, Proceedings of the European Conference on Case-Based Reasoning, pages 317–330. Springer, 2004.

    Google Scholar 

  33. S. Montani, et al. Case-based retrieval to support the treatment of end stage renal failure patients, Artificial Intelligence in Press.

    Google Scholar 

  34. S. Montani and L. Portinale. Case based representation and retrieval with time dependent features. In Proceedings of the International Conference on Case-Based Reasoning, pages 353–367, Springer, 2005.

    Google Scholar 

  35. Nilsson, M., Funk, P.: A Case-Based Classification of Respiratory Sinus Arrhythmia. In P. Funk and P.A.G. Calero, editors, Proceedings of the European Conference on Case-Based Reasoning, pages 673–685. Springer, 2004.

    Google Scholar 

  36. E. Olsson, P. Funk, and N. Xiong. Fault diagnosis in industry using sensor readings and case-based reasoning. Journal of Intelligent & Fuzzy Systems, 15:41–46, 2004.

    Google Scholar 

  37. Park, S., Chu, W.W., Yoon, J., Hsu, C.: Efficient search for similar subsequences of different lengths in sequence databases. In: Proceedings of the International Conference on Data Engineering. (2000) 23–32

    Google Scholar 

  38. P. Perner. Incremental learning of retrieval knowledge in a case-based reasoning system. In K. D. Ashley and D. G. Bridge, editors, Proceedings of the International Conference on Case-Based Reasoning, pages 422–436. Springer, 2003.

    Google Scholar 

  39. Pous, C., Colomer, J., and Melendez, J.: Extending a fault dictionary towards a case based reasoning system for linear electronic analog circuits diagnosis. In: Proceedings of the 7th European Conference on Case-Based Reasoning, Madrid, 2004, pp 748–762.

    Google Scholar 

  40. Pray, K.A., Ruiz, C.: Mining expressive temporal associations from complex data. In: Perner, P., Imiya, A. (eds.): Proceedings of the IAPR International Conference on Machine Learning and Data Mining in Pattern Recognition. Leipzig (2005) 384–394

    Google Scholar 

  41. Ray, A.: Symbolic dynamic analysis of complex systems for anomaly detection. Signal Processing 84 (2004) 1115–1130

    Article  MATH  Google Scholar 

  42. R. Schmidt, B. Heindl, B. Pollwein, and L. Gierl. Abstraction of data and time for multiparametric time course prognoses. In: Advances of Case-Based Reasoning, LNAI 1168, Springer-Verlag, Berlin, 1996, pp. 377–391.

    Chapter  Google Scholar 

  43. J. Lin, E. Keogh, S. Lonardi et al. A symbolic representation of time series, with implications for streaming algorithms. In: Proceedings of the 8th ACM SIGMOD Workshop on Research Issues in Data Mining and Knowledge Discovery, pages 2–11, 2003

    Google Scholar 

  44. G. Salton. Automatic information organization and retrieval. New York: McGraw-Hill, 1968.

    Google Scholar 

  45. Y. Shahar. A framework for knowledge-based temporal abstractions. Artificial Intelligence, 90:79–133, 1997.

    Article  MATH  Google Scholar 

  46. Srikant, R., Agrawal, R.: Mining sequential patterns: Generalizations and performance improvements. In: Proceedings of the 5th International Conference on Extending Database Technology. (1996) 3–17

    Google Scholar 

  47. S.D. Stearns. Digital Signal Processing with Examples in Matlab. CRC Press, Florida, 2003

    MATH  Google Scholar 

  48. X.Z. Tang, E.R. Tracy, and R. Brown. Symbol statistics and spatio-temporal systems. Physica D, Vol. 102, Issue 3–4, pp. 253–261, 1997.

    Article  MATH  Google Scholar 

  49. Tung, A.K.H., Lu, H., Han, J., Feng, L.: Breaking the barrier of transactions: Mining inter-transaction association rules. In: Proceedings of ACM Conference on Knowledge Discovery and Data Mining. (1999) 297–301

    Google Scholar 

  50. G. Tzanetakis, G. Essl, and P. Cook. Audio Analysis using the Discrete Wavelet Transform. In Proceedings of the WSES International Conference on Acoustics and Music: Theory and Applications (AMTA 2001) Skiathos, Greece, 2001.

    Google Scholar 

  51. Wu, Y., Agrawal, D., Abbadi, A. EI: A comparison of DFT and DWT based similarity search in time series databases. In: Proceedings of the 9th ACM CIKM Conference on Information and Knowledge Management. McLean, VA (2000) 488–495

    Google Scholar 

  52. Yoon, H., Yang, K., Shahabi, C.: Feature subset selection and feature ranking for multivariate time series. IEEE Trans. Knowledge and Data Engineering 17 (2005) 1186–1198

    Article  Google Scholar 

  53. S. Zelikovitz and H. Hirsh. Integrating background knowledge into nearest-neighbor text classification. In S. Craw and A. Preece, editors, Proceedings of the European Conference on Case-Based Reasoning, pages 1–5. Springer, 2002.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2008 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Funk, P., Xiong, N. (2008). Extracting Knowledge from Sensor Signals for Case-Based Reasoning with Longitudinal Time Series Data. In: Perner, P. (eds) Case-Based Reasoning on Images and Signals. Studies in Computational Intelligence, vol 73. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-73180-1_9

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-73180-1_9

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-73178-8

  • Online ISBN: 978-3-540-73180-1

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics