Skip to main content

Health Change Detection Using Temporal Transductive Learning

  • Conference paper
  • First Online:
Machine Learning, Optimization, and Data Science (LOD 2021)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 13164))

  • 1694 Accesses

Abstract

Industrial equipment, devices and patients typically undergo change from a healthy state to an unhealthy state. We develop a novel approach to detect unhealthy entities and also discover the time of change to enable deeper investigation into the cause for change. In the absence of an engineering or medical intervention, health degradation only happens in one direction — healthy to unhealthy. Our transductive learning framework, known as max-margin temporal transduction (MMTT), leverages this chronology of observations for learning a superior model with minimal supervision. Temporal Transduction is achieved by incorporating chronological constraints in the conventional max-margin classifier — Support Vector Machines (SVM). We utilize stochastic gradient descent to solve the resulting optimization problem. We prove that with high probability, an \(\epsilon \)-accurate solution for the proposed model can be achieved in \({\text {O}}\left( \frac{1}{\lambda \epsilon }\right) \) iterations. The runtime is \({\text {O}}\left( \frac{1}{\lambda \epsilon }\right) \) for the linear kernel and \({\text {O}}\left( \frac{n}{\lambda \epsilon }\right) \) for a non-linear Mercer kernel, where n is the number of observations from all entities — labeled and unlabeled. Our experiments on publicly available benchmark datasets demonstrate the effectiveness of our approach in accurately detecting unhealthy entities with less supervision as compared to other strong baselines — conventional and transductive SVM.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 69.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 89.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    We have ignored the bias b in this work, although it is likely to only further improve the results beyond those presented here. Detailed discussion on the bias term appears in [10].

  2. 2.

    Uses: \(\frac{\partial |u|}{\partial v} = \frac{u}{|u|}\frac{\partial u}{\partial v}; u \ne 0\).

  3. 3.

    A function \(f(\mathbf {w})\) is called \(\lambda \)-strongly convex if \(f(\mathbf {w}) - \frac{\lambda }{2}\Vert \mathbf {w}\Vert ^2\) is a convex function.

  4. 4.

    \(\Vert \phi (\mathbf {x})\Vert ^2 = \langle \phi (x)\phi (x) \rangle = \exp \left( \frac{-|\phi (\mathbf {x}) - \phi (\mathbf {x})\Vert ^2}{2\sigma ^2}\right) = 1\).

  5. 5.

    http://svmlight.joachims.org/.

  6. 6.

    http://scikit-learn.org.

  7. 7.

    https://www.dropbox.com/s/z9kfii51nvc7izq/mmtt.zip?dl=0.

References

  1. Bordes, A., Ertekin, S., Weston, J., Bottou, L.: Fast kernel classifiers with online and active learning. J. Mach. Learn. Res. 6, 1579–1619 (2005). http://leon.bottou.org/papers/bordes-ertekin-weston-bottou-2005

  2. Chapelle, O., Vapnik, V., Weston, J.: Transductive inference for estimating values of functions. In: Advances in Neural Information Processing Systems (1999)

    Google Scholar 

  3. Chapelle, O., Zien, A.: Semi-supervised classification by low density separation. In: Proceedings of the Tenth International Workshop on Artificial Intelligence and Statistics, pp. 57–64 (2005)

    Google Scholar 

  4. Collobert, R., Sinz, F., Weston, J., Bottou, L.: Large scale transductive SVMs. J. Mach. Learn. Res. 7, 1687–1712 (2006). http://dl.acm.org/citation.cfm?id=1248547.1248609

  5. Petricoin, E.F., et al.: Use of proteomic patterns in serum to identify ovarian cancer. Lancet 359, 572–577 (2002). https://doi.org/10.1016/S0140-6736(02)07746-2

    Article  Google Scholar 

  6. Joachims, T.: Transductive inference for text classification using support vector machines. In: Proceedings of the Sixteenth International Conference on Machine Learning, ICML’99, pp. 200–209. Morgan Kaufmann Publishers Inc., San Francisco (1999). http://dl.acm.org/citation.cfm?id=645528.657646

  7. Kakade, S.M., Tewari, A.: On the generalization ability of online strongly convex programming algorithms. In: Koller, D., Schuurmans, D., Bengio, Y., Bottou, L. (eds.) NIPS, pp. 801–808. Curran Associates, Inc. (2008). http://dblp.uni-trier.de/db/conf/nips/nips2008.html#KakadeT08

  8. Little, M., McSharry, P., Roberts, S., Costello, D., Moroz, I.: Exploiting nonlinear recurrence and fractal scaling properties for voice disorder detection. Biomed. Eng. Online 6(1), 23 (2007)

    Article  Google Scholar 

  9. Saxena, A., Goebel, K., Simon, D., Eklund, N.: Damage propagation modeling for aircraft engine run-to-failure simulation. In: International Conference on Prognostics and Health Management, PHM 2008, pp. 1–9, October 2008. https://doi.org/10.1109/PHM.2008.4711414

  10. Shalev-Shwartz, S., Singer, Y., Srebro, N., Cotter, A.: Pegasos: Primal Estimated sub-GrAdient SOlver for SVM. Math. Program. 127(1), 3–30 (2011)

    Article  MathSciNet  Google Scholar 

  11. Smith, J.W., Everhart, J.E., Dickson, W.C., Knowler, W.C., Johannes, R.S.: Using the ADAP learning algorithm to forecast the onset of diabetes mellitus. J. Hopkins APL Tech. Dig. 10, 262–266 (1988)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Abhay Harpale .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Harpale, A. (2022). Health Change Detection Using Temporal Transductive Learning. In: Nicosia, G., et al. Machine Learning, Optimization, and Data Science. LOD 2021. Lecture Notes in Computer Science(), vol 13164. Springer, Cham. https://doi.org/10.1007/978-3-030-95470-3_13

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-95470-3_13

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-95469-7

  • Online ISBN: 978-3-030-95470-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics