Skip to main content

A Study on Neural Networks Using Taylor Series Expansion of Sigmoid Activation Function

  • Conference paper

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 3046))

Abstract

The use of microcontroller in neural network realizations is cheaper than those specific neural chips. However, realization of complicated mathematical operations such as sigmoid activation function is difficult via general microcontrollers. On the other hand, it is possible to make approximation to the sigmoid activation function. In this study, Taylor series expansions up to nine terms are used to realize sigmoid activation function. The neural network (NN) structures with Taylor series expansions of sigmoid activation function are used for the concentration estimation of Toluene gas from the trend of the transient sensor responses. The Quartz Crystal Microbalance (QCM) type sensors were used as gas sensors. The appropriateness of the NNs for the gas concentration determination inside the sensor response time is observed with five different terms of Taylor series expansion.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Aybay, I., Çetinkaya, S., Halici, U.: Classification of Neural Network Hardware. Neural Network World, IDG Co. 6(1), 11–29 (1996)

    Google Scholar 

  2. Beiu, V.: How to Build VLSI-Efficient Neural Chips. In: Proceedings of the International ICSC Symposium on Engineering of Intelligent Systems, EIS 1998, Teneferie, Spain, pp. 9–13 (1998)

    Google Scholar 

  3. Avci, M., Yildirim, T.: Generation Of Tangent Hyperbolic Sigmoid Function For Microcontroller Based Digital Implementations Of Neural Networks. In: TAINN 2003, Canakkale,Turkey (2003)

    Google Scholar 

  4. Ho, M.H., Gullbault, G.G., Rietz, B.: Continuos Detection of Toluene in Ambient Air with a Coated Piezoelectric Crystal. Anal. Chem. 52(9) (1980)

    Google Scholar 

  5. Vaihinger, S., Gopel, W.: Multi - Component Analysis in Chemical Sensing. In: Gopel, W., Hense, S., Zemel, S.N., Weinhe, V. (eds.) Sensors: A Comprehensive Survery, New York, vol. 2(1), p. 192 (1991)

    Google Scholar 

  6. Ozturk, Z.Z., Zhou, R., Wiemar, U., Ahsen, V., Bekaroglu, O., Gopel, W.: Soluble Phthalocyanines For the Detection of Organic Solvents Thin Film Structure With Quartz Microbalance and Capacitance Transducers. Sensors And Actuators B 26-27, 208–212 (1995)

    Article  Google Scholar 

  7. Zhou, R., Josse, F., Gopel, W., Ozturk, Z.Z., Bekaroglu, A.: Phthalocyanines As Sensitive Materyals For Chemical Sensors. Applied Organometallic Chemistry 10, 557–577 (1996)

    Article  Google Scholar 

  8. Gopel, W., Schierbaum, K.D.: Sensors A Comprehensive Survey Ed. ch. 1, pp. 18–27. VCH Weinheim, New York (1991)

    Google Scholar 

  9. Szczurek, A., Szecowka, P.M., Licznerski, B.W.: Application of sensor array and neural networks for quantification of organic solvent vapours in air. Sensors and Actuators B 58, 427–432 (1999)

    Article  Google Scholar 

  10. Temurtas, F., Tasaltin, C., Yumusak, N., Ebeoglu, M.A., Ozturk, Z.Z.: Artificial Neural Networks for the Concentration Estimation of Volatile Organic Gases. In: Int. Conf. on Elec. and Electronics Eng., pp. 219–223 (1999)

    Google Scholar 

  11. Pardo, M., Faglia, G., Sberveglieri, G., Corte, M., Masulli, F., Riani, M.: A time delay neural network for estimation of gas concentrations in a mixture. Sensors and Actuators B 65, 267–269 (2000)

    Article  Google Scholar 

  12. Temurtas, F., Tasaltin, C., Temurta, H., Yumusak, N., Ozturk, Z.Z.: Fuzzy Logic and Neural Network Applications on the Gas Sensor Data: Concentration Estimation. In: Yazıcı, A., Şener, C. (eds.) ISCIS 2003. LNCS, vol. 2869, pp. 178–185. Springer, Heidelberg (2003)

    Google Scholar 

  13. Caliskan, E., Temurtas, F., Yumusak, N.: Gas Concentration Estimation using Fuzzy Inference Systems. SAU FBE Dergisi 8(1) (2004)

    Google Scholar 

  14. Haykin, S.: Neural Networks, A Comprehensive Foundation. Macmillan Publishing Company, Englewood Cliffs (1994)

    MATH  Google Scholar 

  15. King, H.W.: Piezoelectric Sorption Detector. Anal. Chem. 36, 1735–1739 (1964)

    Article  Google Scholar 

  16. Riddick, J., Bunger, A.: In: Weissberger, A. (ed.) Organic Solvents’ in Techniques of Chemistry, vol. 2, Wiley Interscience, Hoboken (1970)

    Google Scholar 

  17. Riedmiller, M.: Advanced supervised learning in multilayer perceptrons from backpropagation to adaptive learning algorithms. Int. J. of Computer Standards and Interfaces, Special Issue on Neural Networks 5 (1994)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2004 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Temurtas, F., Gulbag, A., Yumusak, N. (2004). A Study on Neural Networks Using Taylor Series Expansion of Sigmoid Activation Function. In: Laganá, A., Gavrilova, M.L., Kumar, V., Mun, Y., Tan, C.J.K., Gervasi, O. (eds) Computational Science and Its Applications – ICCSA 2004. ICCSA 2004. Lecture Notes in Computer Science, vol 3046. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-24768-5_41

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-24768-5_41

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-22060-2

  • Online ISBN: 978-3-540-24768-5

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics