From Homogeneous Network to Neural Nets with Fractional Derivative Mechanism
The paper refers to ANNs of the feed-forward type, homogeneous within individual layers. It extends the idea of network modelling and design with the use of calculus of finite differences proposed by Dudek-Dyduch E. and then developed jointly with Tadeusiewicz R. and others. This kind of neural nets was applied mainly to different features extraction i.e. edges, ridges, maxima, extrema and many others that can be defined with the use of classic derivative of any order and their linear combinations. Authors extend this type ANNs modelling by using fractional derivative theory. The formulae for weight distribution functions expressed by means of fractional derivative and its discrete approximation are given. It is also shown that the application of discrete approximation of fractional derivative of some base functions allows for modelling the transfer function of a single neuron for various characteristics. In such an approach smooth control of a derivative order allows to model the neuron dynamics without direct modification of the source code in IT model. The new approach presented in the paper, universalizes the model of the considered type of ANNs.
KeywordsFractional Order Fractional Derivative Discrete Approximation Fractional Order Derivative Classic Derivative
The research were conducted in the scientific cooperation between Faculty of Mathematics and Natural Sciences Department of Computer Engineering at University of Rzeszow and AGH University of Science and Technology Cracow, Department of Biomedical Engineering and Automation. The studies were conducted in the laboratory of Computer Graphics and Digital Image Processing at Center for Innovation and Transfer of Natural Sciences and Engineering Knowledge of Rzeszow University. Grants: WMP/GD-11/2016 and AGH-UST 11.120.417.
- 2.Chang, O., Constante, P., Gordon, A.: A novel deep neural network that uses space-time features for tracking and recognizing a moving object (2017). https://doi.org/10.1515/jaiscr-2017-0009. Accessed 23 Feb 2017
- 3.Vance, D.: Fractional derivatives and fractional mechanics, 2 June 2014Google Scholar
- 4.Dudek-Dyduch, E., Tadeusiewicz, R.: Neural networks indicating maxima and ridges in two-dimensional signal. In: Engineering Applications of Artificial Neural Networks, pp. 485–488. FAIS- Helsinki (1995)Google Scholar
- 5.Dudek-Dyduch, E.: Artificial neuron network indicating distribution of local maxima of input signals Ph.D. thesis, AGH-University of Science and Technology (1977)Google Scholar
- 10.Gomolka, Z., Twarog, B.: Artificial intelligence methods for image processing. In: Symbiosis of Engineering and Computer Science, pp. 93–124 (2010)Google Scholar
- 11.Gomolka, Z., Twarog, B., Kwiatkowski, B.: The fractional order operators applied in the image processing. In: Computing in Science and Technology, Monographs in AI, pp. 77–96 (2013)Google Scholar
- 12.Gomolka, Z.: Neural network for fringe image analysis, Academy of Mining and Metallurgy Cracow, Ph.D. thesis (2000)Google Scholar
- 13.Kondratenko, Y., Gordienko, E.: Implementation of the neural networks for adaptive control system on FPGA. In: DAAAM International, Vienna, Austria, EU, pp. 0389–0392 (2012)Google Scholar
- 14.Kondratenko, Y.P., Kozlov, O.V., Gerasin, O.S., Zaporozhets, Y.M.: Synthesis and research of neuro-fuzzy observer of clamping force for mobile robot automatic control system. In: IEEE First International Conference on Data Stream Mining & Processing (DSMP), pp. 90–95 (2016). doi: 10.1109/DSMP.2016.7583514
- 16.Neel, M.C., Joelson, M.: Generalizing Grunwald-Letnikovs formulas for fractional derivatives, ENOC-2008, Saint Petersburg, Russia, June 30–July 4 (2008)Google Scholar
- 17.Chakraborty, M., Maiti, D., Konar, A., Janarthanan, R.: A study of the Grunwald-Letnikov definition for minimizing the effects of random noise on fractional order differential equations. In: 4th IEEE International Conference on Information and Automation for Sustainability (2008)Google Scholar
- 18.Ostalczyk, P.: On simplified forms of the fractional-order backward difference and related fractional-order linear discrete-time system description. Bull. Polish Acad. Sci. Techn. Sci. 63(2), 423–433 (2015)Google Scholar