Artificial neural networks: a practical review of applications involving fractional calculus

Eur Phys J Spec Top. 2022;231(10):2059-2095. doi: 10.1140/epjs/s11734-022-00455-3. Epub 2022 Feb 12.

Abstract

In this work, a bibliographic analysis on artificial neural networks (ANNs) using fractional calculus (FC) theory has been developed to summarize the main features and applications of the ANNs. ANN is a mathematical modeling tool used in several sciences and engineering fields. FC has been mainly applied on ANNs with three different objectives, such as systems stabilization, systems synchronization, and parameters training, using optimization algorithms. FC and some control strategies have been satisfactorily employed to attain the synchronization and stabilization of ANNs. To show this fact, in this manuscript are summarized, the architecture of the systems, the control strategies, and the fractional derivatives used in each research work, also, the achieved goals are presented. Regarding the parameters training using optimization algorithms issue, in this manuscript, the systems types, the fractional derivatives involved, and the optimization algorithm employed to train the ANN parameters are also presented. In most of the works found in the literature where ANNs and FC are involved, the authors focused on controlling the systems using synchronization and stabilization. Furthermore, recent applications of ANNs with FC in several fields such as medicine, cryptographic, image processing, robotic are reviewed in detail in this manuscript. Works with applications, such as chaos analysis, functions approximation, heat transfer process, periodicity, and dissipativity, also were included. Almost to the end of the paper, several future research topics arising on ANNs involved with FC are recommended to the researchers community. From the bibliographic review, we concluded that the Caputo derivative is the most utilized derivative for solving problems with ANNs because its initial values take the same form as the differential equations of integer-order.