University of Isfahan Computational Intelligence in Electrical Engineering 2821-0689 11 4 2020 12 21 An evolutionary attention-based deep long short-term memory for time series prediction An evolutionary attention-based deep long short-term memory for time series prediction 15 28 24772 10.22108/isee.2020.121597.1334 FA Marzieh Hajizadeh Tahan Computer Engineering Department, Yazd University, Yazd, Iran Mohammad Ghasemzadeh Computer Engineering Department, Yazd University, Yazd, Iran. 0000-0002-6805-4852 Mahdi Rezaeian Computer Engineering Department, Yazd University,Yazd, Iran Journal Article 2020 02 13 Long-term prediction of time series is an important but challenging issue. Today, deep networks, especially Long short Term Memory (LSTM) networks, have been successfully used to predict time series. The LSTM network is capable of maintaining long-term dependencies, but its ability to assign varying degrees of attention to sub window features over multiple time steps is not sufficient. Also, the performance of these networks depends heavily on their hyper-parameters ​​and it is important to adopt an efficient method to ensure optimum values. In this study, to overcome the above challenges, an evolutionary attention-based deep LSTM for predicting multivariate time series is recommended that automatically finds one of the best combinations of LSTM parameter values and sub window features. The proposed algorithm uses a genetic algorithm to properly adjust the deep LSTM network architecture. In order to evaluate the performance of the proposed algorithm, three data sets in the fields of energy and environment have been used. The experimental results show that the proposed algorithm performs better than other basic models. Long-term prediction of time series is an important but challenging issue. Today, deep networks, especially Long short Term Memory (LSTM) networks, have been successfully used to predict time series. The LSTM network is capable of maintaining long-term dependencies, but its ability to assign varying degrees of attention to sub window features over multiple time steps is not sufficient. Also, the performance of these networks depends heavily on their hyper-parameters ​​and it is important to adopt an efficient method to ensure optimum values. In this study, to overcome the above challenges, an evolutionary attention-based deep LSTM for predicting multivariate time series is recommended that automatically finds one of the best combinations of LSTM parameter values and sub window features. The proposed algorithm uses a genetic algorithm to properly adjust the deep LSTM network architecture. In order to evaluate the performance of the proposed algorithm, three data sets in the fields of energy and environment have been used. The experimental results show that the proposed algorithm performs better than other basic models. https://isee.ui.ac.ir/article_24772_d7dd73f99effc0b7b7f277c760f7950f.pdf