Skip to main content

Table 3 Optimal optimizers for different algorithms

From: Practical Options for Adopting Recurrent Neural Network and Its Variants on Remaining Useful Life Prediction

Algorithms Optimal optimizers
RNN_1LAYER AdaGrad
RNN_2LAYERS Adam
RNN_3LAYERS Adam
LSTM_1LAYER AdaGrad
LSTM_2LAYERS Adam
LSTM_3LAYERS Adam, AdaDelta
Bi_LSTM_1LAYER Adam, AdaGrad, AdaDelta
Bi_LSTM_2LAYERS AdaGrad
Bi_LSTM_3LAYERS AdaGrad
GRU_1LAYER Adam, AdaGrad
GRU_2LAYERS AdaGrad
GRU_3LAYERS AdaGrad