Chinese Journal of Mechanical Engineering

Table 3 Optimal optimizers for different algorithms

From: Practical Options for Adopting Recurrent Neural Network and Its Variants on Remaining Useful Life Prediction

Algorithms	Optimal optimizers
RNN_1LAYER	AdaGrad
RNN_2LAYERS	Adam
RNN_3LAYERS	Adam
LSTM_1LAYER	AdaGrad
LSTM_2LAYERS	Adam
LSTM_3LAYERS	Adam, AdaDelta
Bi_LSTM_1LAYER	Adam, AdaGrad, AdaDelta
Bi_LSTM_2LAYERS	AdaGrad
Bi_LSTM_3LAYERS	AdaGrad
GRU_1LAYER	Adam, AdaGrad
GRU_2LAYERS	AdaGrad
GRU_3LAYERS	AdaGrad

Back to article page