完成LSTM
numHiddenUnits = 200
maxEpochs = 200
miniBatchSize = 100
rmsprop
‘InitialLearnRate’, 0.001
numHiddenUnits = 200
maxEpochs = 200
miniBatchSize = 100
adam
‘InitialLearnRate’, 0.001
numHiddenUnits = 200
maxEpochs = 200
miniBatchSize = 100
adam
‘InitialLearnRate’, 0.0001
(学习率太低了)
numHiddenUnits = 200
maxEpochs = 200
miniBatchSize = 50
adam
‘InitialLearnRate’, 0.001
‘LearnRateSchedule’, ‘piecewise’
‘LearnRateDropFactor’, 0.5
‘LearnRateDropPeriod’, 50
(分段调节的学习率,效果反而不好)
acc = 0.9674
numHiddenUnits = 200
maxEpochs = 200
miniBatchSize = 50
adam
‘InitialLearnRate’, 0.001
acc = 0.9801
numHiddenUnits = 200
maxEpochs = 200
miniBatchSize = 50
adam
‘InitialLearnRate’, 0.001
‘LearnRateSchedule’, ‘piecewise’
‘LearnRateDropFactor’, 0.5
‘LearnRateDropPeriod’, 100
(100epoch之后学习率减半,acc稍微低一点点)
acc = 0.9772