用Keras实现MNIST手写数字识别
MNIST手写数字数据集介绍
MNIST手写数字数据集来自美国国家标准与技术研究所，National Institute of Standards and Technology (NIST)。 训练集 (training set) 由来自 250 个不同人手写的数字构成，其中50%是高中学生，50% 来自人口普查局 (the Census Bureau) 的工作人员。测试集(test set) 也是同样比例的手写数字数据。
图片特点：
这些图片已进行尺寸规格化，并在固定尺寸的图像中居中
训练集：60,000个示例
测试集：10,000个示例
大下：28x28
使用神经网络来识别手写数字
环境
Win 10
PyCharm
Anaconda
Python 3.6.7
TensorFlow 1.10.0
Keras 2.2.0
MLP
CNN
MLP和CNN对比
使用Anaconda安装tensorflow和keras的环境，并在pycharm设置环境
TensorFlow 1.10.0
Keras 2.2.0
tendorflow和keras版本要相互对应，否则程序会报错。
该网站提供了python、tensorflow和keras对应的版本：
最新版本的tensorflow自带keras，不需要单独下载。
MLP:多层感知机
1、导入数据
2、数据格式转换
3、归一化
4、one-hot编码
5、创建一个序列模型，添加连接层
6、编译模型
7、开始训练
8、使用模型进行预测
import keras
from keras.datasets import mnist
from keras.models import Sequential
from keras.layers import Dense, Dropout
from keras.optimizers import RMSprop
import matplotlib.pyplot as plt
# 导入数据
(x_train, y_train), (x_test, y_test) = mnist.load_data()
print('Let it go!')
# 二维数据转换为向量
x_train = x_train.reshape(60000, 784)
x_test = x_test.reshape(10000, 784)
# 数据转换为float类型
x_train = x_train.astype('float32')
x_test = x_test.astype('float32')
# 归一化：0~255到0~1
x_train /= 255
x_test /= 255
print(x_train.shape[0], 'train samples')
print(x_test.shape[0], 'test samples')
# one-hot编码
num_classes = 10
y_train = keras.utils.to_categorical(y_train, num_classes)
y_test = keras.utils.to_categorical(y_test, num_classes)
# create model
# 创建一个序列模型
model = Sequential()
# 添加一个全连接层，512个神经元，激活函数用'relu'
model.add(Dense(512, activation='relu', input_shape=(784, )))
# 为了避免过拟合，提高模型的泛化能力，添加随机失火层，失火频率20%
model.add(Dropout(0.2))
model.add(Dense(512, activation='relu'))
model.add(Dropout(0.2))
model.add(Dense(num_classes, activation='softmax'))
model.summary()
# 编译模型
model.compile(loss='categorical_crossentropy',
optimizer=RMSprop(),
metrics=['accuracy'])
# 开始训练
batch_size = 128
# 迭代次数
epochs = 10
model.fit(x_train, y_train,
batch_size=batch_size,
epochs=epochs,
# 训练时的啰嗦程度，训练一次，打印一次
verbose=1,
# 验证数据集
validation_data=(x_test, y_test))
# 打印模型训练后预测的结果
n = 10
predicted_number = model.predict(x_test[:n], n)
plt.figure(figsize=(10, 2))
for i in range(n):
plt.subplot(1, n, i + 1)
# 向量需要reshape为矩阵
t = x_test[i].reshape(28, 28)
# 以灰度图显示
plt.imshow(t, cmap='gray')
# 设置图片之间的间距
plt.subplots_adjust(wspace=2)
# 通过标签，反映模型预测结果
# 第一个数字是真实标签，第二个数字是预测数值
# 如果预测正确，绿色显示，否则红色显示
# 预测结果是one-hot编码，需要转化为数字
if y_test[i].argmax() == predicted_number[i].argmax():
plt.title('%d,%d' % (y_test[i].argmax(), predicted_number[i].argmax()), color='green')
else:
plt.title('%d,%d' % (y_test[i].argmax(), predicted_number[i].argmax()), color='red')
plt.xticks([]) # 取消x轴刻度
plt.yticks([])
plt.show()
模型预测结果
模型训练过程
D:\Users\Stark\Anaconda3\python.exe D:/Python/keras_mnist001/venv/Include/MNIST_MLP.py
Using TensorFlow backend.
D:\Users\Stark\Anaconda3\lib\site-packages\tensorflow\python\framework\dtypes.py:523: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'.
_np_qint8 = np.dtype([("qint8", np.int8, 1)])
D:\Users\Stark\Anaconda3\lib\site-packages\tensorflow\python\framework\dtypes.py:524: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'.
_np_quint8 = np.dtype([("quint8", np.uint8, 1)])
D:\Users\Stark\Anaconda3\lib\site-packages\tensorflow\python\framework\dtypes.py:525: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'.
_np_qint16 = np.dtype([("qint16", np.int16, 1)])
D:\Users\Stark\Anaconda3\lib\site-packages\tensorflow\python\framework\dtypes.py:526: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'.
_np_quint16 = np.dtype([("quint16", np.uint16, 1)])
D:\Users\Stark\Anaconda3\lib\site-packages\tensorflow\python\framework\dtypes.py:527: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'.
_np_qint32 = np.dtype([("qint32", np.int32, 1)])
D:\Users\Stark\Anaconda3\lib\site-packages\tensorflow\python\framework\dtypes.py:532: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'.
np_resource = np.dtype([("resource", np.ubyte, 1)])
Let it go!
60000 train samples
10000 test samples
_________________________________________________________________
Layer (type) Output Shape Param #
=================================================================
dense_1 (Dense) (None, 512) 401920
_________________________________________________________________
dropout_1 (Dropout) (None, 512) 0
_________________________________________________________________
dense_2 (Dense) (None, 512) 262656
_________________________________________________________________
dropout_2 (Dropout) (None, 512) 0
_________________________________________________________________
dense_3 (Dense) (None, 10) 5130
=================================================================
Total params: 669,706
Trainable params: 669,706
Non-trainable params: 0
_________________________________________________________________
Train on 60000 samples, validate on 10000 samples
Epoch 1/10
2020-11-19 10:35:41.192414: I tensorflow/core/platform/cpu_feature_guard.cc:141] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX AVX2
128/60000 [..............................] - ETA: 1:28 - loss: 2.2976 - acc: 0.1328
768/60000 [..............................] - ETA: 18s - loss: 1.7288 - acc: 0.4362
1536/60000 [..............................] - ETA: 11s - loss: 1.3051 - acc: 0.5749
2176/60000 [>.............................] - ETA: 9s - loss: 1.1180 - acc: 0.6388
2816/60000 [>.............................] - ETA: 8s - loss: 0.9863 - acc: 0.6825
3456/60000 [>.............................] - ETA: 7s - loss: 0.9045 - acc: 0.7109
4096/60000 [=>............................] - ETA: 6s - loss: 0.8354 - acc: 0.7334
4736/60000 [=>............................] - ETA: 6s - loss: 0.7683 - acc: 0.7574
5376/60000 [=>............................] - ETA: 6s - loss: 0.7377 - acc: 0.7684
6016/60000 [==>...........................] - ETA: 5s - loss: 0.6996 - acc: 0.7794
6656/60000 [==>...........................] - ETA: 5s - loss: 0.6658 - acc: 0.7912
7296/60000 [==>...........................] - ETA: 5s - loss: 0.6375 - acc: 0.8007
7936/60000 [==>...........................] - ETA: 5s - loss: 0.6147 - acc: 0.8082
8576/60000 [===>..........................] - ETA: 5s - loss: 0.5948 - acc: 0.8138
9344/60000 [===>..........................] - ETA: 5s - loss: 0.5739 - acc: 0.8204
9984/60000 [===>..........................] - ETA: 4s - loss: 0.5548 - acc: 0.8269
10752/60000 [====>.........................] - ETA: 4s - loss: 0.5355 - acc: 0.8331
11520/60000 [====>.........................] - ETA: 4s - loss: 0.5186 - acc: 0.8389
12288/60000 [=====>........................] - ETA: 4s - loss: 0.5042 - acc: 0.8437
13056/60000 [=====>........................] - ETA: 4s - loss: 0.4917 - acc: 0.8480
13696/60000 [=====>........................] - ETA: 4s - loss: 0.4822 - acc: 0.8516
14336/60000 [======>.......................] - ETA: 4s - loss: 0.4723 - acc: 0.8542
14976/60000 [======>.......................] - ETA: 4s - loss: 0.4643 - acc: 0.8569
15616/60000 [======>.......................] - ETA: 4s - loss: 0.4549 - acc: 0.8600
16256/60000 [=======>......................] - ETA: 4s - loss: 0.4476 - acc: 0.8624
16896/60000 [=======>......................] - ETA: 3s - loss: 0.4384 - acc: 0.8649
17536/60000 [=======>......................] - ETA: 3s - loss: 0.4311 - acc: 0.8672
18176/60000 [========>.....................] - ETA: 3s - loss: 0.4236 - acc: 0.8692
18816/60000 [========>.....................] - ETA: 3s - loss: 0.4166 - acc: 0.8715
19456/60000 [========>.....................] - ETA: 3s - loss: 0.4093 - acc: 0.8739
20096/60000 [=========>....................] - ETA: 3s - loss: 0.4028 - acc: 0.8754
20736/60000 [=========>....................] - ETA: 3s - loss: 0.3980 - acc: 0.8770
21376/60000 [=========>....................] - ETA: 3s - loss: 0.3908 - acc: 0.8789
22016/60000 [==========>...................] - ETA: 3s - loss: 0.3869 - acc: 0.8802
22656/60000 [==========>...................] - ETA: 3s - loss: 0.3813 - acc: 0.8819
23296/60000 [==========>...................] - ETA: 3s - loss: 0.3768 - acc: 0.8832
23936/60000 [==========>...................] - ETA: 3s - loss: 0.3722 - acc: 0.8848
24576/60000 [===========>..................] - ETA: 3s - loss: 0.3677 - acc: 0.8864
25216/60000 [===========>..................] - ETA: 3s - loss: 0.3620 - acc: 0.8883
25856/60000 [===========>..................] - ETA: 3s - loss: 0.3585 - acc: 0.8895
26496/60000 [============>.................] - ETA: 2s - loss: 0.3541 - acc: 0.8907
27136/60000 [============>.................] - ETA: 2s - loss: 0.3509 - acc: 0.8917
27776/60000 [============>.................] - ETA: 2s - loss: 0.3470 - acc: 0.8930
28416/60000 [=============>................] - ETA: 2s - loss: 0.3436 - acc: 0.8940
29056/60000 [=============>................] - ETA: 2s - loss: 0.3408 - acc: 0.8947
29696/60000 [=============>................] - ETA: 2s - loss: 0.3382 - acc: 0.8956
30336/60000 [==============>...............] - ETA: 2s - loss: 0.3352 - acc: 0.8969
30976/60000 [==============>...............] - ETA: 2s - loss: 0.3321 - acc: 0.8980
31616/60000 [==============>...............] - ETA: 2s - loss: 0.3285 - acc: 0.8989
32256/60000 [===============>..............] - ETA: 2s - loss: 0.3254 - acc: 0.8998
32896/60000 [===============>..............] - ETA: 2s - loss: 0.3221 - acc: 0.9009
33536/60000 [===============>..............] - ETA: 2s - loss: 0.3199 - acc: 0.9016
34176/60000 [================>.............] - ETA: 2s - loss: 0.3173 - acc: 0.9023
34816/60000 [================>.............] - ETA: 2s - loss: 0.3153 - acc: 0.9031
35456/60000 [================>.............] - ETA: 2s - loss: 0.3129 - acc: 0.9039
36096/60000 [=================>............] - ETA: 2s - loss: 0.3102 - acc: 0.9049
36736/60000 [=================>............] - ETA: 2s - loss: 0.3073 - acc: 0.9058
37376/60000 [=================>............] - ETA: 1s - loss: 0.3058 - acc: 0.9063
38016/60000 [==================>...........] - ETA: 1s - loss: 0.3032 - acc: 0.9072
38656/60000 [==================>...........] - ETA: 1s - loss: 0.3010 - acc: 0.9079
39296/60000 [==================>...........] - ETA: 1s - loss: 0.2985 - acc: 0.9085
39936/60000 [==================>...........] - ETA: 1s - loss: 0.2959 - acc: 0.9093
40576/60000 [===================>..........] - ETA: 1s - loss: 0.2946 - acc: 0.9096
41216/60000 [===================>..........] - ETA: 1s - loss: 0.2922 - acc: 0.9102
41856/60000 [===================>..........] - ETA: 1s - loss: 0.2908 - acc: 0.9107
42496/60000 [====================>.........] - ETA: 1s - loss: 0.2892 - acc: 0.9113
43136/60000 [====================>.........] - ETA: 1s - loss: 0.2870 - acc: 0.9120
43776/60000 [====================>.........] - ETA: 1s - loss: 0.2846 - acc: 0.9127
44544/60000 [=====================>........] - ETA: 1s - loss: 0.2821 - acc: 0.9136
45312/60000 [=====================>........] - ETA: 1s - loss: 0.2798 - acc: 0.9142
45952/60000 [=====================>........] - ETA: 1s - loss: 0.2773 - acc: 0.9149
46592/60000 [======================>.......] - ETA: 1s - loss: 0.2758 - acc: 0.9154
47232/60000 [======================>.......] - ETA: 1s - loss: 0.2744 - acc: 0.9158
47872/60000 [======================>.......] - ETA: 1s - loss: 0.2730 - acc: 0.9163
48640/60000 [=======================>......] - ETA: 0s - loss: 0.2709 - acc: 0.9170
49408/60000 [=======================>......] - ETA: 0s - loss: 0.2689 - acc: 0.9175
49920/60000 [=======================>......] - ETA: 0s - loss: 0.2679 - acc: 0.9178
50688/60000 [========================>.....] - ETA: 0s - loss: 0.2657 - acc: 0.9186
51328/60000 [========================>.....] - ETA: 0s - loss: 0.2640 - acc: 0.9191
51968/60000 [========================>.....] - ETA: 0s - loss: 0.2624 - acc: 0.9197
52736/60000 [=========================>....] - ETA: 0s - loss: 0.2602 - acc: 0.9204
53376/60000 [=========================>....] - ETA: 0s - loss: 0.2585 - acc: 0.9209
54144/60000 [==========================>...] - ETA: 0s - loss: 0.2566 - acc: 0.9214
54912/60000 [==========================>...] - ETA: 0s - loss: 0.2550 - acc: 0.9220
55680/60000 [==========================>...] - ETA: 0s - loss: 0.2533 - acc: 0.9226
56448/60000 [===========================>..] - ETA: 0s - loss: 0.2519 - acc: 0.9231
57088/60000 [===========================>..] - ETA: 0s - loss: 0.2510 - acc: 0.9234
57728/60000 [===========================>..] - ETA: 0s - loss: 0.2500 - acc: 0.9237
58368/60000 [============================>.] - ETA: 0s - loss: 0.2489 - acc: 0.9241
59008/60000 [============================>.] - ETA: 0s - loss: 0.2478 - acc: 0.9246
59648/60000 [============================>.] - ETA: 0s - loss: 0.2463 - acc: 0.9250
60000/60000 [==============================] - 5s 89us/step - loss: 0.2459 - acc: 0.9252 - val_loss: 0.1284 - val_acc: 0.9591
Epoch 2/10
128/60000 [..............................] - ETA: 5s - loss: 0.1098 - acc: 0.9688
768/60000 [..............................] - ETA: 4s - loss: 0.1186 - acc: 0.9557
1408/60000 [..............................] - ETA: 5s - loss: 0.1077 - acc: 0.9609
2048/60000 [>.............................] - ETA: 4s - loss: 0.1075 - acc: 0.9639
2688/60000 [>.............................] - ETA: 4s - loss: 0.0989 - acc: 0.9673
3328/60000 [>.............................] - ETA: 4s - loss: 0.1054 - acc: 0.9663
3968/60000 [>.............................] - ETA: 4s - loss: 0.0990 - acc: 0.9682
4608/60000 [=>............................] - ETA: 4s - loss: 0.0981 - acc: 0.9681
5376/60000 [=>............................] - ETA: 4s - loss: 0.0981 - acc: 0.9680
6144/60000 [==>...........................] - ETA: 4s - loss: 0.1028 - acc: 0.9674
6784/60000 [==>...........................] - ETA: 4s - loss: 0.1043 - acc: 0.9676
7552/60000 [==>...........................] - ETA: 4s - loss: 0.1056 - acc: 0.9674
8320/60000 [===>..........................] - ETA: 4s - loss: 0.1053 - acc: 0.9677
8832/60000 [===>..........................] - ETA: 4s - loss: 0.1057 - acc: 0.9677
9472/60000 [===>..........................] - ETA: 4s - loss: 0.1059 - acc: 0.9671
10240/60000 [====>.........................] - ETA: 4s - loss: 0.1082 - acc: 0.9665
10880/60000 [====>.........................] - ETA: 4s - loss: 0.1075 - acc: 0.9660
11648/60000 [====>.........................] - ETA: 3s - loss: 0.1081 - acc: 0.9658
12160/60000 [=====>........................] - ETA: 3s - loss: 0.1092 - acc: 0.9654
12800/60000 [=====>........................] - ETA: 3s - loss: 0.1086 - acc: 0.9655
13568/60000 [=====>........................] - ETA: 3s - loss: 0.1087 - acc: 0.9655
14336/60000 [======>.......................] - ETA: 3s - loss: 0.1082 - acc: 0.9656
14976/60000 [======>.......................] - ETA: 3s - loss: 0.1080 - acc: 0.9655
15744/60000 [======>.......................] - ETA: 3s - loss: 0.1084 - acc: 0.9655
16512/60000 [=======>......................] - ETA: 3s - loss: 0.1085 - acc: 0.9654
17280/60000 [=======>......................] - ETA: 3s - loss: 0.1078 - acc: 0.9658
17920/60000 [=======>......................] - ETA: 3s - loss: 0.1073 - acc: 0.9662
18688/60000 [========>.....................] - ETA: 3s - loss: 0.1063 - acc: 0.9667
19456/60000 [========>.....................] - ETA: 3s - loss: 0.1066 - acc: 0.9667
20096/60000 [=========>....................] - ETA: 3s - loss: 0.1074 - acc: 0.9667
20736/60000 [=========>....................] - ETA: 3s - loss: 0.1081 - acc: 0.9663
21376/60000 [=========>....................] - ETA: 3s - loss: 0.1067 - acc: 0.9669
22016/60000 [==========>...................] - ETA: 3s - loss: 0.1070 - acc: 0.9669
22656/60000 [==========>...................] - ETA: 3s - loss: 0.1088 - acc: 0.9667
23296/60000 [==========>...................] - ETA: 2s - loss: 0.1086 - acc: 0.9668
23936/60000 [==========>...................] - ETA: 2s - loss: 0.1089 - acc: 0.9666
24576/60000 [===========>..................] - ETA: 2s - loss: 0.1086 - acc: 0.9666
25216/60000 [===========>..................] - ETA: 2s - loss: 0.1082 - acc: 0.9666
25856/60000 [===========>..................] - ETA: 2s - loss: 0.1084 - acc: 0.9666
26496/60000 [============>.................] - ETA: 2s - loss: 0.1080 - acc: 0.9666
27136/60000 [============>.................] - ETA: 2s - loss: 0.1090 - acc: 0.9665
27776/60000 [============>.................] - ETA: 2s - loss: 0.1090 - acc: 0.9666
28416/60000 [=============>................] - ETA: 2s - loss: 0.1089 - acc: 0.9666
29056/60000 [=============>................] - ETA: 2s - loss: 0.1087 - acc: 0.9668
29696/60000 [=============>................] - ETA: 2s - loss: 0.1078 - acc: 0.9670
30336/60000 [==============>...............] - ETA: 2s - loss: 0.1072 - acc: 0.9671
30976/60000 [==============>...............] - ETA: 2s - loss: 0.1069 - acc: 0.9672
31872/60000 [==============>...............] - ETA: 2s - loss: 0.1064 - acc: 0.9673
32512/60000 [===============>..............] - ETA: 2s - loss: 0.1064 - acc: 0.9672
33280/60000 [===============>..............] - ETA: 2s - loss: 0.1062 - acc: 0.9672
34048/60000 [================>.............] - ETA: 2s - loss: 0.1061 - acc: 0.9672
34688/60000 [================>.............] - ETA: 2s - loss: 0.1060 - acc: 0.9673
35456/60000 [================>.............] - ETA: 1s - loss: 0.1054 - acc: 0.9675
36096/60000 [=================>............] - ETA: 1s - loss: 0.1054 - acc: 0.9677
36736/60000 [=================>............] - ETA: 1s - loss: 0.1051 - acc: 0.9679
37376/60000 [=================>............] - ETA: 1s - loss: 0.1048 - acc: 0.9679
38144/60000 [==================>...........] - ETA: 1s - loss: 0.1049 - acc: 0.9680
38656/60000 [==================>...........] - ETA: 1s - loss: 0.1053 - acc: 0.9679
39296/60000 [==================>...........] - ETA: 1s - loss: 0.1055 - acc: 0.9678
40064/60000 [===================>..........] - ETA: 1s - loss: 0.1061 - acc: 0.9678
40832/60000 [===================>..........] - ETA: 1s - loss: 0.1055 - acc: 0.9679
41472/60000 [===================>..........] - ETA: 1s - loss: 0.1049 - acc: 0.9681
42240/60000 [====================>.........] - ETA: 1s - loss: 0.1053 - acc: 0.9681
42880/60000 [====================>.........] - ETA: 1s - loss: 0.1052 - acc: 0.9681
43520/60000 [====================>.........] - ETA: 1s - loss: 0.1055 - acc: 0.9682
44160/60000 [=====================>........] - ETA: 1s - loss: 0.1050 - acc: 0.9682
44800/60000 [=====================>........] - ETA: 1s - loss: 0.1054 - acc: 0.9682
45440/60000 [=====================>........] - ETA: 1s - loss: 0.1051 - acc: 0.9682
46080/60000 [======================>.......] - ETA: 1s - loss: 0.1052 - acc: 0.9682
46720/60000 [======================>.......] - ETA: 1s - loss: 0.1049 - acc: 0.9682
47360/60000 [======================>.......] - ETA: 1s - loss: 0.1044 - acc: 0.9683
48000/60000 [=======================>......] - ETA: 0s - loss: 0.1038 - acc: 0.9685
48640/60000 [=======================>......] - ETA: 0s - loss: 0.1040 - acc: 0.9685
49280/60000 [=======================>......] - ETA: 0s - loss: 0.1042 - acc: 0.9686
50048/60000 [========================>.....] - ETA: 0s - loss: 0.1042 - acc: 0.9686
50688/60000 [========================>.....] - ETA: 0s - loss: 0.1039 - acc: 0.9688
51456/60000 [========================>.....] - ETA: 0s - loss: 0.1033 - acc: 0.9689
52096/60000 [=========================>....] - ETA: 0s - loss: 0.1032 - acc: 0.9690
52736/60000 [=========================>....] - ETA: 0s - loss: 0.1029 - acc: 0.9690
53376/60000 [=========================>....] - ETA: 0s - loss: 0.1031 - acc: 0.9690
54016/60000 [==========================>...] - ETA: 0s - loss: 0.1035 - acc: 0.9689
54656/60000 [==========================>...] - ETA: 0s - loss: 0.1037 - acc: 0.9688
55296/60000 [==========================>...] - ETA: 0s - loss: 0.1034 - acc: 0.9689
55936/60000 [==========================>...] - ETA: 0s - loss: 0.1033 - acc: 0.9689
56576/60000 [===========================>..] - ETA: 0s - loss: 0.1031 - acc: 0.9690
57216/60000 [===========================>..] - ETA: 0s - loss: 0.1026 - acc: 0.9691
57856/60000 [===========================>..] - ETA: 0s - loss: 0.1023 - acc: 0.9692
58496/60000 [============================>.] - ETA: 0s - loss: 0.1026 - acc: 0.9692
59136/60000 [============================>.] - ETA: 0s - loss: 0.1025 - acc: 0.9692
59904/60000 [============================>.] - ETA: 0s - loss: 0.1022 - acc: 0.9693
60000/60000 [==============================] - 5s 84us/step - loss: 0.1021 - acc: 0.9693 - val_loss: 0.0828 - val_acc: 0.9747
Epoch 3/10
128/60000 [..............................] - ETA: 5s - loss: 0.0365 - acc: 0.9844
768/60000 [..............................] - ETA: 5s - loss: 0.1053 - acc: 0.9688
1408/60000 [..............................] - ETA: 4s - loss: 0.0841 - acc: 0.9730
2048/60000 [>.............................] - ETA: 4s - loss: 0.0828 - acc: 0.9722
2688/60000 [>.............................] - ETA: 4s - loss: 0.0731 - acc: 0.9754
3456/60000 [>.............................] - ETA: 4s - loss: 0.0730 - acc: 0.9760
4096/60000 [=>............................] - ETA: 4s - loss: 0.0762 - acc: 0.9751
4736/60000 [=>............................] - ETA: 4s - loss: 0.0751 - acc: 0.9759
5376/60000 [=>............................] - ETA: 4s - loss: 0.0775 - acc: 0.9753
6016/60000 [==>...........................] - ETA: 4s - loss: 0.0760 - acc: 0.9756
6656/60000 [==>...........................] - ETA: 4s - loss: 0.0759 - acc: 0.9764
7296/60000 [==>...........................] - ETA: 4s - loss: 0.0745 - acc: 0.9766
7936/60000 [==>...........................] - ETA: 4s - loss: 0.0727 - acc: 0.9771
8576/60000 [===>..........................] - ETA: 4s - loss: 0.0733 - acc: 0.9770
9216/60000 [===>..........................] - ETA: 4s - loss: 0.0713 - acc: 0.9778
9856/60000 [===>..........................] - ETA: 4s - loss: 0.0708 - acc: 0.9780
10624/60000 [====>.........................] - ETA: 3s - loss: 0.0701 - acc: 0.9781
11264/60000 [====>.........................] - ETA: 3s - loss: 0.0710 - acc: 0.9778
11904/60000 [====>.........................] - ETA: 3s - loss: 0.0707 - acc: 0.9779
12544/60000 [=====>........................] - ETA: 3s - loss: 0.0725 - acc: 0.9779
13184/60000 [=====>........................] - ETA: 3s - loss: 0.0745 - acc: 0.9772
13824/60000 [=====>........................] - ETA: 3s - loss: 0.0738 - acc: 0.9776
14464/60000 [======>.......................] - ETA: 3s - loss: 0.0734 - acc: 0.9776
15104/60000 [======>.......................] - ETA: 3s - loss: 0.0726 - acc: 0.9780
15744/60000 [======>.......................] - ETA: 3s - loss: 0.0726 - acc: 0.9778
16384/60000 [=======>......................] - ETA: 3s - loss: 0.0732 - acc: 0.9778
17024/60000 [=======>......................] - ETA: 3s - loss: 0.0723 - acc: 0.9780
17664/60000 [=======>......................] - ETA: 3s - loss: 0.0732 - acc: 0.9777
18304/60000 [========>.....................] - ETA: 3s - loss: 0.0734 - acc: 0.9775
18944/60000 [========>.....................] - ETA: 3s - loss: 0.0738 - acc: 0.9774
19584/60000 [========>.....................] - ETA: 3s - loss: 0.0738 - acc: 0.9774
20224/60000 [=========>....................] - ETA: 3s - loss: 0.0740 - acc: 0.9775
20864/60000 [=========>....................] - ETA: 3s - loss: 0.0744 - acc: 0.9773
21632/60000 [=========>....................] - ETA: 3s - loss: 0.0750 - acc: 0.9770
22400/60000 [==========>...................] - ETA: 3s - loss: 0.0761 - acc: 0.9769
23040/60000 [==========>...................] - ETA: 2s - loss: 0.0765 - acc: 0.9766
23808/60000 [==========>...................] - ETA: 2s - loss: 0.0759 - acc: 0.9768
24576/60000 [===========>..................] - ETA: 2s - loss: 0.0758 - acc: 0.9766
25216/60000 [===========>..................] - ETA: 2s - loss: 0.0758 - acc: 0.9767
25856/60000 [===========>..................] - ETA: 2s - loss: 0.0767 - acc: 0.9766
26496/60000 [============>.................] - ETA: 2s - loss: 0.0767 - acc: 0.9766
27136/60000 [============>.................] - ETA: 2s - loss: 0.0766 - acc: 0.9766
27776/60000 [============>.................] - ETA: 2s - loss: 0.0767 - acc: 0.9765
28416/60000 [=============>................] - ETA: 2s - loss: 0.0763 - acc: 0.9766
29056/60000 [=============>................] - ETA: 2s - loss: 0.0767 - acc: 0.9766
29696/60000 [=============>................] - ETA: 2s - loss: 0.0764 - acc: 0.9767
30336/60000 [==============>...............] - ETA: 2s - loss: 0.0756 - acc: 0.9768
30976/60000 [==============>...............] - ETA: 2s - loss: 0.0754 - acc: 0.9769
31744/60000 [==============>...............] - ETA: 2s - loss: 0.0750 - acc: 0.9769
32384/60000 [===============>..............] - ETA: 2s - loss: 0.0751 - acc: 0.9768
33024/60000 [===============>..............] - ETA: 2s - loss: 0.0750 - acc: 0.9767
33792/60000 [===============>..............] - ETA: 2s - loss: 0.0746 - acc: 0.9768
34560/60000 [================>.............] - ETA: 2s - loss: 0.0742 - acc: 0.9769
35200/60000 [================>.............] - ETA: 1s - loss: 0.0746 - acc: 0.9766
35840/60000 [================>.............] - ETA: 1s - loss: 0.0747 - acc: 0.9767
36480/60000 [=================>............] - ETA: 1s - loss: 0.0752 - acc: 0.9766
37120/60000 [=================>............] - ETA: 1s - loss: 0.0754 - acc: 0.9767
37760/60000 [=================>............] - ETA: 1s - loss: 0.0750 - acc: 0.9769
38400/60000 [==================>...........] - ETA: 1s - loss: 0.0748 - acc: 0.9769
39040/60000 [==================>...........] - ETA: 1s - loss: 0.0747 - acc: 0.9768
39680/60000 [==================>...........] - ETA: 1s - loss: 0.0745 - acc: 0.9768
40320/60000 [===================>..........] - ETA: 1s - loss: 0.0746 - acc: 0.9769
40960/60000 [===================>..........] - ETA: 1s - loss: 0.0750 - acc: 0.9769
41600/60000 [===================>..........] - ETA: 1s - loss: 0.0752 - acc: 0.9768
42240/60000 [====================>.........] - ETA: 1s - loss: 0.0753 - acc: 0.9768
42880/60000 [====================>.........] - ETA: 1s - loss: 0.0750 - acc: 0.9769
43520/60000 [====================>.........] - ETA: 1s - loss: 0.0748 - acc: 0.9770
44160/60000 [=====================>........] - ETA: 1s - loss: 0.0746 - acc: 0.9770
44800/60000 [=====================>........] - ETA: 1s - loss: 0.0747 - acc: 0.9770
45440/60000 [=====================>........] - ETA: 1s - loss: 0.0743 - acc: 0.9771
46080/60000 [======================>.......] - ETA: 1s - loss: 0.0744 - acc: 0.9770
46720/60000 [======================>.......] - ETA: 1s - loss: 0.0747 - acc: 0.9770
47360/60000 [======================>.......] - ETA: 1s - loss: 0.0747 - acc: 0.9769
48000/60000 [=======================>......] - ETA: 0s - loss: 0.0744 - acc: 0.9770
48640/60000 [=======================>......] - ETA: 0s - loss: 0.0742 - acc: 0.9770
49280/60000 [=======================>......] - ETA: 0s - loss: 0.0743 - acc: 0.9770
49920/60000 [=======================>......] - ETA: 0s - loss: 0.0748 - acc: 0.9769
50560/60000 [========================>.....] - ETA: 0s - loss: 0.0748 - acc: 0.9768
51200/60000 [========================>.....] - ETA: 0s - loss: 0.0749 - acc: 0.9769
51840/60000 [========================>.....] - ETA: 0s - loss: 0.0749 - acc: 0.9769
52480/60000 [=========================>....] - ETA: 0s - loss: 0.0746 - acc: 0.9770
53120/60000 [=========================>....] - ETA: 0s - loss: 0.0745 - acc: 0.9771
53760/60000 [=========================>....] - ETA: 0s - loss: 0.0749 - acc: 0.9770
54400/60000 [==========================>...] - ETA: 0s - loss: 0.0749 - acc: 0.9770
55040/60000 [==========================>...] - ETA: 0s - loss: 0.0749 - acc: 0.9770
55680/60000 [==========================>...] - ETA: 0s - loss: 0.0751 - acc: 0.9770
56320/60000 [===========================>..] - ETA: 0s - loss: 0.0753 - acc: 0.9770
56960/60000 [===========================>..] - ETA: 0s - loss: 0.0750 - acc: 0.9771
57600/60000 [===========================>..] - ETA: 0s - loss: 0.0753 - acc: 0.9770
58240/60000 [============================>.] - ETA: 0s - loss: 0.0755 - acc: 0.9770
59008/60000 [============================>.] - ETA: 0s - loss: 0.0753 - acc: 0.9771
59776/60000 [============================>.] - ETA: 0s - loss: 0.0753 - acc: 0.9771
60000/60000 [==============================] - 5s 84us/step - loss: 0.0753 - acc: 0.9771 - val_loss: 0.0750 - val_acc: 0.9788
Epoch 4/10
128/60000 [..............................] - ETA: 5s - loss: 0.0300 - acc: 0.9844
768/60000 [..............................] - ETA: 5s - loss: 0.0479 - acc: 0.9844
1408/60000 [..............................] - ETA: 4s - loss: 0.0593 - acc: 0.9822
2048/60000 [>.............................] - ETA: 4s - loss: 0.0613 - acc: 0.9805
2688/60000 [>.............................] - ETA: 4s - loss: 0.0620 - acc: 0.9803
3328/60000 [>.............................] - ETA: 4s - loss: 0.0563 - acc: 0.9829
3968/60000 [>.............................] - ETA: 4s - loss: 0.0622 - acc: 0.9814
4608/60000 [=>............................] - ETA: 4s - loss: 0.0597 - acc: 0.9816
5248/60000 [=>............................] - ETA: 4s - loss: 0.0603 - acc: 0.9819
5888/60000 [=>............................] - ETA: 4s - loss: 0.0647 - acc: 0.9808
6528/60000 [==>...........................] - ETA: 4s - loss: 0.0660 - acc: 0.9802
7296/60000 [==>...........................] - ETA: 4s - loss: 0.0698 - acc: 0.9796
7936/60000 [==>...........................] - ETA: 4s - loss: 0.0675 - acc: 0.9801
8576/60000 [===>..........................] - ETA: 4s - loss: 0.0677 - acc: 0.9801
9216/60000 [===>..........................] - ETA: 4s - loss: 0.0659 - acc: 0.9806
9856/60000 [===>..........................] - ETA: 4s - loss: 0.0668 - acc: 0.9802
10496/60000 [====>.........................] - ETA: 4s - loss: 0.0670 - acc: 0.9799
11136/60000 [====>.........................] - ETA: 3s - loss: 0.0667 - acc: 0.9798
11776/60000 [====>.........................] - ETA: 3s - loss: 0.0659 - acc: 0.9801
12416/60000 [=====>........................] - ETA: 3s - loss: 0.0649 - acc: 0.9803
13056/60000 [=====>........................] - ETA: 3s - loss: 0.0638 - acc: 0.9807
13824/60000 [=====>........................] - ETA: 3s - loss: 0.0626 - acc: 0.9810
14464/60000 [======>.......................] - ETA: 3s - loss: 0.0616 - acc: 0.9812
15104/60000 [======>.......................] - ETA: 3s - loss: 0.0606 - acc: 0.9814
15744/60000 [======>.......................] - ETA: 3s - loss: 0.0608 - acc: 0.9813
16384/60000 [=======>......................] - ETA: 3s - loss: 0.0609 - acc: 0.9813
17152/60000 [=======>......................] - ETA: 3s - loss: 0.0608 - acc: 0.9813
17792/60000 [=======>......................] - ETA: 3s - loss: 0.0600 - acc: 0.9816
18432/60000 [========>.....................] - ETA: 3s - loss: 0.0591 - acc: 0.9818
19072/60000 [========>.....................] - ETA: 3s - loss: 0.0588 - acc: 0.9819
19840/60000 [========>.....................] - ETA: 3s - loss: 0.0600 - acc: 0.9815
20608/60000 [=========>....................] - ETA: 3s - loss: 0.0604 - acc: 0.9813
21376/60000 [=========>....................] - ETA: 3s - loss: 0.0612 - acc: 0.9813
22016/60000 [==========>...................] - ETA: 3s - loss: 0.0612 - acc: 0.9812
22784/60000 [==========>...................] - ETA: 2s - loss: 0.0607 - acc: 0.9813
23552/60000 [==========>...................] - ETA: 2s - loss: 0.0613 - acc: 0.9812
24192/60000 [===========>..................] - ETA: 2s - loss: 0.0610 - acc: 0.9813
24960/60000 [===========>..................] - ETA: 2s - loss: 0.0603 - acc: 0.9815
25472/60000 [===========>..................] - ETA: 2s - loss: 0.0599 - acc: 0.9814
26112/60000 [============>.................] - ETA: 2s - loss: 0.0599 - acc: 0.9815
26752/60000 [============>.................] - ETA: 2s - loss: 0.0604 - acc: 0.9812
27392/60000 [============>.................] - ETA: 2s - loss: 0.0609 - acc: 0.9811
28032/60000 [=============>................] - ETA: 2s - loss: 0.0608 - acc: 0.9811
28672/60000 [=============>................] - ETA: 2s - loss: 0.0605 - acc: 0.9812
29440/60000 [=============>................] - ETA: 2s - loss: 0.0610 - acc: 0.9811
30208/60000 [==============>...............] - ETA: 2s - loss: 0.0609 - acc: 0.9812
30848/60000 [==============>...............] - ETA: 2s - loss: 0.0604 - acc: 0.9813
31488/60000 [==============>...............] - ETA: 2s - loss: 0.0606 - acc: 0.9814
32128/60000 [===============>..............] - ETA: 2s - loss: 0.0605 - acc: 0.9814
32768/60000 [===============>..............] - ETA: 2s - loss: 0.0609 - acc: 0.9814
33408/60000 [===============>..............] - ETA: 2s - loss: 0.0609 - acc: 0.9814
34176/60000 [================>.............] - ETA: 2s - loss: 0.0604 - acc: 0.9815
34816/60000 [================>.............] - ETA: 2s - loss: 0.0603 - acc: 0.9815
35456/60000 [================>.............] - ETA: 1s - loss: 0.0602 - acc: 0.9816
36224/60000 [=================>............] - ETA: 1s - loss: 0.0600 - acc: 0.9816
36736/60000 [=================>............] - ETA: 1s - loss: 0.0601 - acc: 0.9814
37504/60000 [=================>............] - ETA: 1s - loss: 0.0603 - acc: 0.9814
38272/60000 [==================>...........] - ETA: 1s - loss: 0.0610 - acc: 0.9813
38912/60000 [==================>...........] - ETA: 1s - loss: 0.0605 - acc: 0.9814
39552/60000 [==================>...........] - ETA: 1s - loss: 0.0605 - acc: 0.9815
40320/60000 [===================>..........] - ETA: 1s - loss: 0.0604 - acc: 0.9815
40960/60000 [===================>..........] - ETA: 1s - loss: 0.0603 - acc: 0.9815
41600/60000 [===================>..........] - ETA: 1s - loss: 0.0604 - acc: 0.9815
42240/60000 [====================>.........] - ETA: 1s - loss: 0.0601 - acc: 0.9816
42880/60000 [====================>.........] - ETA: 1s - loss: 0.0598 - acc: 0.9816
43520/60000 [====================>.........] - ETA: 1s - loss: 0.0595 - acc: 0.9816
44160/60000 [=====================>........] - ETA: 1s - loss: 0.0597 - acc: 0.9815
44928/60000 [=====================>........] - ETA: 1s - loss: 0.0597 - acc: 0.9816
45696/60000 [=====================>........] - ETA: 1s - loss: 0.0603 - acc: 0.9814
46464/60000 [======================>.......] - ETA: 1s - loss: 0.0604 - acc: 0.9814
47232/60000 [======================>.......] - ETA: 1s - loss: 0.0602 - acc: 0.9815
47872/60000 [======================>.......] - ETA: 0s - loss: 0.0601 - acc: 0.9815
48512/60000 [=======================>......] - ETA: 0s - loss: 0.0597 - acc: 0.9816
49152/60000 [=======================>......] - ETA: 0s - loss: 0.0598 - acc: 0.9815
49792/60000 [=======================>......] - ETA: 0s - loss: 0.0592 - acc: 0.9817
50560/60000 [========================>.....] - ETA: 0s - loss: 0.0593 - acc: 0.9816
51200/60000 [========================>.....] - ETA: 0s - loss: 0.0596 - acc: 0.9816
51968/60000 [========================>.....] - ETA: 0s - loss: 0.0595 - acc: 0.9816
52608/60000 [=========================>....] - ETA: 0s - loss: 0.0598 - acc: 0.9814
53120/60000 [=========================>....] - ETA: 0s - loss: 0.0599 - acc: 0.9814
53888/60000 [=========================>....] - ETA: 0s - loss: 0.0602 - acc: 0.9812
54656/60000 [==========================>...] - ETA: 0s - loss: 0.0605 - acc: 0.9812
55296/60000 [==========================>...] - ETA: 0s - loss: 0.0601 - acc: 0.9813
55936/60000 [==========================>...] - ETA: 0s - loss: 0.0598 - acc: 0.9813
56704/60000 [===========================>..] - ETA: 0s - loss: 0.0600 - acc: 0.9814
57472/60000 [===========================>..] - ETA: 0s - loss: 0.0602 - acc: 0.9813
58112/60000 [============================>.] - ETA: 0s - loss: 0.0600 - acc: 0.9813
58752/60000 [============================>.] - ETA: 0s - loss: 0.0603 - acc: 0.9813
59392/60000 [============================>.] - ETA: 0s - loss: 0.0603 - acc: 0.9813
60000/60000 [==============================] - 5s 83us/step - loss: 0.0603 - acc: 0.9813 - val_loss: 0.0952 - val_acc: 0.9742
Epoch 5/10
128/60000 [..............................] - ETA: 4s - loss: 0.0688 - acc: 0.9766
768/60000 [..............................] - ETA: 4s - loss: 0.0358 - acc: 0.9896
1280/60000 [..............................] - ETA: 5s - loss: 0.0397 - acc: 0.9867
2048/60000 [>.............................] - ETA: 4s - loss: 0.0489 - acc: 0.9839
2816/60000 [>.............................] - ETA: 4s - loss: 0.0541 - acc: 0.9830
3456/60000 [>.............................] - ETA: 4s - loss: 0.0506 - acc: 0.9844
4224/60000 [=>............................] - ETA: 4s - loss: 0.0484 - acc: 0.9848
4864/60000 [=>............................] - ETA: 4s - loss: 0.0469 - acc: 0.9852
5632/60000 [=>............................] - ETA: 4s - loss: 0.0458 - acc: 0.9858
6272/60000 [==>...........................] - ETA: 4s - loss: 0.0432 - acc: 0.9868
6912/60000 [==>...........................] - ETA: 4s - loss: 0.0468 - acc: 0.9861
7552/60000 [==>...........................] - ETA: 4s - loss: 0.0496 - acc: 0.9853
8320/60000 [===>..........................] - ETA: 4s - loss: 0.0521 - acc: 0.9852
8960/60000 [===>..........................] - ETA: 4s - loss: 0.0504 - acc: 0.9855
9600/60000 [===>..........................] - ETA: 4s - loss: 0.0509 - acc: 0.9852
10240/60000 [====>.........................] - ETA: 3s - loss: 0.0535 - acc: 0.9849
10880/60000 [====>.........................] - ETA: 3s - loss: 0.0515 - acc: 0.9853
11520/60000 [====>.........................] - ETA: 3s - loss: 0.0517 - acc: 0.9849
12160/60000 [=====>........................] - ETA: 3s - loss: 0.0515 - acc: 0.9849
12800/60000 [=====>........................] - ETA: 3s - loss: 0.0512 - acc: 0.9850
13440/60000 [=====>........................] - ETA: 3s - loss: 0.0502 - acc: 0.9850
14208/60000 [======>.......................] - ETA: 3s - loss: 0.0513 - acc: 0.9844
14848/60000 [======>.......................] - ETA: 3s - loss: 0.0514 - acc: 0.9844
15488/60000 [======>.......................] - ETA: 3s - loss: 0.0517 - acc: 0.9843
16128/60000 [=======>......................] - ETA: 3s - loss: 0.0511 - acc: 0.9844
16896/60000 [=======>......................] - ETA: 3s - loss: 0.0502 - acc: 0.9848
17536/60000 [=======>......................] - ETA: 3s - loss: 0.0511 - acc: 0.9848
18176/60000 [========>.....................] - ETA: 3s - loss: 0.0516 - acc: 0.9848
18816/60000 [========>.....................] - ETA: 3s - loss: 0.0513 - acc: 0.9846
19456/60000 [========>.....................] - ETA: 3s - loss: 0.0515 - acc: 0.9845
20224/60000 [=========>....................] - ETA: 3s - loss: 0.0513 - acc: 0.9845
20992/60000 [=========>....................] - ETA: 3s - loss: 0.0506 - acc: 0.9848
21632/60000 [=========>....................] - ETA: 3s - loss: 0.0506 - acc: 0.9848
22272/60000 [==========>...................] - ETA: 3s - loss: 0.0502 - acc: 0.9847
23040/60000 [==========>...................] - ETA: 2s - loss: 0.0506 - acc: 0.9847
23808/60000 [==========>...................] - ETA: 2s - loss: 0.0502 - acc: 0.9848
24448/60000 [===========>..................] - ETA: 2s - loss: 0.0508 - acc: 0.9847
25216/60000 [===========>..................] - ETA: 2s - loss: 0.0499 - acc: 0.9849
25856/60000 [===========>..................] - ETA: 2s - loss: 0.0495 - acc: 0.9850
26496/60000 [============>.................] - ETA: 2s - loss: 0.0497 - acc: 0.9850
27136/60000 [============>.................] - ETA: 2s - loss: 0.0497 - acc: 0.9850
27776/60000 [============>.................] - ETA: 2s - loss: 0.0496 - acc: 0.9849
28416/60000 [=============>................] - ETA: 2s - loss: 0.0496 - acc: 0.9849
29056/60000 [=============>................] - ETA: 2s - loss: 0.0496 - acc: 0.9849
29696/60000 [=============>................] - ETA: 2s - loss: 0.0497 - acc: 0.9847
30336/60000 [==============>...............] - ETA: 2s - loss: 0.0497 - acc: 0.9848
30976/60000 [==============>...............] - ETA: 2s - loss: 0.0500 - acc: 0.9848
31616/60000 [==============>...............] - ETA: 2s - loss: 0.0497 - acc: 0.9848
32256/60000 [===============>..............] - ETA: 2s - loss: 0.0495 - acc: 0.9849
32896/60000 [===============>..............] - ETA: 2s - loss: 0.0493 - acc: 0.9850
33536/60000 [===============>..............] - ETA: 2s - loss: 0.0490 - acc: 0.9850
34176/60000 [================>.............] - ETA: 2s - loss: 0.0497 - acc: 0.9848
34816/60000 [================>.............] - ETA: 2s - loss: 0.0504 - acc: 0.9847
35584/60000 [================>.............] - ETA: 1s - loss: 0.0505 - acc: 0.9847
36352/60000 [=================>............] - ETA: 1s - loss: 0.0503 - acc: 0.9846
36992/60000 [=================>............] - ETA: 1s - loss: 0.0504 - acc: 0.9846
37632/60000 [=================>............] - ETA: 1s - loss: 0.0499 - acc: 0.9847
38400/60000 [==================>...........] - ETA: 1s - loss: 0.0500 - acc: 0.9847
39168/60000 [==================>...........] - ETA: 1s - loss: 0.0498 - acc: 0.9848
39936/60000 [==================>...........] - ETA: 1s - loss: 0.0496 - acc: 0.9849
40576/60000 [===================>..........] - ETA: 1s - loss: 0.0496 - acc: 0.9848
41216/60000 [===================>..........] - ETA: 1s - loss: 0.0496 - acc: 0.9848
41856/60000 [===================>..........] - ETA: 1s - loss: 0.0496 - acc: 0.9848
42496/60000 [====================>.........] - ETA: 1s - loss: 0.0495 - acc: 0.9848
43136/60000 [====================>.........] - ETA: 1s - loss: 0.0496 - acc: 0.9848
43776/60000 [====================>.........] - ETA: 1s - loss: 0.0497 - acc: 0.9849
44416/60000 [=====================>........] - ETA: 1s - loss: 0.0497 - acc: 0.9848
45056/60000 [=====================>........] - ETA: 1s - loss: 0.0498 - acc: 0.9848
45696/60000 [=====================>........] - ETA: 1s - loss: 0.0499 - acc: 0.9847
46464/60000 [======================>.......] - ETA: 1s - loss: 0.0501 - acc: 0.9847
47232/60000 [======================>.......] - ETA: 1s - loss: 0.0506 - acc: 0.9847
47872/60000 [======================>.......] - ETA: 0s - loss: 0.0509 - acc: 0.9846
48512/60000 [=======================>......] - ETA: 0s - loss: 0.0515 - acc: 0.9845
49152/60000 [=======================>......] - ETA: 0s - loss: 0.0518 - acc: 0.9845
49792/60000 [=======================>......] - ETA: 0s - loss: 0.0519 - acc: 0.9845
50432/60000 [========================>.....] - ETA: 0s - loss: 0.0520 - acc: 0.9845
51072/60000 [========================>.....] - ETA: 0s - loss: 0.0521 - acc: 0.9845
51712/60000 [========================>.....] - ETA: 0s - loss: 0.0521 - acc: 0.9845
52480/60000 [=========================>....] - ETA: 0s - loss: 0.0523 - acc: 0.9844
53120/60000 [=========================>....] - ETA: 0s - loss: 0.0520 - acc: 0.9844
53760/60000 [=========================>....] - ETA: 0s - loss: 0.0521 - acc: 0.9844
54400/60000 [==========================>...] - ETA: 0s - loss: 0.0523 - acc: 0.9843
55040/60000 [==========================>...] - ETA: 0s - loss: 0.0522 - acc: 0.9844
55680/60000 [==========================>...] - ETA: 0s - loss: 0.0519 - acc: 0.9845
56320/60000 [===========================>..] - ETA: 0s - loss: 0.0517 - acc: 0.9845
56960/60000 [===========================>..] - ETA: 0s - loss: 0.0520 - acc: 0.9844
57600/60000 [===========================>..] - ETA: 0s - loss: 0.0520 - acc: 0.9844
58368/60000 [============================>.] - ETA: 0s - loss: 0.0520 - acc: 0.9844
59136/60000 [============================>.] - ETA: 0s - loss: 0.0517 - acc: 0.9844
59776/60000 [============================>.] - ETA: 0s - loss: 0.0518 - acc: 0.9843
60000/60000 [==============================] - 5s 84us/step - loss: 0.0517 - acc: 0.9843 - val_loss: 0.0776 - val_acc: 0.9790
Epoch 6/10
128/60000 [..............................] - ETA: 9s - loss: 0.0051 - acc: 1.0000
768/60000 [..............................] - ETA: 5s - loss: 0.0280 - acc: 0.9922
1408/60000 [..............................] - ETA: 5s - loss: 0.0356 - acc: 0.9908
2048/60000 [>.............................] - ETA: 5s - loss: 0.0390 - acc: 0.9893
2688/60000 [>.............................] - ETA: 4s - loss: 0.0399 - acc: 0.9892
3328/60000 [>.............................] - ETA: 4s - loss: 0.0415 - acc: 0.9883
4096/60000 [=>............................] - ETA: 4s - loss: 0.0413 - acc: 0.9873
4736/60000 [=>............................] - ETA: 4s - loss: 0.0431 - acc: 0.9859
5504/60000 [=>............................] - ETA: 4s - loss: 0.0461 - acc: 0.9855
6144/60000 [==>...........................] - ETA: 4s - loss: 0.0472 - acc: 0.9855
6912/60000 [==>...........................] - ETA: 4s - loss: 0.0475 - acc: 0.9855
7680/60000 [==>...........................] - ETA: 4s - loss: 0.0472 - acc: 0.9855
8448/60000 [===>..........................] - ETA: 4s - loss: 0.0468 - acc: 0.9857
9088/60000 [===>..........................] - ETA: 4s - loss: 0.0447 - acc: 0.9864
9728/60000 [===>..........................] - ETA: 4s - loss: 0.0435 - acc: 0.9866
10496/60000 [====>.........................] - ETA: 3s - loss: 0.0429 - acc: 0.9867
11264/60000 [====>.........................] - ETA: 3s - loss: 0.0436 - acc: 0.9867
11904/60000 [====>.........................] - ETA: 3s - loss: 0.0442 - acc: 0.9865
12544/60000 [=====>........................] - ETA: 3s - loss: 0.0445 - acc: 0.9864
13184/60000 [=====>........................] - ETA: 3s - loss: 0.0431 - acc: 0.9868
13824/60000 [=====>........................] - ETA: 3s - loss: 0.0428 - acc: 0.9870
14592/60000 [======>.......................] - ETA: 3s - loss: 0.0420 - acc: 0.9870
15232/60000 [======>.......................] - ETA: 3s - loss: 0.0431 - acc: 0.9869
16000/60000 [=======>......................] - ETA: 3s - loss: 0.0436 - acc: 0.9867
16768/60000 [=======>......................] - ETA: 3s - loss: 0.0431 - acc: 0.9869
17536/60000 [=======>......................] - ETA: 3s - loss: 0.0427 - acc: 0.9868
18176/60000 [========>.....................] - ETA: 3s - loss: 0.0428 - acc: 0.9866
18944/60000 [========>.....................] - ETA: 3s - loss: 0.0423 - acc: 0.9867
19584/60000 [========>.....................] - ETA: 3s - loss: 0.0419 - acc: 0.9868
20224/60000 [=========>....................] - ETA: 3s - loss: 0.0415 - acc: 0.9868
20864/60000 [=========>....................] - ETA: 3s - loss: 0.0425 - acc: 0.9866
21632/60000 [=========>....................] - ETA: 3s - loss: 0.0424 - acc: 0.9865
22272/60000 [==========>...................] - ETA: 3s - loss: 0.0421 - acc: 0.9866
23040/60000 [==========>...................] - ETA: 2s - loss: 0.0416 - acc: 0.9867
23808/60000 [==========>...................] - ETA: 2s - loss: 0.0417 - acc: 0.9865
24576/60000 [===========>..................] - ETA: 2s - loss: 0.0416 - acc: 0.9867
25216/60000 [===========>..................] - ETA: 2s - loss: 0.0414 - acc: 0.9869
25856/60000 [===========>..................] - ETA: 2s - loss: 0.0423 - acc: 0.9868
26496/60000 [============>.................] - ETA: 2s - loss: 0.0426 - acc: 0.9867
27264/60000 [============>.................] - ETA: 2s - loss: 0.0423 - acc: 0.9867
28032/60000 [=============>................] - ETA: 2s - loss: 0.0419 - acc: 0.9867
28672/60000 [=============>................] - ETA: 2s - loss: 0.0430 - acc: 0.9867
29440/60000 [=============>................] - ETA: 2s - loss: 0.0435 - acc: 0.9865
30208/60000 [==============>...............] - ETA: 2s - loss: 0.0430 - acc: 0.9868
30848/60000 [==============>...............] - ETA: 2s - loss: 0.0428 - acc: 0.9868
31488/60000 [==============>...............] - ETA: 2s - loss: 0.0431 - acc: 0.9868
32256/60000 [===============>..............] - ETA: 2s - loss: 0.0427 - acc: 0.9869
32896/60000 [===============>..............] - ETA: 2s - loss: 0.0430 - acc: 0.9867
33536/60000 [===============>..............] - ETA: 2s - loss: 0.0429 - acc: 0.9867
34176/60000 [================>.............] - ETA: 2s - loss: 0.0429 - acc: 0.9867
34816/60000 [================>.............] - ETA: 2s - loss: 0.0429 - acc: 0.9866
35456/60000 [================>.............] - ETA: 1s - loss: 0.0423 - acc: 0.9868
36096/60000 [=================>............] - ETA: 1s - loss: 0.0422 - acc: 0.9867
36864/60000 [=================>............] - ETA: 1s - loss: 0.0420 - acc: 0.9867
37632/60000 [=================>............] - ETA: 1s - loss: 0.0419 - acc: 0.9867
38272/60000 [==================>...........] - ETA: 1s - loss: 0.0420 - acc: 0.9866
38912/60000 [==================>...........] - ETA: 1s - loss: 0.0423 - acc: 0.9866
39680/60000 [==================>...........] - ETA: 1s - loss: 0.0421 - acc: 0.9867
40320/60000 [===================>..........] - ETA: 1s - loss: 0.0423 - acc: 0.9867
40960/60000 [===================>..........] - ETA: 1s - loss: 0.0422 - acc: 0.9866
41600/60000 [===================>..........] - ETA: 1s - loss: 0.0429 - acc: 0.9864
42240/60000 [====================>.........] - ETA: 1s - loss: 0.0435 - acc: 0.9863
42880/60000 [====================>.........] - ETA: 1s - loss: 0.0432 - acc: 0.9864
43520/60000 [====================>.........] - ETA: 1s - loss: 0.0428 - acc: 0.9865
44160/60000 [=====================>........] - ETA: 1s - loss: 0.0429 - acc: 0.9865
44800/60000 [=====================>........] - ETA: 1s - loss: 0.0429 - acc: 0.9864
45440/60000 [=====================>........] - ETA: 1s - loss: 0.0432 - acc: 0.9864
46080/60000 [======================>.......] - ETA: 1s - loss: 0.0434 - acc: 0.9863
46720/60000 [======================>.......] - ETA: 1s - loss: 0.0433 - acc: 0.9862
47360/60000 [======================>.......] - ETA: 1s - loss: 0.0429 - acc: 0.9864
48128/60000 [=======================>......] - ETA: 0s - loss: 0.0429 - acc: 0.9864
48896/60000 [=======================>......] - ETA: 0s - loss: 0.0427 - acc: 0.9865
49536/60000 [=======================>......] - ETA: 0s - loss: 0.0425 - acc: 0.9866
50176/60000 [========================>.....] - ETA: 0s - loss: 0.0425 - acc: 0.9865
50816/60000 [========================>.....] - ETA: 0s - loss: 0.0422 - acc: 0.9866
51456/60000 [========================>.....] - ETA: 0s - loss: 0.0424 - acc: 0.9866
52096/60000 [=========================>....] - ETA: 0s - loss: 0.0424 - acc: 0.9866
52864/60000 [=========================>....] - ETA: 0s - loss: 0.0424 - acc: 0.9866
53632/60000 [=========================>....] - ETA: 0s - loss: 0.0426 - acc: 0.9866
54272/60000 [==========================>...] - ETA: 0s - loss: 0.0430 - acc: 0.9865
54912/60000 [==========================>...] - ETA: 0s - loss: 0.0436 - acc: 0.9863
55552/60000 [==========================>...] - ETA: 0s - loss: 0.0435 - acc: 0.9864
56192/60000 [===========================>..] - ETA: 0s - loss: 0.0435 - acc: 0.9863
56960/60000 [===========================>..] - ETA: 0s - loss: 0.0437 - acc: 0.9863
57728/60000 [===========================>..] - ETA: 0s - loss: 0.0436 - acc: 0.9863
58496/60000 [============================>.] - ETA: 0s - loss: 0.0436 - acc: 0.9863
59264/60000 [============================>.] - ETA: 0s - loss: 0.0435 - acc: 0.9863
59904/60000 [============================>.] - ETA: 0s - loss: 0.0435 - acc: 0.9863
60000/60000 [==============================] - 5s 83us/step - loss: 0.0436 - acc: 0.9863 - val_loss: 0.0800 - val_acc: 0.9815
Epoch 7/10
128/60000 [..............................] - ETA: 4s - loss: 0.1485 - acc: 0.9766
768/60000 [..............................] - ETA: 5s - loss: 0.0470 - acc: 0.9883
1408/60000 [..............................] - ETA: 4s - loss: 0.0308 - acc: 0.9915
2048/60000 [>.............................] - ETA: 4s - loss: 0.0301 - acc: 0.9907
2816/60000 [>.............................] - ETA: 4s - loss: 0.0308 - acc: 0.9908
3456/60000 [>.............................] - ETA: 4s - loss: 0.0312 - acc: 0.9913
4224/60000 [=>............................] - ETA: 4s - loss: 0.0323 - acc: 0.9905
4992/60000 [=>............................] - ETA: 4s - loss: 0.0319 - acc: 0.9906
5760/60000 [=>............................] - ETA: 4s - loss: 0.0330 - acc: 0.9901
6528/60000 [==>...........................] - ETA: 4s - loss: 0.0327 - acc: 0.9903
7296/60000 [==>...........................] - ETA: 4s - loss: 0.0337 - acc: 0.9897
7936/60000 [==>...........................] - ETA: 4s - loss: 0.0343 - acc: 0.9893
8576/60000 [===>..........................] - ETA: 4s - loss: 0.0341 - acc: 0.9894
9344/60000 [===>..........................] - ETA: 4s - loss: 0.0352 - acc: 0.9891
10112/60000 [====>.........................] - ETA: 3s - loss: 0.0348 - acc: 0.9892
10752/60000 [====>.........................] - ETA: 3s - loss: 0.0342 - acc: 0.9892
11520/60000 [====>.........................] - ETA: 3s - loss: 0.0337 - acc: 0.9893
12288/60000 [=====>........................] - ETA: 3s - loss: 0.0331 - acc: 0.9896
12928/60000 [=====>........................] - ETA: 3s - loss: 0.0326 - acc: 0.9898
13568/60000 [=====>........................] - ETA: 3s - loss: 0.0339 - acc: 0.9895
14336/60000 [======>.......................] - ETA: 3s - loss: 0.0355 - acc: 0.9890
15104/60000 [======>.......................] - ETA: 3s - loss: 0.0358 - acc: 0.9890
15616/60000 [======>.......................] - ETA: 3s - loss: 0.0356 - acc: 0.9890
16384/60000 [=======>......................] - ETA: 3s - loss: 0.0368 - acc: 0.9888
17024/60000 [=======>......................] - ETA: 3s - loss: 0.0357 - acc: 0.9891
17664/60000 [=======>......................] - ETA: 3s - loss: 0.0359 - acc: 0.9892
18304/60000 [========>.....................] - ETA: 3s - loss: 0.0361 - acc: 0.9891
18944/60000 [========>.....................] - ETA: 3s - loss: 0.0358 - acc: 0.9892
19584/60000 [========>.....................] - ETA: 3s - loss: 0.0348 - acc: 0.9895
20224/60000 [=========>....................] - ETA: 3s - loss: 0.0358 - acc: 0.9895
20992/60000 [=========>....................] - ETA: 3s - loss: 0.0358 - acc: 0.9896
21632/60000 [=========>....................] - ETA: 3s - loss: 0.0358 - acc: 0.9896
22272/60000 [==========>...................] - ETA: 3s - loss: 0.0359 - acc: 0.9896
22912/60000 [==========>...................] - ETA: 2s - loss: 0.0361 - acc: 0.9896
23552/60000 [==========>...................] - ETA: 2s - loss: 0.0359 - acc: 0.9896
24192/60000 [===========>..................] - ETA: 2s - loss: 0.0355 - acc: 0.9896
24832/60000 [===========>..................] - ETA: 2s - loss: 0.0355 - acc: 0.9896
25344/60000 [===========>..................] - ETA: 2s - loss: 0.0364 - acc: 0.9894
25984/60000 [===========>..................] - ETA: 2s - loss: 0.0362 - acc: 0.9895
26624/60000 [============>.................] - ETA: 2s - loss: 0.0365 - acc: 0.9894
27264/60000 [============>.................] - ETA: 2s - loss: 0.0361 - acc: 0.9895
27904/60000 [============>.................] - ETA: 2s - loss: 0.0360 - acc: 0.9895
28544/60000 [=============>................] - ETA: 2s - loss: 0.0362 - acc: 0.9895
29184/60000 [=============>................] - ETA: 2s - loss: 0.0365 - acc: 0.9893
29824/60000 [=============>................] - ETA: 2s - loss: 0.0365 - acc: 0.9893
30464/60000 [==============>...............] - ETA: 2s - loss: 0.0363 - acc: 0.9893
31104/60000 [==============>...............] - ETA: 2s - loss: 0.0366 - acc: 0.9892
31744/60000 [==============>...............] - ETA: 2s - loss: 0.0368 - acc: 0.9890
32384/60000 [===============>..............] - ETA: 2s - loss: 0.0371 - acc: 0.9889
33024/60000 [===============>..............] - ETA: 2s - loss: 0.0379 - acc: 0.9889
33664/60000 [===============>..............] - ETA: 2s - loss: 0.0377 - acc: 0.9889
34304/60000 [================>.............] - ETA: 2s - loss: 0.0380 - acc: 0.9887
34944/60000 [================>.............] - ETA: 2s - loss: 0.0383 - acc: 0.9886
35584/60000 [================>.............] - ETA: 1s - loss: 0.0382 - acc: 0.9885
36224/60000 [=================>............] - ETA: 1s - loss: 0.0378 - acc: 0.9886
36864/60000 [=================>............] - ETA: 1s - loss: 0.0375 - acc: 0.9886
37504/60000 [=================>............] - ETA: 1s - loss: 0.0374 - acc: 0.9887
38144/60000 [==================>...........] - ETA: 1s - loss: 0.0371 - acc: 0.9888
38784/60000 [==================>...........] - ETA: 1s - loss: 0.0374 - acc: 0.9888
39424/60000 [==================>...........] - ETA: 1s - loss: 0.0370 - acc: 0.9888
40064/60000 [===================>..........] - ETA: 1s - loss: 0.0373 - acc: 0.9888
40704/60000 [===================>..........] - ETA: 1s - loss: 0.0377 - acc: 0.9887
41344/60000 [===================>..........] - ETA: 1s - loss: 0.0375 - acc: 0.9888
41984/60000 [===================>..........] - ETA: 1s - loss: 0.0375 - acc: 0.9888
42624/60000 [====================>.........] - ETA: 1s - loss: 0.0377 - acc: 0.9887
43264/60000 [====================>.........] - ETA: 1s - loss: 0.0377 - acc: 0.9888
43904/60000 [====================>.........] - ETA: 1s - loss: 0.0375 - acc: 0.9888
44672/60000 [=====================>........] - ETA: 1s - loss: 0.0375 - acc: 0.9888
45312/60000 [=====================>........] - ETA: 1s - loss: 0.0379 - acc: 0.9887
46080/60000 [======================>.......] - ETA: 1s - loss: 0.0385 - acc: 0.9886
46720/60000 [======================>.......] - ETA: 1s - loss: 0.0385 - acc: 0.9886
47488/60000 [======================>.......] - ETA: 1s - loss: 0.0394 - acc: 0.9885
48128/60000 [=======================>......] - ETA: 0s - loss: 0.0398 - acc: 0.9884
48768/60000 [=======================>......] - ETA: 0s - loss: 0.0395 - acc: 0.9884
49408/60000 [=======================>......] - ETA: 0s - loss: 0.0396 - acc: 0.9884
50048/60000 [========================>.....] - ETA: 0s - loss: 0.0395 - acc: 0.9885
50688/60000 [========================>.....] - ETA: 0s - loss: 0.0394 - acc: 0.9885
51328/60000 [========================>.....] - ETA: 0s - loss: 0.0394 - acc: 0.9885
51968/60000 [========================>.....] - ETA: 0s - loss: 0.0392 - acc: 0.9885
52608/60000 [=========================>....] - ETA: 0s - loss: 0.0389 - acc: 0.9885
53248/60000 [=========================>....] - ETA: 0s - loss: 0.0389 - acc: 0.9886
53888/60000 [=========================>....] - ETA: 0s - loss: 0.0388 - acc: 0.9886
54528/60000 [==========================>...] - ETA: 0s - loss: 0.0388 - acc: 0.9886
55168/60000 [==========================>...] - ETA: 0s - loss: 0.0389 - acc: 0.9886
55808/60000 [==========================>...] - ETA: 0s - loss: 0.0389 - acc: 0.9887
56448/60000 [===========================>..] - ETA: 0s - loss: 0.0387 - acc: 0.9887
57088/60000 [===========================>..] - ETA: 0s - loss: 0.0385 - acc: 0.9887
57728/60000 [===========================>..] - ETA: 0s - loss: 0.0389 - acc: 0.9886
58368/60000 [============================>.] - ETA: 0s - loss: 0.0390 - acc: 0.9886
59008/60000 [============================>.] - ETA: 0s - loss: 0.0390 - acc: 0.9886
59648/60000 [============================>.] - ETA: 0s - loss: 0.0393 - acc: 0.9885
60000/60000 [==============================] - 5s 84us/step - loss: 0.0392 - acc: 0.9886 - val_loss: 0.0777 - val_acc: 0.9816
Epoch 8/10
128/60000 [..............................] - ETA: 5s - loss: 0.0126 - acc: 0.9922
768/60000 [..............................] - ETA: 4s - loss: 0.0182 - acc: 0.9922
1408/60000 [..............................] - ETA: 4s - loss: 0.0144 - acc: 0.9950
2048/60000 [>.............................] - ETA: 4s - loss: 0.0166 - acc: 0.9937
2688/60000 [>.............................] - ETA: 4s - loss: 0.0207 - acc: 0.9926
3328/60000 [>.............................] - ETA: 4s - loss: 0.0189 - acc: 0.9931
3968/60000 [>.............................] - ETA: 4s - loss: 0.0180 - acc: 0.9940
4608/60000 [=>............................] - ETA: 4s - loss: 0.0195 - acc: 0.9937
5248/60000 [=>............................] - ETA: 4s - loss: 0.0189 - acc: 0.9939
5888/60000 [=>............................] - ETA: 4s - loss: 0.0186 - acc: 0.9939
6528/60000 [==>...........................] - ETA: 4s - loss: 0.0202 - acc: 0.9933
7296/60000 [==>...........................] - ETA: 4s - loss: 0.0200 - acc: 0.9933
8064/60000 [===>..........................] - ETA: 4s - loss: 0.0209 - acc: 0.9928
8832/60000 [===>..........................] - ETA: 4s - loss: 0.0210 - acc: 0.9928
9600/60000 [===>..........................] - ETA: 4s - loss: 0.0230 - acc: 0.9922
10368/60000 [====>.........................] - ETA: 3s - loss: 0.0248 - acc: 0.9919
11136/60000 [====>.........................] - ETA: 3s - loss: 0.0245 - acc: 0.9921
11776/60000 [====>.........................] - ETA: 3s - loss: 0.0262 - acc: 0.9920
12416/60000 [=====>........................] - ETA: 3s - loss: 0.0281 - acc: 0.9915
13056/60000 [=====>........................] - ETA: 3s - loss: 0.0284 - acc: 0.9916
13696/60000 [=====>........................] - ETA: 3s - loss: 0.0287 - acc: 0.9913
14336/60000 [======>.......................] - ETA: 3s - loss: 0.0286 - acc: 0.9914
14976/60000 [======>.......................] - ETA: 3s - loss: 0.0290 - acc: 0.9913
15744/60000 [======>.......................] - ETA: 3s - loss: 0.0287 - acc: 0.9915
16384/60000 [=======>......................] - ETA: 3s - loss: 0.0287 - acc: 0.9914
17024/60000 [=======>......................] - ETA: 3s - loss: 0.0298 - acc: 0.9914
17792/60000 [=======>......................] - ETA: 3s - loss: 0.0300 - acc: 0.9912
18560/60000 [========>.....................] - ETA: 3s - loss: 0.0299 - acc: 0.9912
19200/60000 [========>.....................] - ETA: 3s - loss: 0.0300 - acc: 0.9912
19840/60000 [========>.....................] - ETA: 3s - loss: 0.0296 - acc: 0.9914
20736/60000 [=========>....................] - ETA: 3s - loss: 0.0291 - acc: 0.9915
21504/60000 [=========>....................] - ETA: 3s - loss: 0.0288 - acc: 0.9916
22272/60000 [==========>...................] - ETA: 2s - loss: 0.0291 - acc: 0.9915
22912/60000 [==========>...................] - ETA: 2s - loss: 0.0293 - acc: 0.9915
23680/60000 [==========>...................] - ETA: 2s - loss: 0.0288 - acc: 0.9916
24320/60000 [===========>..................] - ETA: 2s - loss: 0.0289 - acc: 0.9915
24960/60000 [===========>..................] - ETA: 2s - loss: 0.0290 - acc: 0.9913
25600/60000 [===========>..................] - ETA: 2s - loss: 0.0296 - acc: 0.9912
26240/60000 [============>.................] - ETA: 2s - loss: 0.0299 - acc: 0.9912
26880/60000 [============>.................] - ETA: 2s - loss: 0.0298 - acc: 0.9912
27520/60000 [============>.................] - ETA: 2s - loss: 0.0298 - acc: 0.9911
28160/60000 [=============>................] - ETA: 2s - loss: 0.0299 - acc: 0.9911
28800/60000 [=============>................] - ETA: 2s - loss: 0.0303 - acc: 0.9910
29440/60000 [=============>................] - ETA: 2s - loss: 0.0305 - acc: 0.9909
30080/60000 [==============>...............] - ETA: 2s - loss: 0.0305 - acc: 0.9909
30720/60000 [==============>...............] - ETA: 2s - loss: 0.0302 - acc: 0.9910
31360/60000 [==============>...............] - ETA: 2s - loss: 0.0301 - acc: 0.9910
32000/60000 [===============>..............] - ETA: 2s - loss: 0.0298 - acc: 0.9912
32640/60000 [===============>..............] - ETA: 2s - loss: 0.0296 - acc: 0.9912
33280/60000 [===============>..............] - ETA: 2s - loss: 0.0296 - acc: 0.9912
33920/60000 [===============>..............] - ETA: 2s - loss: 0.0298 - acc: 0.9911
34688/60000 [================>.............] - ETA: 2s - loss: 0.0300 - acc: 0.9910
35456/60000 [================>.............] - ETA: 1s - loss: 0.0306 - acc: 0.9909
36096/60000 [=================>............] - ETA: 1s - loss: 0.0305 - acc: 0.9909
36736/60000 [=================>............] - ETA: 1s - loss: 0.0315 - acc: 0.9908
37376/60000 [=================>............] - ETA: 1s - loss: 0.0314 - acc: 0.9908
38016/60000 [==================>...........] - ETA: 1s - loss: 0.0316 - acc: 0.9907
38656/60000 [==================>...........] - ETA: 1s - loss: 0.0320 - acc: 0.9905
39424/60000 [==================>...........] - ETA: 1s - loss: 0.0325 - acc: 0.9904
40064/60000 [===================>..........] - ETA: 1s - loss: 0.0328 - acc: 0.9903
40704/60000 [===================>..........] - ETA: 1s - loss: 0.0329 - acc: 0.9902
41344/60000 [===================>..........] - ETA: 1s - loss: 0.0330 - acc: 0.9902
42112/60000 [====================>.........] - ETA: 1s - loss: 0.0330 - acc: 0.9902
42880/60000 [====================>.........] - ETA: 1s - loss: 0.0331 - acc: 0.9901
43520/60000 [====================>.........] - ETA: 1s - loss: 0.0329 - acc: 0.9901
44288/60000 [=====================>........] - ETA: 1s - loss: 0.0328 - acc: 0.9902
45056/60000 [=====================>........] - ETA: 1s - loss: 0.0328 - acc: 0.9901
45952/60000 [=====================>........] - ETA: 1s - loss: 0.0329 - acc: 0.9901
46592/60000 [======================>.......] - ETA: 1s - loss: 0.0331 - acc: 0.9900
47360/60000 [======================>.......] - ETA: 1s - loss: 0.0331 - acc: 0.9901
48000/60000 [=======================>......] - ETA: 0s - loss: 0.0331 - acc: 0.9900
48640/60000 [=======================>......] - ETA: 0s - loss: 0.0333 - acc: 0.9900
49280/60000 [=======================>......] - ETA: 0s - loss: 0.0335 - acc: 0.9900
49920/60000 [=======================>......] - ETA: 0s - loss: 0.0336 - acc: 0.9899
50560/60000 [========================>.....] - ETA: 0s - loss: 0.0336 - acc: 0.9900
51200/60000 [========================>.....] - ETA: 0s - loss: 0.0337 - acc: 0.9899
51968/60000 [========================>.....] - ETA: 0s - loss: 0.0337 - acc: 0.9899
52608/60000 [=========================>....] - ETA: 0s - loss: 0.0335 - acc: 0.9899
53376/60000 [=========================>....] - ETA: 0s - loss: 0.0339 - acc: 0.9898
54144/60000 [==========================>...] - ETA: 0s - loss: 0.0336 - acc: 0.9899
54784/60000 [==========================>...] - ETA: 0s - loss: 0.0334 - acc: 0.9900
55424/60000 [==========================>...] - ETA: 0s - loss: 0.0335 - acc: 0.9899
56192/60000 [===========================>..] - ETA: 0s - loss: 0.0338 - acc: 0.9898
56960/60000 [===========================>..] - ETA: 0s - loss: 0.0340 - acc: 0.9898
57600/60000 [===========================>..] - ETA: 0s - loss: 0.0340 - acc: 0.9898
58368/60000 [============================>.] - ETA: 0s - loss: 0.0341 - acc: 0.9898
59136/60000 [============================>.] - ETA: 0s - loss: 0.0340 - acc: 0.9898
59776/60000 [============================>.] - ETA: 0s - loss: 0.0341 - acc: 0.9897
60000/60000 [==============================] - 5s 83us/step - loss: 0.0341 - acc: 0.9897 - val_loss: 0.0811 - val_acc: 0.9812
Epoch 9/10
128/60000 [..............................] - ETA: 4s - loss: 0.0426 - acc: 0.9844
896/60000 [..............................] - ETA: 4s - loss: 0.0484 - acc: 0.9900
1408/60000 [..............................] - ETA: 5s - loss: 0.0342 - acc: 0.9922
2176/60000 [>.............................] - ETA: 4s - loss: 0.0317 - acc: 0.9922
2944/60000 [>.............................] - ETA: 4s - loss: 0.0292 - acc: 0.9925
3584/60000 [>.............................] - ETA: 4s - loss: 0.0269 - acc: 0.9933
4224/60000 [=>............................] - ETA: 4s - loss: 0.0258 - acc: 0.9938
4864/60000 [=>............................] - ETA: 4s - loss: 0.0282 - acc: 0.9932
5504/60000 [=>............................] - ETA: 4s - loss: 0.0310 - acc: 0.9927
6144/60000 [==>...........................] - ETA: 4s - loss: 0.0298 - acc: 0.9925
6784/60000 [==>...........................] - ETA: 4s - loss: 0.0310 - acc: 0.9917
7424/60000 [==>...........................] - ETA: 4s - loss: 0.0303 - acc: 0.9918
8064/60000 [===>..........................] - ETA: 4s - loss: 0.0291 - acc: 0.9918
8704/60000 [===>..........................] - ETA: 4s - loss: 0.0291 - acc: 0.9917
9344/60000 [===>..........................] - ETA: 4s - loss: 0.0287 - acc: 0.9915
10112/60000 [====>.........................] - ETA: 4s - loss: 0.0284 - acc: 0.9918
10880/60000 [====>.........................] - ETA: 4s - loss: 0.0276 - acc: 0.9921
11520/60000 [====>.........................] - ETA: 3s - loss: 0.0289 - acc: 0.9920
12288/60000 [=====>........................] - ETA: 3s - loss: 0.0292 - acc: 0.9919
12928/60000 [=====>........................] - ETA: 3s - loss: 0.0299 - acc: 0.9916
13568/60000 [=====>........................] - ETA: 3s - loss: 0.0294 - acc: 0.9917
14336/60000 [======>.......................] - ETA: 3s - loss: 0.0294 - acc: 0.9916
15104/60000 [======>.......................] - ETA: 3s - loss: 0.0296 - acc: 0.9915
15616/60000 [======>.......................] - ETA: 3s - loss: 0.0298 - acc: 0.9915
16384/60000 [=======>......................] - ETA: 3s - loss: 0.0297 - acc: 0.9916
17024/60000 [=======>......................] - ETA: 3s - loss: 0.0316 - acc: 0.9911
17664/60000 [=======>......................] - ETA: 3s - loss: 0.0317 - acc: 0.9911
18304/60000 [========>.....................] - ETA: 3s - loss: 0.0312 - acc: 0.9910
19072/60000 [========>.....................] - ETA: 3s - loss: 0.0301 - acc: 0.9913
19712/60000 [========>.....................] - ETA: 3s - loss: 0.0300 - acc: 0.9914
20480/60000 [=========>....................] - ETA: 3s - loss: 0.0305 - acc: 0.9912
21120/60000 [=========>....................] - ETA: 3s - loss: 0.0305 - acc: 0.9911
21888/60000 [=========>....................] - ETA: 3s - loss: 0.0317 - acc: 0.9909
22656/60000 [==========>...................] - ETA: 3s - loss: 0.0322 - acc: 0.9907
23424/60000 [==========>...................] - ETA: 2s - loss: 0.0327 - acc: 0.9907
24064/60000 [===========>..................] - ETA: 2s - loss: 0.0321 - acc: 0.9908
24704/60000 [===========>..................] - ETA: 2s - loss: 0.0320 - acc: 0.9909
25344/60000 [===========>..................] - ETA: 2s - loss: 0.0320 - acc: 0.9911
26112/60000 [============>.................] - ETA: 2s - loss: 0.0317 - acc: 0.9912
26624/60000 [============>.................] - ETA: 2s - loss: 0.0318 - acc: 0.9911
27264/60000 [============>.................] - ETA: 2s - loss: 0.0315 - acc: 0.9912
27904/60000 [============>.................] - ETA: 2s - loss: 0.0316 - acc: 0.9912
28672/60000 [=============>................] - ETA: 2s - loss: 0.0315 - acc: 0.9912
29312/60000 [=============>................] - ETA: 2s - loss: 0.0317 - acc: 0.9912
30080/60000 [==============>...............] - ETA: 2s - loss: 0.0319 - acc: 0.9913
30720/60000 [==============>...............] - ETA: 2s - loss: 0.0318 - acc: 0.9913
31360/60000 [==============>...............] - ETA: 2s - loss: 0.0315 - acc: 0.9913
32128/60000 [===============>..............] - ETA: 2s - loss: 0.0313 - acc: 0.9914
32768/60000 [===============>..............] - ETA: 2s - loss: 0.0308 - acc: 0.9915
33280/60000 [===============>..............] - ETA: 2s - loss: 0.0310 - acc: 0.9915
34048/60000 [================>.............] - ETA: 2s - loss: 0.0308 - acc: 0.9915
34688/60000 [================>.............] - ETA: 2s - loss: 0.0313 - acc: 0.9913
35456/60000 [================>.............] - ETA: 1s - loss: 0.0314 - acc: 0.9913
36224/60000 [=================>............] - ETA: 1s - loss: 0.0313 - acc: 0.9913
36864/60000 [=================>............] - ETA: 1s - loss: 0.0315 - acc: 0.9912
37504/60000 [=================>............] - ETA: 1s - loss: 0.0313 - acc: 0.9913
38144/60000 [==================>...........] - ETA: 1s - loss: 0.0314 - acc: 0.9913
38784/60000 [==================>...........] - ETA: 1s - loss: 0.0316 - acc: 0.9913
39424/60000 [==================>...........] - ETA: 1s - loss: 0.0315 - acc: 0.9913
40192/60000 [===================>..........] - ETA: 1s - loss: 0.0315 - acc: 0.9913
40832/60000 [===================>..........] - ETA: 1s - loss: 0.0314 - acc: 0.9913
41472/60000 [===================>..........] - ETA: 1s - loss: 0.0311 - acc: 0.9914
42112/60000 [====================>.........] - ETA: 1s - loss: 0.0308 - acc: 0.9915
42880/60000 [====================>.........] - ETA: 1s - loss: 0.0307 - acc: 0.9914
43520/60000 [====================>.........] - ETA: 1s - loss: 0.0310 - acc: 0.9912
44288/60000 [=====================>........] - ETA: 1s - loss: 0.0309 - acc: 0.9913
44928/60000 [=====================>........] - ETA: 1s - loss: 0.0308 - acc: 0.9912
45696/60000 [=====================>........] - ETA: 1s - loss: 0.0307 - acc: 0.9912
46464/60000 [======================>.......] - ETA: 1s - loss: 0.0309 - acc: 0.9911
47232/60000 [======================>.......] - ETA: 1s - loss: 0.0312 - acc: 0.9910
48000/60000 [=======================>......] - ETA: 0s - loss: 0.0312 - acc: 0.9910
48640/60000 [=======================>......] - ETA: 0s - loss: 0.0310 - acc: 0.9911
49280/60000 [=======================>......] - ETA: 0s - loss: 0.0310 - acc: 0.9911
50048/60000 [========================>.....] - ETA: 0s - loss: 0.0312 - acc: 0.9910
50688/60000 [========================>.....] - ETA: 0s - loss: 0.0312 - acc: 0.9910
51328/60000 [========================>.....] - ETA: 0s - loss: 0.0313 - acc: 0.9910
51968/60000 [========================>.....] - ETA: 0s - loss: 0.0313 - acc: 0.9909
52736/60000 [=========================>....] - ETA: 0s - loss: 0.0313 - acc: 0.9909
53376/60000 [=========================>....] - ETA: 0s - loss: 0.0311 - acc: 0.9910
54144/60000 [==========================>...] - ETA: 0s - loss: 0.0309 - acc: 0.9910
54912/60000 [==========================>...] - ETA: 0s - loss: 0.0314 - acc: 0.9910
55680/60000 [==========================>...] - ETA: 0s - loss: 0.0314 - acc: 0.9910
56320/60000 [===========================>..] - ETA: 0s - loss: 0.0314 - acc: 0.9911
56960/60000 [===========================>..] - ETA: 0s - loss: 0.0312 - acc: 0.9911
57600/60000 [===========================>..] - ETA: 0s - loss: 0.0311 - acc: 0.9911
58240/60000 [============================>.] - ETA: 0s - loss: 0.0309 - acc: 0.9911
59008/60000 [============================>.] - ETA: 0s - loss: 0.0310 - acc: 0.9910
59648/60000 [============================>.] - ETA: 0s - loss: 0.0310 - acc: 0.9910
60000/60000 [==============================] - 5s 84us/step - loss: 0.0308 - acc: 0.9910 - val_loss: 0.0844 - val_acc: 0.9831
Epoch 10/10
128/60000 [..............................] - ETA: 4s - loss: 0.0095 - acc: 0.9922
896/60000 [..............................] - ETA: 4s - loss: 0.0055 - acc: 0.9978
1664/60000 [..............................] - ETA: 4s - loss: 0.0212 - acc: 0.9952
2304/60000 [>.............................] - ETA: 4s - loss: 0.0203 - acc: 0.9948
2944/60000 [>.............................] - ETA: 4s - loss: 0.0203 - acc: 0.9942
3584/60000 [>.............................] - ETA: 4s - loss: 0.0205 - acc: 0.9933
4352/60000 [=>............................] - ETA: 4s - loss: 0.0198 - acc: 0.9931
5120/60000 [=>............................] - ETA: 4s - loss: 0.0195 - acc: 0.9928
5760/60000 [=>............................] - ETA: 4s - loss: 0.0204 - acc: 0.9927
6400/60000 [==>...........................] - ETA: 4s - loss: 0.0204 - acc: 0.9927
7040/60000 [==>...........................] - ETA: 4s - loss: 0.0200 - acc: 0.9929
7808/60000 [==>...........................] - ETA: 4s - loss: 0.0219 - acc: 0.9924
8576/60000 [===>..........................] - ETA: 4s - loss: 0.0218 - acc: 0.9927
9344/60000 [===>..........................] - ETA: 3s - loss: 0.0225 - acc: 0.9925
9984/60000 [===>..........................] - ETA: 3s - loss: 0.0225 - acc: 0.9927
10752/60000 [====>.........................] - ETA: 3s - loss: 0.0217 - acc: 0.9929
11520/60000 [====>.........................] - ETA: 3s - loss: 0.0218 - acc: 0.9931
12288/60000 [=====>........................] - ETA: 3s - loss: 0.0241 - acc: 0.9923
12928/60000 [=====>........................] - ETA: 3s - loss: 0.0233 - acc: 0.9924
13568/60000 [=====>........................] - ETA: 3s - loss: 0.0226 - acc: 0.9926
14336/60000 [======>.......................] - ETA: 3s - loss: 0.0232 - acc: 0.9924
14976/60000 [======>.......................] - ETA: 3s - loss: 0.0228 - acc: 0.9925
15616/60000 [======>.......................] - ETA: 3s - loss: 0.0222 - acc: 0.9928
16384/60000 [=======>......................] - ETA: 3s - loss: 0.0222 - acc: 0.9927
17152/60000 [=======>......................] - ETA: 3s - loss: 0.0221 - acc: 0.9928
17792/60000 [=======>......................] - ETA: 3s - loss: 0.0225 - acc: 0.9929
18560/60000 [========>.....................] - ETA: 3s - loss: 0.0223 - acc: 0.9927
19328/60000 [========>.....................] - ETA: 3s - loss: 0.0218 - acc: 0.9928
20096/60000 [=========>....................] - ETA: 3s - loss: 0.0229 - acc: 0.9925
20736/60000 [=========>....................] - ETA: 3s - loss: 0.0240 - acc: 0.9923
21376/60000 [=========>....................] - ETA: 3s - loss: 0.0244 - acc: 0.9924
22016/60000 [==========>...................] - ETA: 3s - loss: 0.0258 - acc: 0.9922
22784/60000 [==========>...................] - ETA: 2s - loss: 0.0261 - acc: 0.9921
23552/60000 [==========>...................] - ETA: 2s - loss: 0.0266 - acc: 0.9920
24192/60000 [===========>..................] - ETA: 2s - loss: 0.0264 - acc: 0.9920
24960/60000 [===========>..................] - ETA: 2s - loss: 0.0266 - acc: 0.9919
25728/60000 [===========>..................] - ETA: 2s - loss: 0.0268 - acc: 0.9919
26496/60000 [============>.................] - ETA: 2s - loss: 0.0266 - acc: 0.9918
27136/60000 [============>.................] - ETA: 2s - loss: 0.0266 - acc: 0.9918
27776/60000 [============>.................] - ETA: 2s - loss: 0.0266 - acc: 0.9917
28416/60000 [=============>................] - ETA: 2s - loss: 0.0265 - acc: 0.9918
29056/60000 [=============>................] - ETA: 2s - loss: 0.0268 - acc: 0.9918
29824/60000 [=============>................] - ETA: 2s - loss: 0.0267 - acc: 0.9919
30464/60000 [==============>...............] - ETA: 2s - loss: 0.0265 - acc: 0.9919
31232/60000 [==============>...............] - ETA: 2s - loss: 0.0268 - acc: 0.9919
32000/60000 [===============>..............] - ETA: 2s - loss: 0.0274 - acc: 0.9918
32640/60000 [===============>..............] - ETA: 2s - loss: 0.0274 - acc: 0.9917
33280/60000 [===============>..............] - ETA: 2s - loss: 0.0276 - acc: 0.9916
34048/60000 [================>.............] - ETA: 2s - loss: 0.0274 - acc: 0.9917
34688/60000 [================>.............] - ETA: 2s - loss: 0.0272 - acc: 0.9918
35328/60000 [================>.............] - ETA: 1s - loss: 0.0274 - acc: 0.9917
36096/60000 [=================>............] - ETA: 1s - loss: 0.0272 - acc: 0.9918
36864/60000 [=================>............] - ETA: 1s - loss: 0.0270 - acc: 0.9918
37632/60000 [=================>............] - ETA: 1s - loss: 0.0270 - acc: 0.9917
38272/60000 [==================>...........] - ETA: 1s - loss: 0.0271 - acc: 0.9917
38912/60000 [==================>...........] - ETA: 1s - loss: 0.0272 - acc: 0.9916
39552/60000 [==================>...........] - ETA: 1s - loss: 0.0271 - acc: 0.9916
40192/60000 [===================>..........] - ETA: 1s - loss: 0.0275 - acc: 0.9915
40960/60000 [===================>..........] - ETA: 1s - loss: 0.0277 - acc: 0.9915
41600/60000 [===================>..........] - ETA: 1s - loss: 0.0276 - acc: 0.9915
42368/60000 [====================>.........] - ETA: 1s - loss: 0.0280 - acc: 0.9914
43008/60000 [====================>.........] - ETA: 1s - loss: 0.0281 - acc: 0.9914
43648/60000 [====================>.........] - ETA: 1s - loss: 0.0281 - acc: 0.9914
44416/60000 [=====================>........] - ETA: 1s - loss: 0.0282 - acc: 0.9914
45056/60000 [=====================>........] - ETA: 1s - loss: 0.0282 - acc: 0.9914
45696/60000 [=====================>........] - ETA: 1s - loss: 0.0283 - acc: 0.9913
46336/60000 [======================>.......] - ETA: 1s - loss: 0.0285 - acc: 0.9913
46976/60000 [======================>.......] - ETA: 1s - loss: 0.0284 - acc: 0.9913
47616/60000 [======================>.......] - ETA: 0s - loss: 0.0290 - acc: 0.9912
48384/60000 [=======================>......] - ETA: 0s - loss: 0.0287 - acc: 0.9913
49024/60000 [=======================>......] - ETA: 0s - loss: 0.0287 - acc: 0.9913
49792/60000 [=======================>......] - ETA: 0s - loss: 0.0287 - acc: 0.9913
50560/60000 [========================>.....] - ETA: 0s - loss: 0.0286 - acc: 0.9914
51200/60000 [========================>.....] - ETA: 0s - loss: 0.0286 - acc: 0.9914
51840/60000 [========================>.....] - ETA: 0s - loss: 0.0287 - acc: 0.9913
52480/60000 [=========================>....] - ETA: 0s - loss: 0.0285 - acc: 0.9914
53248/60000 [=========================>....] - ETA: 0s - loss: 0.0283 - acc: 0.9914
54016/60000 [==========================>...] - ETA: 0s - loss: 0.0284 - acc: 0.9914
54656/60000 [==========================>...] - ETA: 0s - loss: 0.0282 - acc: 0.9914
55168/60000 [==========================>...] - ETA: 0s - loss: 0.0282 - acc: 0.9914
55808/60000 [==========================>...] - ETA: 0s - loss: 0.0284 - acc: 0.9914
56448/60000 [===========================>..] - ETA: 0s - loss: 0.0284 - acc: 0.9915
57088/60000 [===========================>..] - ETA: 0s - loss: 0.0285 - acc: 0.9915
57856/60000 [===========================>..] - ETA: 0s - loss: 0.0289 - acc: 0.9915
58496/60000 [============================>.] - ETA: 0s - loss: 0.0292 - acc: 0.9915
59136/60000 [============================>.] - ETA: 0s - loss: 0.0293 - acc: 0.9914
59776/60000 [============================>.] - ETA: 0s - loss: 0.0293 - acc: 0.9915
60000/60000 [==============================] - 5s 82us/step - loss: 0.0293 - acc: 0.9915 - val_loss: 0.0845 - val_acc: 0.9821
Process finished with exit code 0