呼伦贝尔网站设计百度中搜到网站名字

当前位置: 首页 > news >正文

呼伦贝尔网站设计,百度中搜到网站名字,深圳网站建设 猴王网络,周大福网站建设主要工作模型微调#xff08;fine-tune)-迁移学习 torchvision微调timm微调半精度训练 起源#xff1a; 1、随着深度学习的发展#xff0c;模型的参数越来越大#xff0c;许多开源模型都是在较大数据集上进行训练的#xff0c;比如Imagenet-1k#xff0c;Imagenet-11k等2、如果…模型微调fine-tune)-迁移学习 torchvision微调timm微调半精度训练 起源 1、随着深度学习的发展模型的参数越来越大许多开源模型都是在较大数据集上进行训练的比如Imagenet-1kImagenet-11k等2、如果数据集可能只有几千张训练几千万参数的大模型过拟合无法避免3、如果我们想从零开始训练一个大模型那么我们的解决办法是收集更多的数据。然而收集和标注数据会花费大量的时间和资⾦成本无法承受 解决方案 应用迁移学习(transfer learning)将从源数据集学到的知识迁移到目标数据集上比如ImageNet数据集的图像大多跟椅子无关但在该数据集上训练的模型可以抽取较通用的图像特征从而能够帮助识别边缘、纹理、形状和物体组成模型微调finetune:就是先找到一个同类的别人训练好的模型基于已经训练好的模型换成自己的数据通过训练调整一下参数 不同数据集下使用微调 数据集1 - 数据量少但数据相似度非常高 - 在这种情况下我们所做的只是修改最后几层或最终的softmax图层的输出类别。 数据集2 - 数据量少数据相似度低 - 在这种情况下我们可以冻结预训练模型的初始层比如k层并再次训练剩余的n-k层。由于新数据集的相似度较低因此根据新数据集对较高层进行重新训练具有重要意义。 数据集3 - 数据量大数据相似度低 - 在这种情况下由于我们有一个大的数据集我们的神经网络训练将会很有效。但是由于我们的数据与用于训练我们的预训练模型的数据相比有很大不同。使用预训练模型进行的预测不会有效。因此最好根据你的数据从头开始训练神经网络Training from scatch 数据集4 - 数据量大数据相似度高 - 这是理想情况。在这种情况下预训练模型应该是最有效的。使用模型的最好方法是保留模型的体系结构和模型的初始权重。然后我们可以使用在预先训练的模型中的权重来重新训练该模型。
微调的是什么 换数据源针对K层进行重新训练K层的权重shape调整 1、模型微调(fine-tune)一般流程 1、在源数据集(如ImageNet数据集)上预训练一个神经网络模型即源模型2、创建一个新的神经网络模型即目标模型它复制了源模型上除了输出层外的所有模型设计及其参数3、为目标模型添加一个输出⼤小为⽬标数据集类别个数的输出层并随机初始化该层的模型参数4、在目标数据集上训练目标模型。我们将从头训练输出层而其余层的参数都是基于源模型的参数微调得到的 [外链图片转存失败,源站可能有防盗链机制,建议将图片保存下来直接上传(img-xfegFfaM-1692613842808)(attachment:image.png)] 2、torchvision微调 2.1 实例化Model import torchvision.models as models resnet34 models.resnet34(pretrainedTrue)pretrained参数说明 1、通过True或者False来决定是否使用预训练好的权重在默认状态下pretrained False意味着我们不使用预训练得到的权重2、当pretrained True意味着我们将使用在一些数据集上预训练得到的权重 注意如果中途强行停止下载的话一定要去对应路径下将权重文件删除干净否则会报错。 2.2 训练特定层 如果我们正在提取特征并且只想为新初始化的层计算梯度其他参数不进行改变。那我们就需要通过设置requires_grad False来冻结部分层 def set_parameter_requires_grad(model, feature_extracting):if feature_extracting:for param in model.parameters():param.requires_grad False2.3 实例 使用resnet34为例的将1000类改为10类但是仅改变最后一层的模型参数我们先冻结模型参数的梯度再对模型输出部分的全连接层进行修改 import torch import torch.nn.functional as F import torch.nn as nn from torch.optim.lr_scheduler import LambdaLR from torch.optim.lr_scheduler import StepLR import torchvision from torch.utils.data import Dataset, DataLoader from torchvision.transforms import transforms from torch.utils.tensorboard import SummaryWriter import numpy as np import torchvision.models as models from torchinfo import summary#超参数定义

批次的大小

batch_size 16 #可选32、64、128

优化器的学习率

lr 1e-4 #运行epoch max_epochs 2

方案二使用“device”后续对要使用GPU的变量用.to(device)即可

device torch.device(cuda:1 if torch.cuda.is_available() else cpu) # 数据读取 #cifar10数据集为例给出构建Dataset类的方式 from torchvision import datasets#“data_transform”可以对图像进行一定的变换如翻转、裁剪、归一化等操作可自己定义 data_transformtransforms.Compose([transforms.ToTensor(),transforms.Normalize((0.5,0.5,0.5),(0.5,0.5,0.5))])train_cifar_dataset datasets.CIFAR10(cifar10,trainTrue, downloadFalse,transformdata_transform) test_cifar_dataset datasets.CIFAR10(cifar10,trainFalse, downloadFalse,transformdata_transform)#构建好Dataset后就可以使用DataLoader来按批次读入数据了 train_loader torch.utils.data.DataLoader(train_cifar_dataset, batch_sizebatch_size, num_workers4, shuffleTrue, drop_lastTrue)test_loader torch.utils.data.DataLoader(test_cifar_dataset, batch_sizebatch_size, num_workers4, shuffleFalse)

下载预训练模型 restnet50

resnet34 models.resnet34(pretrainedTrue) print(resnet34)D:\Users\xulele\Anaconda3\lib\site-packages\torchvision\models_utils.py:208: UserWarning: The parameter pretrained is deprecated since 0.13 and may be removed in the future, please use weights instead.warnings.warn( D:\Users\xulele\Anaconda3\lib\site-packages\torchvision\models_utils.py:223: UserWarning: Arguments other than a weight enum or None for weights are deprecated since 0.13 and may be removed in the future. The current behavior is equivalent to passing weightsResNet34_Weights.IMAGENET1K_V1. You can also use weightsResNet34_Weights.DEFAULT to get the most up-to-date weights.warnings.warn(msg) Downloading: https://download.pytorch.org/models/resnet34-b627a593.pth to C:\Users\xulele/.cache\torch\hub\checkpoints\resnet34-b627a593.pth 100%|██████████| 83.3M/83.3M [00:1000:00, 8.57MB/s]ResNet((conv1): Conv2d(3, 64, kernel_size(7, 7), stride(2, 2), padding(3, 3), biasFalse)(bn1): BatchNorm2d(64, eps1e-05, momentum0.1, affineTrue, track_running_statsTrue)(relu): ReLU(inplaceTrue)(maxpool): MaxPool2d(kernel_size3, stride2, padding1, dilation1, ceil_modeFalse)(layer1): Sequential((0): BasicBlock((conv1): Conv2d(64, 64, kernel_size(3, 3), stride(1, 1), padding(1, 1), biasFalse)(bn1): BatchNorm2d(64, eps1e-05, momentum0.1, affineTrue, track_running_statsTrue)(relu): ReLU(inplaceTrue)(conv2): Conv2d(64, 64, kernel_size(3, 3), stride(1, 1), padding(1, 1), biasFalse)(bn2): BatchNorm2d(64, eps1e-05, momentum0.1, affineTrue, track_running_statsTrue))(1): BasicBlock((conv1): Conv2d(64, 64, kernel_size(3, 3), stride(1, 1), padding(1, 1), biasFalse)(bn1): BatchNorm2d(64, eps1e-05, momentum0.1, affineTrue, track_running_statsTrue)(relu): ReLU(inplaceTrue)(conv2): Conv2d(64, 64, kernel_size(3, 3), stride(1, 1), padding(1, 1), biasFalse)(bn2): BatchNorm2d(64, eps1e-05, momentum0.1, affineTrue, track_running_statsTrue))(2): BasicBlock((conv1): Conv2d(64, 64, kernel_size(3, 3), stride(1, 1), padding(1, 1), biasFalse)(bn1): BatchNorm2d(64, eps1e-05, momentum0.1, affineTrue, track_running_statsTrue)(relu): ReLU(inplaceTrue)(conv2): Conv2d(64, 64, kernel_size(3, 3), stride(1, 1), padding(1, 1), biasFalse)(bn2): BatchNorm2d(64, eps1e-05, momentum0.1, affineTrue, track_running_statsTrue)))(layer2): Sequential((0): BasicBlock((conv1): Conv2d(64, 128, kernel_size(3, 3), stride(2, 2), padding(1, 1), biasFalse)(bn1): BatchNorm2d(128, eps1e-05, momentum0.1, affineTrue, track_running_statsTrue)(relu): ReLU(inplaceTrue)(conv2): Conv2d(128, 128, kernel_size(3, 3), stride(1, 1), padding(1, 1), biasFalse)(bn2): BatchNorm2d(128, eps1e-05, momentum0.1, affineTrue, track_running_statsTrue)(downsample): Sequential((0): Conv2d(64, 128, kernel_size(1, 1), stride(2, 2), biasFalse)(1): BatchNorm2d(128, eps1e-05, momentum0.1, affineTrue, track_running_statsTrue)))(1): BasicBlock((conv1): Conv2d(128, 128, kernel_size(3, 3), stride(1, 1), padding(1, 1), biasFalse)(bn1): BatchNorm2d(128, eps1e-05, momentum0.1, affineTrue, track_running_statsTrue)(relu): ReLU(inplaceTrue)(conv2): Conv2d(128, 128, kernel_size(3, 3), stride(1, 1), padding(1, 1), biasFalse)(bn2): BatchNorm2d(128, eps1e-05, momentum0.1, affineTrue, track_running_statsTrue))(2): BasicBlock((conv1): Conv2d(128, 128, kernel_size(3, 3), stride(1, 1), padding(1, 1), biasFalse)(bn1): BatchNorm2d(128, eps1e-05, momentum0.1, affineTrue, track_running_statsTrue)(relu): ReLU(inplaceTrue)(conv2): Conv2d(128, 128, kernel_size(3, 3), stride(1, 1), padding(1, 1), biasFalse)(bn2): BatchNorm2d(128, eps1e-05, momentum0.1, affineTrue, track_running_statsTrue))(3): BasicBlock((conv1): Conv2d(128, 128, kernel_size(3, 3), stride(1, 1), padding(1, 1), biasFalse)(bn1): BatchNorm2d(128, eps1e-05, momentum0.1, affineTrue, track_running_statsTrue)(relu): ReLU(inplaceTrue)(conv2): Conv2d(128, 128, kernel_size(3, 3), stride(1, 1), padding(1, 1), biasFalse)(bn2): BatchNorm2d(128, eps1e-05, momentum0.1, affineTrue, track_running_statsTrue)))(layer3): Sequential((0): BasicBlock((conv1): Conv2d(128, 256, kernel_size(3, 3), stride(2, 2), padding(1, 1), biasFalse)(bn1): BatchNorm2d(256, eps1e-05, momentum0.1, affineTrue, track_running_statsTrue)(relu): ReLU(inplaceTrue)(conv2): Conv2d(256, 256, kernel_size(3, 3), stride(1, 1), padding(1, 1), biasFalse)(bn2): BatchNorm2d(256, eps1e-05, momentum0.1, affineTrue, track_running_statsTrue)(downsample): Sequential((0): Conv2d(128, 256, kernel_size(1, 1), stride(2, 2), biasFalse)(1): BatchNorm2d(256, eps1e-05, momentum0.1, affineTrue, track_running_statsTrue)))(1): BasicBlock((conv1): Conv2d(256, 256, kernel_size(3, 3), stride(1, 1), padding(1, 1), biasFalse)(bn1): BatchNorm2d(256, eps1e-05, momentum0.1, affineTrue, track_running_statsTrue)(relu): ReLU(inplaceTrue)(conv2): Conv2d(256, 256, kernel_size(3, 3), stride(1, 1), padding(1, 1), biasFalse)(bn2): BatchNorm2d(256, eps1e-05, momentum0.1, affineTrue, track_running_statsTrue))(2): BasicBlock((conv1): Conv2d(256, 256, kernel_size(3, 3), stride(1, 1), padding(1, 1), biasFalse)(bn1): BatchNorm2d(256, eps1e-05, momentum0.1, affineTrue, track_running_statsTrue)(relu): ReLU(inplaceTrue)(conv2): Conv2d(256, 256, kernel_size(3, 3), stride(1, 1), padding(1, 1), biasFalse)(bn2): BatchNorm2d(256, eps1e-05, momentum0.1, affineTrue, track_running_statsTrue))(3): BasicBlock((conv1): Conv2d(256, 256, kernel_size(3, 3), stride(1, 1), padding(1, 1), biasFalse)(bn1): BatchNorm2d(256, eps1e-05, momentum0.1, affineTrue, track_running_statsTrue)(relu): ReLU(inplaceTrue)(conv2): Conv2d(256, 256, kernel_size(3, 3), stride(1, 1), padding(1, 1), biasFalse)(bn2): BatchNorm2d(256, eps1e-05, momentum0.1, affineTrue, track_running_statsTrue))(4): BasicBlock((conv1): Conv2d(256, 256, kernel_size(3, 3), stride(1, 1), padding(1, 1), biasFalse)(bn1): BatchNorm2d(256, eps1e-05, momentum0.1, affineTrue, track_running_statsTrue)(relu): ReLU(inplaceTrue)(conv2): Conv2d(256, 256, kernel_size(3, 3), stride(1, 1), padding(1, 1), biasFalse)(bn2): BatchNorm2d(256, eps1e-05, momentum0.1, affineTrue, track_running_statsTrue))(5): BasicBlock((conv1): Conv2d(256, 256, kernel_size(3, 3), stride(1, 1), padding(1, 1), biasFalse)(bn1): BatchNorm2d(256, eps1e-05, momentum0.1, affineTrue, track_running_statsTrue)(relu): ReLU(inplaceTrue)(conv2): Conv2d(256, 256, kernel_size(3, 3), stride(1, 1), padding(1, 1), biasFalse)(bn2): BatchNorm2d(256, eps1e-05, momentum0.1, affineTrue, track_running_statsTrue)))(layer4): Sequential((0): BasicBlock((conv1): Conv2d(256, 512, kernel_size(3, 3), stride(2, 2), padding(1, 1), biasFalse)(bn1): BatchNorm2d(512, eps1e-05, momentum0.1, affineTrue, track_running_statsTrue)(relu): ReLU(inplaceTrue)(conv2): Conv2d(512, 512, kernel_size(3, 3), stride(1, 1), padding(1, 1), biasFalse)(bn2): BatchNorm2d(512, eps1e-05, momentum0.1, affineTrue, track_running_statsTrue)(downsample): Sequential((0): Conv2d(256, 512, kernel_size(1, 1), stride(2, 2), biasFalse)(1): BatchNorm2d(512, eps1e-05, momentum0.1, affineTrue, track_running_statsTrue)))(1): BasicBlock((conv1): Conv2d(512, 512, kernel_size(3, 3), stride(1, 1), padding(1, 1), biasFalse)(bn1): BatchNorm2d(512, eps1e-05, momentum0.1, affineTrue, track_running_statsTrue)(relu): ReLU(inplaceTrue)(conv2): Conv2d(512, 512, kernel_size(3, 3), stride(1, 1), padding(1, 1), biasFalse)(bn2): BatchNorm2d(512, eps1e-05, momentum0.1, affineTrue, track_running_statsTrue))(2): BasicBlock((conv1): Conv2d(512, 512, kernel_size(3, 3), stride(1, 1), padding(1, 1), biasFalse)(bn1): BatchNorm2d(512, eps1e-05, momentum0.1, affineTrue, track_running_statsTrue)(relu): ReLU(inplaceTrue)(conv2): Conv2d(512, 512, kernel_size(3, 3), stride(1, 1), padding(1, 1), biasFalse)(bn2): BatchNorm2d(512, eps1e-05, momentum0.1, affineTrue, track_running_statsTrue)))(avgpool): AdaptiveAvgPool2d(output_size(1, 1))(fc): Linear(in_features512, out_features1000, biasTrue) )#查看模型结构 summary(resnet34, (1, 3, 224, 224)) Layer (type:depth-idx) Output Shape Param #ResNet [1, 1000] – ├─Conv2d: 1-1 [1, 64, 112, 112] 9,408 ├─BatchNorm2d: 1-2 [1, 64, 112, 112] 128 ├─ReLU: 1-3 [1, 64, 112, 112] – ├─MaxPool2d: 1-4 [1, 64, 56, 56] – ├─Sequential: 1-5 [1, 64, 56, 56] – │ └─BasicBlock: 2-1 [1, 64, 56, 56] – │ │ └─Conv2d: 3-1 [1, 64, 56, 56] 36,864 │ │ └─BatchNorm2d: 3-2 [1, 64, 56, 56] 128 │ │ └─ReLU: 3-3 [1, 64, 56, 56] – │ │ └─Conv2d: 3-4 [1, 64, 56, 56] 36,864 │ │ └─BatchNorm2d: 3-5 [1, 64, 56, 56] 128 │ │ └─ReLU: 3-6 [1, 64, 56, 56] – │ └─BasicBlock: 2-2 [1, 64, 56, 56] – │ │ └─Conv2d: 3-7 [1, 64, 56, 56] 36,864 │ │ └─BatchNorm2d: 3-8 [1, 64, 56, 56] 128 │ │ └─ReLU: 3-9 [1, 64, 56, 56] – │ │ └─Conv2d: 3-10 [1, 64, 56, 56] 36,864 │ │ └─BatchNorm2d: 3-11 [1, 64, 56, 56] 128 │ │ └─ReLU: 3-12 [1, 64, 56, 56] – │ └─BasicBlock: 2-3 [1, 64, 56, 56] – │ │ └─Conv2d: 3-13 [1, 64, 56, 56] 36,864 │ │ └─BatchNorm2d: 3-14 [1, 64, 56, 56] 128 │ │ └─ReLU: 3-15 [1, 64, 56, 56] – │ │ └─Conv2d: 3-16 [1, 64, 56, 56] 36,864 │ │ └─BatchNorm2d: 3-17 [1, 64, 56, 56] 128 │ │ └─ReLU: 3-18 [1, 64, 56, 56] – ├─Sequential: 1-6 [1, 128, 28, 28] – │ └─BasicBlock: 2-4 [1, 128, 28, 28] – │ │ └─Conv2d: 3-19 [1, 128, 28, 28] 73,728 │ │ └─BatchNorm2d: 3-20 [1, 128, 28, 28] 256 │ │ └─ReLU: 3-21 [1, 128, 28, 28] – │ │ └─Conv2d: 3-22 [1, 128, 28, 28] 147,456 │ │ └─BatchNorm2d: 3-23 [1, 128, 28, 28] 256 │ │ └─Sequential: 3-24 [1, 128, 28, 28] 8,448 │ │ └─ReLU: 3-25 [1, 128, 28, 28] – │ └─BasicBlock: 2-5 [1, 128, 28, 28] – │ │ └─Conv2d: 3-26 [1, 128, 28, 28] 147,456 │ │ └─BatchNorm2d: 3-27 [1, 128, 28, 28] 256 │ │ └─ReLU: 3-28 [1, 128, 28, 28] – │ │ └─Conv2d: 3-29 [1, 128, 28, 28] 147,456 │ │ └─BatchNorm2d: 3-30 [1, 128, 28, 28] 256 │ │ └─ReLU: 3-31 [1, 128, 28, 28] – │ └─BasicBlock: 2-6 [1, 128, 28, 28] – │ │ └─Conv2d: 3-32 [1, 128, 28, 28] 147,456 │ │ └─BatchNorm2d: 3-33 [1, 128, 28, 28] 256 │ │ └─ReLU: 3-34 [1, 128, 28, 28] – │ │ └─Conv2d: 3-35 [1, 128, 28, 28] 147,456 │ │ └─BatchNorm2d: 3-36 [1, 128, 28, 28] 256 │ │ └─ReLU: 3-37 [1, 128, 28, 28] – │ └─BasicBlock: 2-7 [1, 128, 28, 28] – │ │ └─Conv2d: 3-38 [1, 128, 28, 28] 147,456 │ │ └─BatchNorm2d: 3-39 [1, 128, 28, 28] 256 │ │ └─ReLU: 3-40 [1, 128, 28, 28] – │ │ └─Conv2d: 3-41 [1, 128, 28, 28] 147,456 │ │ └─BatchNorm2d: 3-42 [1, 128, 28, 28] 256 │ │ └─ReLU: 3-43 [1, 128, 28, 28] – ├─Sequential: 1-7 [1, 256, 14, 14] – │ └─BasicBlock: 2-8 [1, 256, 14, 14] – │ │ └─Conv2d: 3-44 [1, 256, 14, 14] 294,912 │ │ └─BatchNorm2d: 3-45 [1, 256, 14, 14] 512 │ │ └─ReLU: 3-46 [1, 256, 14, 14] – │ │ └─Conv2d: 3-47 [1, 256, 14, 14] 589,824 │ │ └─BatchNorm2d: 3-48 [1, 256, 14, 14] 512 │ │ └─Sequential: 3-49 [1, 256, 14, 14] 33,280 │ │ └─ReLU: 3-50 [1, 256, 14, 14] – │ └─BasicBlock: 2-9 [1, 256, 14, 14] – │ │ └─Conv2d: 3-51 [1, 256, 14, 14] 589,824 │ │ └─BatchNorm2d: 3-52 [1, 256, 14, 14] 512 │ │ └─ReLU: 3-53 [1, 256, 14, 14] – │ │ └─Conv2d: 3-54 [1, 256, 14, 14] 589,824 │ │ └─BatchNorm2d: 3-55 [1, 256, 14, 14] 512 │ │ └─ReLU: 3-56 [1, 256, 14, 14] – │ └─BasicBlock: 2-10 [1, 256, 14, 14] – │ │ └─Conv2d: 3-57 [1, 256, 14, 14] 589,824 │ │ └─BatchNorm2d: 3-58 [1, 256, 14, 14] 512 │ │ └─ReLU: 3-59 [1, 256, 14, 14] – │ │ └─Conv2d: 3-60 [1, 256, 14, 14] 589,824 │ │ └─BatchNorm2d: 3-61 [1, 256, 14, 14] 512 │ │ └─ReLU: 3-62 [1, 256, 14, 14] – │ └─BasicBlock: 2-11 [1, 256, 14, 14] – │ │ └─Conv2d: 3-63 [1, 256, 14, 14] 589,824 │ │ └─BatchNorm2d: 3-64 [1, 256, 14, 14] 512 │ │ └─ReLU: 3-65 [1, 256, 14, 14] – │ │ └─Conv2d: 3-66 [1, 256, 14, 14] 589,824 │ │ └─BatchNorm2d: 3-67 [1, 256, 14, 14] 512 │ │ └─ReLU: 3-68 [1, 256, 14, 14] – │ └─BasicBlock: 2-12 [1, 256, 14, 14] – │ │ └─Conv2d: 3-69 [1, 256, 14, 14] 589,824 │ │ └─BatchNorm2d: 3-70 [1, 256, 14, 14] 512 │ │ └─ReLU: 3-71 [1, 256, 14, 14] – │ │ └─Conv2d: 3-72 [1, 256, 14, 14] 589,824 │ │ └─BatchNorm2d: 3-73 [1, 256, 14, 14] 512 │ │ └─ReLU: 3-74 [1, 256, 14, 14] – │ └─BasicBlock: 2-13 [1, 256, 14, 14] – │ │ └─Conv2d: 3-75 [1, 256, 14, 14] 589,824 │ │ └─BatchNorm2d: 3-76 [1, 256, 14, 14] 512 │ │ └─ReLU: 3-77 [1, 256, 14, 14] – │ │ └─Conv2d: 3-78 [1, 256, 14, 14] 589,824 │ │ └─BatchNorm2d: 3-79 [1, 256, 14, 14] 512 │ │ └─ReLU: 3-80 [1, 256, 14, 14] – ├─Sequential: 1-8 [1, 512, 7, 7] – │ └─BasicBlock: 2-14 [1, 512, 7, 7] – │ │ └─Conv2d: 3-81 [1, 512, 7, 7] 1,179,648 │ │ └─BatchNorm2d: 3-82 [1, 512, 7, 7] 1,024 │ │ └─ReLU: 3-83 [1, 512, 7, 7] – │ │ └─Conv2d: 3-84 [1, 512, 7, 7] 2,359,296 │ │ └─BatchNorm2d: 3-85 [1, 512, 7, 7] 1,024 │ │ └─Sequential: 3-86 [1, 512, 7, 7] 132,096 │ │ └─ReLU: 3-87 [1, 512, 7, 7] – │ └─BasicBlock: 2-15 [1, 512, 7, 7] – │ │ └─Conv2d: 3-88 [1, 512, 7, 7] 2,359,296 │ │ └─BatchNorm2d: 3-89 [1, 512, 7, 7] 1,024 │ │ └─ReLU: 3-90 [1, 512, 7, 7] – │ │ └─Conv2d: 3-91 [1, 512, 7, 7] 2,359,296 │ │ └─BatchNorm2d: 3-92 [1, 512, 7, 7] 1,024 │ │ └─ReLU: 3-93 [1, 512, 7, 7] – │ └─BasicBlock: 2-16 [1, 512, 7, 7] – │ │ └─Conv2d: 3-94 [1, 512, 7, 7] 2,359,296 │ │ └─BatchNorm2d: 3-95 [1, 512, 7, 7] 1,024 │ │ └─ReLU: 3-96 [1, 512, 7, 7] – │ │ └─Conv2d: 3-97 [1, 512, 7, 7] 2,359,296 │ │ └─BatchNorm2d: 3-98 [1, 512, 7, 7] 1,024 │ │ └─ReLU: 3-99 [1, 512, 7, 7] – ├─AdaptiveAvgPool2d: 1-9 [1, 512, 1, 1] – ├─Linear: 1-10 [1, 1000] 513,000Total params: 21,797,672 Trainable params: 21,797,672 Non-trainable params: 0 Total mult-adds (G): 3.66Input size (MB): 0.60 Forward/backward pass size (MB): 59.82 Params size (MB): 87.19 Estimated Total Size (MB): 147.61#检测 模型准确率 def cal_predict_correct(model):test_total_correct 0for iter,(images,labels) in enumerate(test_loader):images images.to(device)labels labels.to(device)outputs model(images)test_total_correct (outputs.argmax(1) labels).sum().item()

print(test_total_correct: str(test_total_correct))return test_total_correcttotal_correct cal_predict_correct(resnet34)

print(test_total_correct: str(test_total_correct / 10000))test_total_correct: 0.1def set_parameter_requires_grad(model, feature_extracting):if feature_extracting:for param in model.parameters():param.requires_grad False# 冻结参数的梯度 feature_extract True new_model resnet34 set_parameter_requires_grad(new_model, feature_extract)# 修改模型 #训练过程中model仍会进行梯度回传但是参数更新则只会发生在fc层 num_ftrs new_model.fc.in_features new_model.fc nn.Linear(in_featuresnum_ftrs, out_features10, biasTrue) summary(new_model, (1, 3, 224, 224)) Layer (type:depth-idx) Output Shape Param #ResNet [1, 10] – ├─Conv2d: 1-1 1, 64, 112, 112 ├─BatchNorm2d: 1-2 1, 64, 112, 112 ├─ReLU: 1-3 [1, 64, 112, 112] – ├─MaxPool2d: 1-4 [1, 64, 56, 56] – ├─Sequential: 1-5 [1, 64, 56, 56] – │ └─BasicBlock: 2-1 [1, 64, 56, 56] – │ │ └─Conv2d: 3-1 1, 64, 56, 56 │ │ └─BatchNorm2d: 3-2 1, 64, 56, 56 │ │ └─ReLU: 3-3 [1, 64, 56, 56] – │ │ └─Conv2d: 3-4 1, 64, 56, 56 │ │ └─BatchNorm2d: 3-5 1, 64, 56, 56 │ │ └─ReLU: 3-6 [1, 64, 56, 56] – │ └─BasicBlock: 2-2 [1, 64, 56, 56] – │ │ └─Conv2d: 3-7 1, 64, 56, 56 │ │ └─BatchNorm2d: 3-8 1, 64, 56, 56 │ │ └─ReLU: 3-9 [1, 64, 56, 56] – │ │ └─Conv2d: 3-10 1, 64, 56, 56 │ │ └─BatchNorm2d: 3-11 1, 64, 56, 56 │ │ └─ReLU: 3-12 [1, 64, 56, 56] – │ └─BasicBlock: 2-3 [1, 64, 56, 56] – │ │ └─Conv2d: 3-13 1, 64, 56, 56 │ │ └─BatchNorm2d: 3-14 1, 64, 56, 56 │ │ └─ReLU: 3-15 [1, 64, 56, 56] – │ │ └─Conv2d: 3-16 1, 64, 56, 56 │ │ └─BatchNorm2d: 3-17 1, 64, 56, 56 │ │ └─ReLU: 3-18 [1, 64, 56, 56] – ├─Sequential: 1-6 [1, 128, 28, 28] – │ └─BasicBlock: 2-4 [1, 128, 28, 28] – │ │ └─Conv2d: 3-19 1, 128, 28, 28 │ │ └─BatchNorm2d: 3-20 1, 128, 28, 28 │ │ └─ReLU: 3-21 [1, 128, 28, 28] – │ │ └─Conv2d: 3-22 1, 128, 28, 28 │ │ └─BatchNorm2d: 3-23 1, 128, 28, 28 │ │ └─Sequential: 3-24 1, 128, 28, 28 │ │ └─ReLU: 3-25 [1, 128, 28, 28] – │ └─BasicBlock: 2-5 [1, 128, 28, 28] – │ │ └─Conv2d: 3-26 1, 128, 28, 28 │ │ └─BatchNorm2d: 3-27 1, 128, 28, 28 │ │ └─ReLU: 3-28 [1, 128, 28, 28] – │ │ └─Conv2d: 3-29 1, 128, 28, 28 │ │ └─BatchNorm2d: 3-30 1, 128, 28, 28 │ │ └─ReLU: 3-31 [1, 128, 28, 28] – │ └─BasicBlock: 2-6 [1, 128, 28, 28] – │ │ └─Conv2d: 3-32 1, 128, 28, 28 │ │ └─BatchNorm2d: 3-33 1, 128, 28, 28 │ │ └─ReLU: 3-34 [1, 128, 28, 28] – │ │ └─Conv2d: 3-35 1, 128, 28, 28 │ │ └─BatchNorm2d: 3-36 1, 128, 28, 28 │ │ └─ReLU: 3-37 [1, 128, 28, 28] – │ └─BasicBlock: 2-7 [1, 128, 28, 28] – │ │ └─Conv2d: 3-38 1, 128, 28, 28 │ │ └─BatchNorm2d: 3-39 1, 128, 28, 28 │ │ └─ReLU: 3-40 [1, 128, 28, 28] – │ │ └─Conv2d: 3-41 1, 128, 28, 28 │ │ └─BatchNorm2d: 3-42 1, 128, 28, 28 │ │ └─ReLU: 3-43 [1, 128, 28, 28] – ├─Sequential: 1-7 [1, 256, 14, 14] – │ └─BasicBlock: 2-8 [1, 256, 14, 14] – │ │ └─Conv2d: 3-44 1, 256, 14, 14 │ │ └─BatchNorm2d: 3-45 1, 256, 14, 14 │ │ └─ReLU: 3-46 [1, 256, 14, 14] – │ │ └─Conv2d: 3-47 1, 256, 14, 14 │ │ └─BatchNorm2d: 3-48 1, 256, 14, 14 │ │ └─Sequential: 3-49 1, 256, 14, 14 │ │ └─ReLU: 3-50 [1, 256, 14, 14] – │ └─BasicBlock: 2-9 [1, 256, 14, 14] – │ │ └─Conv2d: 3-51 1, 256, 14, 14 │ │ └─BatchNorm2d: 3-52 1, 256, 14, 14 │ │ └─ReLU: 3-53 [1, 256, 14, 14] – │ │ └─Conv2d: 3-54 1, 256, 14, 14 │ │ └─BatchNorm2d: 3-55 1, 256, 14, 14 │ │ └─ReLU: 3-56 [1, 256, 14, 14] – │ └─BasicBlock: 2-10 [1, 256, 14, 14] – │ │ └─Conv2d: 3-57 1, 256, 14, 14 │ │ └─BatchNorm2d: 3-58 1, 256, 14, 14 │ │ └─ReLU: 3-59 [1, 256, 14, 14] – │ │ └─Conv2d: 3-60 1, 256, 14, 14 │ │ └─BatchNorm2d: 3-61 1, 256, 14, 14 │ │ └─ReLU: 3-62 [1, 256, 14, 14] – │ └─BasicBlock: 2-11 [1, 256, 14, 14] – │ │ └─Conv2d: 3-63 1, 256, 14, 14 │ │ └─BatchNorm2d: 3-64 1, 256, 14, 14 │ │ └─ReLU: 3-65 [1, 256, 14, 14] – │ │ └─Conv2d: 3-66 1, 256, 14, 14 │ │ └─BatchNorm2d: 3-67 1, 256, 14, 14 │ │ └─ReLU: 3-68 [1, 256, 14, 14] – │ └─BasicBlock: 2-12 [1, 256, 14, 14] – │ │ └─Conv2d: 3-69 1, 256, 14, 14 │ │ └─BatchNorm2d: 3-70 1, 256, 14, 14 │ │ └─ReLU: 3-71 [1, 256, 14, 14] – │ │ └─Conv2d: 3-72 1, 256, 14, 14 │ │ └─BatchNorm2d: 3-73 1, 256, 14, 14 │ │ └─ReLU: 3-74 [1, 256, 14, 14] – │ └─BasicBlock: 2-13 [1, 256, 14, 14] – │ │ └─Conv2d: 3-75 1, 256, 14, 14 │ │ └─BatchNorm2d: 3-76 1, 256, 14, 14 │ │ └─ReLU: 3-77 [1, 256, 14, 14] – │ │ └─Conv2d: 3-78 1, 256, 14, 14 │ │ └─BatchNorm2d: 3-79 1, 256, 14, 14 │ │ └─ReLU: 3-80 [1, 256, 14, 14] – ├─Sequential: 1-8 [1, 512, 7, 7] – │ └─BasicBlock: 2-14 [1, 512, 7, 7] – │ │ └─Conv2d: 3-81 1, 512, 7, 7 │ │ └─BatchNorm2d: 3-82 1, 512, 7, 7 │ │ └─ReLU: 3-83 [1, 512, 7, 7] – │ │ └─Conv2d: 3-84 1, 512, 7, 7 │ │ └─BatchNorm2d: 3-85 1, 512, 7, 7 │ │ └─Sequential: 3-86 1, 512, 7, 7 │ │ └─ReLU: 3-87 [1, 512, 7, 7] – │ └─BasicBlock: 2-15 [1, 512, 7, 7] – │ │ └─Conv2d: 3-88 1, 512, 7, 7 │ │ └─BatchNorm2d: 3-89 1, 512, 7, 7 │ │ └─ReLU: 3-90 [1, 512, 7, 7] – │ │ └─Conv2d: 3-91 1, 512, 7, 7 │ │ └─BatchNorm2d: 3-92 1, 512, 7, 7 │ │ └─ReLU: 3-93 [1, 512, 7, 7] – │ └─BasicBlock: 2-16 [1, 512, 7, 7] – │ │ └─Conv2d: 3-94 1, 512, 7, 7 │ │ └─BatchNorm2d: 3-95 1, 512, 7, 7 │ │ └─ReLU: 3-96 [1, 512, 7, 7] – │ │ └─Conv2d: 3-97 1, 512, 7, 7 │ │ └─BatchNorm2d: 3-98 1, 512, 7, 7 │ │ └─ReLU: 3-99 [1, 512, 7, 7] – ├─AdaptiveAvgPool2d: 1-9 [1, 512, 1, 1] – ├─Linear: 1-10 [1, 10] 5,130Total params: 21,289,802 Trainable params: 5,130 Non-trainable params: 21,284,672 Total mult-adds (G): 3.66Input size (MB): 0.60 Forward/backward pass size (MB): 59.81 Params size (MB): 85.16 Estimated Total Size (MB): 145.57#训练验证 Resnet34_new new_model.to(device)

定义损失函数和优化器

device torch.device(cuda:0 if torch.cuda.is_available() else cpu)

损失函数自定义损失函数

criterion nn.CrossEntropyLoss()

优化器

optimizer torch.optim.Adam(Resnet50_new.parameters(), lrlr) epoch max_epochstotal_step len(train_loader) train_all_loss [] test_all_loss []for i in range(epoch):Resnet34_new.train()train_total_loss 0train_total_num 0train_total_correct 0for iter, (images,labels) in enumerate(train_loader):images images.to(device)labels labels.to(device)outputs Resnet34_new(images)loss criterion(outputs,labels)train_total_correct (outputs.argmax(1) labels).sum().item()#backwordoptimizer.zero_grad()loss.backward()optimizer.step()train_total_num labels.shape[0]train_total_loss loss.item()print(Epoch [{}/{}], Iter [{}/{}], train_loss:{:4f}.format(i1,epoch,iter1,total_step,loss.item()/labels.shape[0]))Resnet34_new.eval()test_total_loss 0test_total_correct 0test_total_num 0for iter,(images,labels) in enumerate(test_loader):images images.to(device)labels labels.to(device)outputs Resnet34_new(images)loss criterion(outputs,labels)test_total_correct (outputs.argmax(1) labels).sum().item()test_total_loss loss.item()test_total_num labels.shape[0]print(Epoch [{}/{}], train_loss:{:.4f}, train_acc:{:.4f}%, test_loss:{:.4f}, test_acc:{:.4f}%.format(i1, epoch, train_total_loss / train_total_num, train_total_correct / train_total_num * 100, test_total_loss / test_total_num, test_total_correct / test_total_num * 100))train_all_loss.append(np.round(train_total_loss / train_total_num,4))test_all_loss.append(np.round(test_total_loss / test_total_num,4)) Epoch [12], Iter [13125], train_loss:0.150127 Epoch [12], Iter [23125], train_loss:0.174470 Epoch [12], Iter [33125], train_loss:0.165727 Epoch [12], Iter [43125], train_loss:0.174811 Epoch [12], Iter [53125], train_loss:0.158658 Epoch [12], Iter [63125], train_loss:0.153260 Epoch [12], Iter [73125], train_loss:0.164495 Epoch [12], Iter [83125], train_loss:0.164485 Epoch [12], Iter [93125], train_loss:0.157202 Epoch [12], Iter [103125], train_loss:0.149555 Epoch [12], Iter [113125], train_loss:0.172609 Epoch [12], Iter [123125], train_loss:0.180861 Epoch [12], Iter [133125], train_loss:0.156719 Epoch [12], Iter [143125], train_loss:0.172375 Epoch [12], Iter [153125], train_loss:0.169886 Epoch [12], Iter [163125], train_loss:0.148726 Epoch [12], Iter [173125], train_loss:0.160391 Epoch [12], Iter [183125], train_loss:0.160285 Epoch [12], Iter [193125], train_loss:0.167672 Epoch [12], Iter [203125], train_loss:0.151213 Epoch [12], Iter [213125], train_loss:0.154690 Epoch [12], Iter [223125], train_loss:0.155165 Epoch [12], Iter [233125], train_loss:0.162777 Epoch [12], Iter [243125], train_loss:0.169136 Epoch [12], Iter [253125], train_loss:0.151533 Epoch [12], Iter [263125], train_loss:0.168992 Epoch [12], Iter [273125], train_loss:0.176258 Epoch [12], Iter [283125], train_loss:0.162240 Epoch [12], Iter [293125], train_loss:0.161768 Epoch [12], Iter [303125], train_loss:0.165359 Epoch [12], Iter [313125], train_loss:0.166174 Epoch [12], Iter [323125], train_loss:0.173654 Epoch [12], Iter [333125], train_loss:0.162488 Epoch [12], Iter [343125], train_loss:0.164815 Epoch [12], Iter [353125], train_loss:0.154411 Epoch [12], Iter [363125], train_loss:0.159386 Epoch [12], Iter [373125], train_loss:0.176261 Epoch [12], Iter [383125], train_loss:0.163848 Epoch [12], Iter [393125], train_loss:0.174402 Epoch [12], Iter [403125], train_loss:0.178917 Epoch [12], Iter [413125], train_loss:0.149938 Epoch [12], Iter [423125], train_loss:0.156186 Epoch [12], Iter [433125], train_loss:0.162950 Epoch [12], Iter [443125], train_loss:0.169058 Epoch [12], Iter [453125], train_loss:0.168587 Epoch [12], Iter [463125], train_loss:0.173754 Epoch [12], Iter [473125], train_loss:0.158612 Epoch [12], Iter [483125], train_loss:0.163891 Epoch [12], Iter [493125], train_loss:0.149220 Epoch [12], Iter [503125], train_loss:0.175387 Epoch [12], Iter [513125], train_loss:0.163082 Epoch [12], Iter [523125], train_loss:0.156597 Epoch [12], Iter [533125], train_loss:0.179248 Epoch [12], Iter [543125], train_loss:0.170053 Epoch [12], Iter [553125], train_loss:0.140899 Epoch [12], Iter [563125], train_loss:0.168686 Epoch [12], Iter [573125], train_loss:0.189548 Epoch [12], Iter [583125], train_loss:0.169847 Epoch [12], Iter [593125], train_loss:0.171854 Epoch [12], Iter [603125], train_loss:0.175660 Epoch [12], Iter [613125], train_loss:0.163686 Epoch [12], Iter [623125], train_loss:0.174950 Epoch [12], Iter [633125], train_loss:0.173237 Epoch [12], Iter [643125], train_loss:0.146743 Epoch [12], Iter [653125], train_loss:0.159798 Epoch [12], Iter [663125], train_loss:0.169616 Epoch [12], Iter [673125], train_loss:0.167541 Epoch [12], Iter [683125], train_loss:0.136470 Epoch [12], Iter [693125], train_loss:0.185080 Epoch [12], Iter [703125], train_loss:0.166373 Epoch [12], Iter [713125], train_loss:0.160634 Epoch [12], Iter [723125], train_loss:0.163522 Epoch [12], Iter [733125], train_loss:0.157858 Epoch [12], Iter [743125], train_loss:0.157069 Epoch [12], Iter [753125], train_loss:0.183969 Epoch [12], Iter [763125], train_loss:0.166041 Epoch [12], Iter [773125], train_loss:0.151215 Epoch [12], Iter [783125], train_loss:0.164155 Epoch [12], Iter [793125], train_loss:0.158990 Epoch [12], Iter [803125], train_loss:0.178859 Epoch [12], Iter [813125], train_loss:0.139378 Epoch [12], Iter [823125], train_loss:0.150422 Epoch [12], Iter [833125], train_loss:0.155447 Epoch [12], Iter [843125], train_loss:0.146703 Epoch [12], Iter [853125], train_loss:0.165099 Epoch [12], Iter [863125], train_loss:0.175539 Epoch [12], Iter [873125], train_loss:0.178613 Epoch [12], Iter [883125], train_loss:0.169430 Epoch [12], Iter [893125], train_loss:0.160620 Epoch [12], Iter [903125], train_loss:0.172726 Epoch [12], Iter [913125], train_loss:0.139834 Epoch [12], Iter [923125], train_loss:0.162758 Epoch [12], Iter [933125], train_loss:0.160110 Epoch [12], Iter [943125], train_loss:0.176203 Epoch [12], Iter [953125], train_loss:0.170835 Epoch [12], Iter [963125], train_loss:0.166727 Epoch [12], Iter [973125], train_loss:0.175421 Epoch [12], Iter [983125], train_loss:0.173413 Epoch [12], Iter [993125], train_loss:0.154259 Epoch [12], Iter [1003125], train_loss:0.146670 Epoch [12], Iter [1013125], train_loss:0.161012 Epoch [12], Iter [1023125], train_loss:0.151979 Epoch [12], Iter [1033125], train_loss:0.163212 Epoch [12], Iter [1043125], train_loss:0.174235 Epoch [12], Iter [1053125], train_loss:0.152968 Epoch [12], Iter [1063125], train_loss:0.156215 Epoch [12], Iter [1073125], train_loss:0.164557 Epoch [12], Iter [1083125], train_loss:0.144438 Epoch [12], Iter [1093125], train_loss:0.168143 Epoch [12], Iter [1103125], train_loss:0.144444 Epoch [12], Iter [1113125], train_loss:0.153808 Epoch [12], Iter [1123125], train_loss:0.172484 Epoch [12], Iter [1133125], train_loss:0.168573 Epoch [12], Iter [1143125], train_loss:0.157955 Epoch [12], Iter [1153125], train_loss:0.170679 Epoch [12], Iter [1163125], train_loss:0.150308 Epoch [12], Iter [1173125], train_loss:0.152166 Epoch [12], Iter [1183125], train_loss:0.175642 Epoch [12], Iter [1193125], train_loss:0.167162 Epoch [12], Iter [1203125], train_loss:0.159675 Epoch [12], Iter [1213125], train_loss:0.176089 Epoch [12], Iter [1223125], train_loss:0.154275 Epoch [12], Iter [1233125], train_loss:0.139308 Epoch [12], Iter [1243125], train_loss:0.156106 Epoch [12], Iter [1253125], train_loss:0.140437 Epoch [12], Iter [1263125], train_loss:0.154971 Epoch [12], Iter [1273125], train_loss:0.148948 Epoch [12], Iter [1283125], train_loss:0.173654 Epoch [12], Iter [1293125], train_loss:0.175725 Epoch [12], Iter [1303125], train_loss:0.160516 Epoch [12], Iter [1313125], train_loss:0.170737 Epoch [12], Iter [1323125], train_loss:0.161662 Epoch [12], Iter [1333125], train_loss:0.179921 Epoch [12], Iter [1343125], train_loss:0.160738 Epoch [12], Iter [1353125], train_loss:0.134471 Epoch [12], Iter [1363125], train_loss:0.170317 Epoch [12], Iter [1373125], train_loss:0.153042 Epoch [12], Iter [1383125], train_loss:0.163370 Epoch [12], Iter [1393125], train_loss:0.169346 Epoch [12], Iter [1403125], train_loss:0.156637 Epoch [12], Iter [1413125], train_loss:0.164446 Epoch [12], Iter [1423125], train_loss:0.166337 Epoch [12], Iter [1433125], train_loss:0.150206 Epoch [12], Iter [1443125], train_loss:0.156191 Epoch [12], Iter [1453125], train_loss:0.169191 Epoch [12], Iter [1463125], train_loss:0.165300 Epoch [12], Iter [1473125], train_loss:0.177487 Epoch [12], Iter [1483125], train_loss:0.179514 Epoch [12], Iter [1493125], train_loss:0.153518 Epoch [12], Iter [1503125], train_loss:0.155025 Epoch [12], Iter [1513125], train_loss:0.169826 Epoch [12], Iter [1523125], train_loss:0.150576 Epoch [12], Iter [1533125], train_loss:0.149755 Epoch [12], Iter [1543125], train_loss:0.156437 Epoch [12], Iter [1553125], train_loss:0.163630 Epoch [12], Iter [1563125], train_loss:0.163358 Epoch [12], Iter [1573125], train_loss:0.168501 Epoch [12], Iter [1583125], train_loss:0.152938 Epoch [12], Iter [1593125], train_loss:0.162743 Epoch [12], Iter [1603125], train_loss:0.164684 Epoch [12], Iter [1613125], train_loss:0.134906 Epoch [12], Iter [1623125], train_loss:0.171217 Epoch [12], Iter [1633125], train_loss:0.166338 Epoch [12], Iter [1643125], train_loss:0.173403 Epoch [12], Iter [1653125], train_loss:0.166951 Epoch [12], Iter [1663125], train_loss:0.161986 Epoch [12], Iter [1673125], train_loss:0.167642 Epoch [12], Iter [1683125], train_loss:0.163133 Epoch [12], Iter [1693125], train_loss:0.176087 Epoch [12], Iter [1703125], train_loss:0.181500 Epoch [12], Iter [1713125], train_loss:0.182332 Epoch [12], Iter [1723125], train_loss:0.159162 Epoch [12], Iter [1733125], train_loss:0.173818 Epoch [12], Iter [1743125], train_loss:0.151095 Epoch [12], Iter [1753125], train_loss:0.169016 Epoch [12], Iter [1763125], train_loss:0.168345 Epoch [12], Iter [1773125], train_loss:0.171198 Epoch [12], Iter [1783125], train_loss:0.158377 Epoch [12], Iter [1793125], train_loss:0.150349 Epoch [12], Iter [1803125], train_loss:0.154732 Epoch [12], Iter [1813125], train_loss:0.159255 Epoch [12], Iter [1823125], train_loss:0.180752 Epoch [12], Iter [1833125], train_loss:0.130398 Epoch [12], Iter [1843125], train_loss:0.149835 Epoch [12], Iter [1853125], train_loss:0.163545 Epoch [12], Iter [1863125], train_loss:0.165769 Epoch [12], Iter [1873125], train_loss:0.165499 Epoch [12], Iter [1883125], train_loss:0.191183 Epoch [12], Iter [1893125], train_loss:0.165406 Epoch [12], Iter [1903125], train_loss:0.158130 Epoch [12], Iter [1913125], train_loss:0.167049 Epoch [12], Iter [1923125], train_loss:0.158406 Epoch [12], Iter [1933125], train_loss:0.155791 Epoch [12], Iter [1943125], train_loss:0.154068 Epoch [12], Iter [1953125], train_loss:0.173929 Epoch [12], Iter [1963125], train_loss:0.166356 Epoch [12], Iter [1973125], train_loss:0.153073 Epoch [12], Iter [1983125], train_loss:0.159932 Epoch [12], Iter [1993125], train_loss:0.158823 Epoch [12], Iter [2003125], train_loss:0.187810 Epoch [12], Iter [2013125], train_loss:0.178415 Epoch [12], Iter [2023125], train_loss:0.156469 Epoch [12], Iter [2033125], train_loss:0.160102 Epoch [12], Iter [2043125], train_loss:0.147824 Epoch [12], Iter [2053125], train_loss:0.159959 Epoch [12], Iter [2063125], train_loss:0.168457 Epoch [12], Iter [2073125], train_loss:0.152751 Epoch [12], Iter [2083125], train_loss:0.153071 Epoch [12], Iter [2093125], train_loss:0.162002 Epoch [12], Iter [2103125], train_loss:0.177490 Epoch [12], Iter [2113125], train_loss:0.153973 Epoch [12], Iter [2123125], train_loss:0.178655 Epoch [12], Iter [2133125], train_loss:0.172759 Epoch [12], Iter [2143125], train_loss:0.161288 Epoch [12], Iter [2153125], train_loss:0.145693 Epoch [12], Iter [2163125], train_loss:0.149355 Epoch [12], Iter [2173125], train_loss:0.177612 Epoch [12], Iter [2183125], train_loss:0.156104 Epoch [12], Iter [2193125], train_loss:0.146696 Epoch [12], Iter [2203125], train_loss:0.168620 Epoch [12], Iter [2213125], train_loss:0.134316 Epoch [12], Iter [2223125], train_loss:0.164465 Epoch [12], Iter [2233125], train_loss:0.161020 Epoch [12], Iter [2243125], train_loss:0.144464 Epoch [12], Iter [2253125], train_loss:0.145501 Epoch [12], Iter [2263125], train_loss:0.156721 Epoch [12], Iter [2273125], train_loss:0.160348 Epoch [12], Iter [2283125], train_loss:0.157792 Epoch [12], Iter [2293125], train_loss:0.143886 Epoch [12], Iter [2303125], train_loss:0.146231 Epoch [12], Iter [2313125], train_loss:0.161353 Epoch [12], Iter [2323125], train_loss:0.172967 Epoch [12], Iter [2333125], train_loss:0.173051 Epoch [12], Iter [2343125], train_loss:0.173887 Epoch [12], Iter [2353125], train_loss:0.155447 Epoch [12], Iter [2363125], train_loss:0.162683 Epoch [12], Iter [2373125], train_loss:0.147682 Epoch [12], Iter [2383125], train_loss:0.170582 Epoch [12], Iter [2393125], train_loss:0.159764 Epoch [12], Iter [2403125], train_loss:0.157225 Epoch [12], Iter [2413125], train_loss:0.153664 Epoch [12], Iter [2423125], train_loss:0.166018 Epoch [12], Iter [2433125], train_loss:0.175373 Epoch [12], Iter [2443125], train_loss:0.146529 Epoch [12], Iter [2453125], train_loss:0.166091 Epoch [12], Iter [2463125], train_loss:0.161189 Epoch [12], Iter [2473125], train_loss:0.144563 Epoch [12], Iter [2483125], train_loss:0.150318 Epoch [12], Iter [2493125], train_loss:0.140906 Epoch [12], Iter [2503125], train_loss:0.169033 Epoch [12], Iter [2513125], train_loss:0.155781 Epoch [12], Iter [2523125], train_loss:0.163493 Epoch [12], Iter [2533125], train_loss:0.153378 Epoch [12], Iter [2543125], train_loss:0.183447 Epoch [12], Iter [2553125], train_loss:0.178129 Epoch [12], Iter [2563125], train_loss:0.177007 Epoch [12], Iter [2573125], train_loss:0.179591 Epoch [12], Iter [2583125], train_loss:0.169509 Epoch [12], Iter [2593125], train_loss:0.146213 Epoch [12], Iter [2603125], train_loss:0.171849 Epoch [12], Iter [2613125], train_loss:0.163851 Epoch [12], Iter [2623125], train_loss:0.178366 Epoch [12], Iter [2633125], train_loss:0.194072 Epoch [12], Iter [2643125], train_loss:0.172418 Epoch [12], Iter [2653125], train_loss:0.143541 Epoch [12], Iter [2663125], train_loss:0.158418 Epoch [12], Iter [2673125], train_loss:0.163535 Epoch [12], Iter [2683125], train_loss:0.171397 Epoch [12], Iter [2693125], train_loss:0.183410 Epoch [12], Iter [2703125], train_loss:0.191745 Epoch [12], Iter [2713125], train_loss:0.195354 Epoch [12], Iter [2723125], train_loss:0.166208 Epoch [12], Iter [2733125], train_loss:0.148297 Epoch [12], Iter [2743125], train_loss:0.164007 Epoch [12], Iter [2753125], train_loss:0.168109 Epoch [12], Iter [2763125], train_loss:0.187189 Epoch [12], Iter [2773125], train_loss:0.171387 Epoch [12], Iter [2783125], train_loss:0.143764 Epoch [12], Iter [2793125], train_loss:0.175919 Epoch [12], Iter [2803125], train_loss:0.172834 Epoch [12], Iter [2813125], train_loss:0.173480 Epoch [12], Iter [2823125], train_loss:0.141544 Epoch [12], Iter [2833125], train_loss:0.187073 Epoch [12], Iter [2843125], train_loss:0.147416 Epoch [12], Iter [2853125], train_loss:0.163346 Epoch [12], Iter [2863125], train_loss:0.155601 Epoch [12], Iter [2873125], train_loss:0.160135 Epoch [12], Iter [2883125], train_loss:0.153201 Epoch [12], Iter [2893125], train_loss:0.157078 Epoch [12], Iter [2903125], train_loss:0.143863 Epoch [12], Iter [2913125], train_loss:0.170847 Epoch [12], Iter [2923125], train_loss:0.160009 Epoch [12], Iter [2933125], train_loss:0.160868 Epoch [12], Iter [2943125], train_loss:0.159037 Epoch [12], Iter [2953125], train_loss:0.148768 Epoch [12], Iter [2963125], train_loss:0.172005 Epoch [12], Iter [2973125], train_loss:0.170369 Epoch [12], Iter [2983125], train_loss:0.150250 Epoch [12], Iter [2993125], train_loss:0.203501 Epoch [12], Iter [3003125], train_loss:0.172398 Epoch [12], Iter [3013125], train_loss:0.184601 Epoch [12], Iter [3023125], train_loss:0.156175 Epoch [12], Iter [3033125], train_loss:0.161752 Epoch [12], Iter [3043125], train_loss:0.154050 Epoch [12], Iter [3053125], train_loss:0.151905 Epoch [12], Iter [3063125], train_loss:0.154861 Epoch [12], Iter [3073125], train_loss:0.157530 Epoch [12], Iter [3083125], train_loss:0.162054 Epoch [12], Iter [3093125], train_loss:0.172370 Epoch [12], Iter [3103125], train_loss:0.149971 Epoch [12], Iter [3113125], train_loss:0.155449 Epoch [12], Iter [3123125], train_loss:0.168246 Epoch [12], Iter [3133125], train_loss:0.161156 Epoch [12], Iter [3143125], train_loss:0.182064 Epoch [12], Iter [3153125], train_loss:0.168014 Epoch [12], Iter [3163125], train_loss:0.155707 Epoch [12], Iter [3173125], train_loss:0.155345 Epoch [12], Iter [3183125], train_loss:0.157537 Epoch [12], Iter [3193125], train_loss:0.158657 Epoch [12], Iter [3203125], train_loss:0.162647 Epoch [12], Iter [3213125], train_loss:0.165201 Epoch [12], Iter [3223125], train_loss:0.187565 Epoch [12], Iter [3233125], train_loss:0.153937 Epoch [12], Iter [3243125], train_loss:0.147520 Epoch [12], Iter [3253125], train_loss:0.139758 Epoch [12], Iter [3263125], train_loss:0.177869 Epoch [12], Iter [3273125], train_loss:0.178201 Epoch [12], Iter [3283125], train_loss:0.154316 Epoch [12], Iter [3293125], train_loss:0.178173 Epoch [12], Iter [3303125], train_loss:0.159244 Epoch [12], Iter [3313125], train_loss:0.177582 Epoch [12], Iter [3323125], train_loss:0.153592 Epoch [12], Iter [3333125], train_loss:0.154490 Epoch [12], Iter [3343125], train_loss:0.150733 Epoch [12], Iter [3353125], train_loss:0.169697 Epoch [12], Iter [3363125], train_loss:0.155575 Epoch [12], Iter [3373125], train_loss:0.158214 Epoch [12], Iter [3383125], train_loss:0.174536 Epoch [12], Iter [3393125], train_loss:0.139395 Epoch [12], Iter [3403125], train_loss:0.163447 Epoch [12], Iter [3413125], train_loss:0.146871 Epoch [12], Iter [3423125], train_loss:0.160089 Epoch [12], Iter [3433125], train_loss:0.161521 Epoch [12], Iter [3443125], train_loss:0.148263 Epoch [12], Iter [3453125], train_loss:0.156887 Epoch [12], Iter [3463125], train_loss:0.163093 Epoch [12], Iter [3473125], train_loss:0.130156 Epoch [12], Iter [3483125], train_loss:0.153562 Epoch [12], Iter [3493125], train_loss:0.183320 Epoch [12], Iter [3503125], train_loss:0.151159 Epoch [12], Iter [3513125], train_loss:0.144421 Epoch [12], Iter [3523125], train_loss:0.145968 Epoch [12], Iter [3533125], train_loss:0.150598 Epoch [12], Iter [3543125], train_loss:0.163271 Epoch [12], Iter [3553125], train_loss:0.191171 Epoch [12], Iter [3563125], train_loss:0.166442 Epoch [12], Iter [3573125], train_loss:0.153268 Epoch [12], Iter [3583125], train_loss:0.160086 Epoch [12], Iter [3593125], train_loss:0.172394 Epoch [12], Iter [3603125], train_loss:0.160697 Epoch [12], Iter [3613125], train_loss:0.158556 Epoch [12], Iter [3623125], train_loss:0.148141 Epoch [12], Iter [3633125], train_loss:0.161616 Epoch [12], Iter [3643125], train_loss:0.164506 Epoch [12], Iter [3653125], train_loss:0.153889 Epoch [12], Iter [3663125], train_loss:0.149990 Epoch [12], Iter [3673125], train_loss:0.172651 Epoch [12], Iter [3683125], train_loss:0.167421 Epoch [12], Iter [3693125], train_loss:0.157874 Epoch [12], Iter [3703125], train_loss:0.175726 Epoch [12], Iter [3713125], train_loss:0.168166 Epoch [12], Iter [3723125], train_loss:0.160632 Epoch [12], Iter [3733125], train_loss:0.169915 Epoch [12], Iter [3743125], train_loss:0.141351 Epoch [12], Iter [3753125], train_loss:0.157579 Epoch [12], Iter [3763125], train_loss:0.159373 Epoch [12], Iter [3773125], train_loss:0.173719 Epoch [12], Iter [3783125], train_loss:0.156862 Epoch [12], Iter [3793125], train_loss:0.164567 Epoch [12], Iter [3803125], train_loss:0.151420 Epoch [12], Iter [3813125], train_loss:0.155565 Epoch [12], Iter [3823125], train_loss:0.156861 Epoch [12], Iter [3833125], train_loss:0.162360 Epoch [12], Iter [3843125], train_loss:0.155612 Epoch [12], Iter [3853125], train_loss:0.187500 Epoch [12], Iter [3863125], train_loss:0.167519 Epoch [12], Iter [3873125], train_loss:0.150314 Epoch [12], Iter [3883125], train_loss:0.171371 Epoch [12], Iter [3893125], train_loss:0.170002 Epoch [12], Iter [3903125], train_loss:0.171281 Epoch [12], Iter [3913125], train_loss:0.154229 Epoch [12], Iter [3923125], train_loss:0.152277 Epoch [12], Iter [3933125], train_loss:0.160335 Epoch [12], Iter [3943125], train_loss:0.160123 Epoch [12], Iter [3953125], train_loss:0.157730 Epoch [12], Iter [3963125], train_loss:0.148626 Epoch [12], Iter [3973125], train_loss:0.164090 Epoch [12], Iter [3983125], train_loss:0.181123 Epoch [12], Iter [3993125], train_loss:0.144987 Epoch [12], Iter [4003125], train_loss:0.147743 Epoch [12], Iter [4013125], train_loss:0.156141 Epoch [12], Iter [4023125], train_loss:0.182602 Epoch [12], Iter [4033125], train_loss:0.186334 Epoch [12], Iter [4043125], train_loss:0.158865 Epoch [12], Iter [4053125], train_loss:0.157437 Epoch [12], Iter [4063125], train_loss:0.151499 Epoch [12], Iter [4073125], train_loss:0.155167 Epoch [12], Iter [4083125], train_loss:0.158371 Epoch [12], Iter [4093125], train_loss:0.170319 Epoch [12], Iter [4103125], train_loss:0.172921 Epoch [12], Iter [4113125], train_loss:0.175661 Epoch [12], Iter [4123125], train_loss:0.170778 Epoch [12], Iter [4133125], train_loss:0.173227 Epoch [12], Iter [4143125], train_loss:0.162998 Epoch [12], Iter [4153125], train_loss:0.144094 Epoch [12], Iter [4163125], train_loss:0.154685 Epoch [12], Iter [4173125], train_loss:0.177953 Epoch [12], Iter [4183125], train_loss:0.151602 Epoch [12], Iter [4193125], train_loss:0.165047 Epoch [12], Iter [4203125], train_loss:0.146441 Epoch [12], Iter [4213125], train_loss:0.155056 Epoch [12], Iter [4223125], train_loss:0.144277 Epoch [12], Iter [4233125], train_loss:0.156635 Epoch [12], Iter [4243125], train_loss:0.154019 Epoch [12], Iter [4253125], train_loss:0.161336 Epoch [12], Iter [4263125], train_loss:0.203085 Epoch [12], Iter [4273125], train_loss:0.146707 Epoch [12], Iter [4283125], train_loss:0.158310 Epoch [12], Iter [4293125], train_loss:0.171015 Epoch [12], Iter [4303125], train_loss:0.142477 Epoch [12], Iter [4313125], train_loss:0.189910 Epoch [12], Iter [4323125], train_loss:0.165581 Epoch [12], Iter [4333125], train_loss:0.163553 Epoch [12], Iter [4343125], train_loss:0.162628 Epoch [12], Iter [4353125], train_loss:0.166308 Epoch [12], Iter [4363125], train_loss:0.174060 Epoch [12], Iter [4373125], train_loss:0.170486 Epoch [12], Iter [4383125], train_loss:0.170334 Epoch [12], Iter [4393125], train_loss:0.170027 Epoch [12], Iter [4403125], train_loss:0.176327 Epoch [12], Iter [4413125], train_loss:0.185929 Epoch [12], Iter [4423125], train_loss:0.164644 Epoch [12], Iter [4433125], train_loss:0.155429 Epoch [12], Iter [4443125], train_loss:0.156190 Epoch [12], Iter [4453125], train_loss:0.183739 Epoch [12], Iter [4463125], train_loss:0.168132 Epoch [12], Iter [4473125], train_loss:0.156675 Epoch [12], Iter [4483125], train_loss:0.174648 Epoch [12], Iter [4493125], train_loss:0.176605 Epoch [12], Iter [4503125], train_loss:0.165744 Epoch [12], Iter [4513125], train_loss:0.159427 Epoch [12], Iter [4523125], train_loss:0.137918 Epoch [12], Iter [4533125], train_loss:0.154664 Epoch [12], Iter [4543125], train_loss:0.188046 Epoch [12], Iter [4553125], train_loss:0.157990 Epoch [12], Iter [4563125], train_loss:0.161434 Epoch [12], Iter [4573125], train_loss:0.164751 Epoch [12], Iter [4583125], train_loss:0.147707 Epoch [12], Iter [4593125], train_loss:0.156135 Epoch [12], Iter [4603125], train_loss:0.170298 Epoch [12], Iter [4613125], train_loss:0.157925 Epoch [12], Iter [4623125], train_loss:0.161613 Epoch [12], Iter [4633125], train_loss:0.156034 Epoch [12], Iter [4643125], train_loss:0.154685 Epoch [12], Iter [4653125], train_loss:0.159974 Epoch [12], Iter [4663125], train_loss:0.137804 Epoch [12], Iter [4673125], train_loss:0.173479 Epoch [12], Iter [4683125], train_loss:0.160113 Epoch [12], Iter [4693125], train_loss:0.181849 Epoch [12], Iter [4703125], train_loss:0.154617 Epoch [12], Iter [4713125], train_loss:0.145756 Epoch [12], Iter [4723125], train_loss:0.173865 Epoch [12], Iter [4733125], train_loss:0.179762 Epoch [12], Iter [4743125], train_loss:0.148816 Epoch [12], Iter [4753125], train_loss:0.143284 Epoch [12], Iter [4763125], train_loss:0.171798 Epoch [12], Iter [4773125], train_loss:0.180198 Epoch [12], Iter [4783125], train_loss:0.160204 Epoch [12], Iter [4793125], train_loss:0.166848 Epoch [12], Iter [4803125], train_loss:0.168912 Epoch [12], Iter [4813125], train_loss:0.151769 Epoch [12], Iter [4823125], train_loss:0.164199 Epoch [12], Iter [4833125], train_loss:0.159082 Epoch [12], Iter [4843125], train_loss:0.157923 Epoch [12], Iter [4853125], train_loss:0.175519 Epoch [12], Iter [4863125], train_loss:0.161383 Epoch [12], Iter [4873125], train_loss:0.162508 Epoch [12], Iter [4883125], train_loss:0.165235 Epoch [12], Iter [4893125], train_loss:0.179577 Epoch [12], Iter [4903125], train_loss:0.151752 Epoch [12], Iter [4913125], train_loss:0.171913 Epoch [12], Iter [4923125], train_loss:0.163084 Epoch [12], Iter [4933125], train_loss:0.156714 Epoch [12], Iter [4943125], train_loss:0.156022 Epoch [12], Iter [4953125], train_loss:0.157305 Epoch [12], Iter [4963125], train_loss:0.156836 Epoch [12], Iter [4973125], train_loss:0.154605 Epoch [12], Iter [4983125], train_loss:0.174036 Epoch [12], Iter [4993125], train_loss:0.164733 Epoch [12], Iter [5003125], train_loss:0.162918 Epoch [12], Iter [5013125], train_loss:0.149830 Epoch [12], Iter [5023125], train_loss:0.186489 Epoch [12], Iter [5033125], train_loss:0.145313 Epoch [12], Iter [5043125], train_loss:0.152114 Epoch [12], Iter [5053125], train_loss:0.150460 Epoch [12], Iter [5063125], train_loss:0.172033 Epoch [12], Iter [5073125], train_loss:0.156441 Epoch [12], Iter [5083125], train_loss:0.151387 Epoch [12], Iter [5093125], train_loss:0.174799 Epoch [12], Iter [5103125], train_loss:0.156212 Epoch [12], Iter [5113125], train_loss:0.157743 Epoch [12], Iter [5123125], train_loss:0.171979 Epoch [12], Iter [5133125], train_loss:0.183507 Epoch [12], Iter [5143125], train_loss:0.174797 Epoch [12], Iter [5153125], train_loss:0.151998 Epoch [12], Iter [5163125], train_loss:0.164528 Epoch [12], Iter [5173125], train_loss:0.164061 Epoch [12], Iter [5183125], train_loss:0.184687 Epoch [12], Iter [5193125], train_loss:0.153723 Epoch [12], Iter [5203125], train_loss:0.140085 Epoch [12], Iter [5213125], train_loss:0.161860 Epoch [12], Iter [5223125], train_loss:0.142582 Epoch [12], Iter [5233125], train_loss:0.158409 Epoch [12], Iter [5243125], train_loss:0.197436 Epoch [12], Iter [5253125], train_loss:0.170067 Epoch [12], Iter [5263125], train_loss:0.150738 Epoch [12], Iter [5273125], train_loss:0.164096 Epoch [12], Iter [5283125], train_loss:0.159754 Epoch [12], Iter [5293125], train_loss:0.152052 Epoch [12], Iter [5303125], train_loss:0.161230 Epoch [12], Iter [5313125], train_loss:0.181889 Epoch [12], Iter [5323125], train_loss:0.149528 Epoch [12], Iter [5333125], train_loss:0.156530 Epoch [12], Iter [5343125], train_loss:0.143401 Epoch [12], Iter [5353125], train_loss:0.164431 Epoch [12], Iter [5363125], train_loss:0.155525 Epoch [12], Iter [5373125], train_loss:0.170614 Epoch [12], Iter [5383125], train_loss:0.172353 Epoch [12], Iter [5393125], train_loss:0.167426 Epoch [12], Iter [5403125], train_loss:0.141499 Epoch [12], Iter [5413125], train_loss:0.165216 Epoch [12], Iter [5423125], train_loss:0.164144 Epoch [12], Iter [5433125], train_loss:0.149974 Epoch [12], Iter [5443125], train_loss:0.157108 Epoch [12], Iter [5453125], train_loss:0.169725 Epoch [12], Iter [5463125], train_loss:0.181695 Epoch [12], Iter [5473125], train_loss:0.161326 Epoch [12], Iter [5483125], train_loss:0.187204 Epoch [12], Iter [5493125], train_loss:0.152687 Epoch [12], Iter [5503125], train_loss:0.144457 Epoch [12], Iter [5513125], train_loss:0.160662 Epoch [12], Iter [5523125], train_loss:0.154854 Epoch [12], Iter [5533125], train_loss:0.159735 Epoch [12], Iter [5543125], train_loss:0.147193 Epoch [12], Iter [5553125], train_loss:0.157361 Epoch [12], Iter [5563125], train_loss:0.186600 Epoch [12], Iter [5573125], train_loss:0.152398 Epoch [12], Iter [5583125], train_loss:0.175364 Epoch [12], Iter [5593125], train_loss:0.167578 Epoch [12], Iter [5603125], train_loss:0.158512 Epoch [12], Iter [5613125], train_loss:0.173613 Epoch [12], Iter [5623125], train_loss:0.160966 Epoch [12], Iter [5633125], train_loss:0.172676 Epoch [12], Iter [5643125], train_loss:0.158586 Epoch [12], Iter [5653125], train_loss:0.180590 Epoch [12], Iter [5663125], train_loss:0.192027 Epoch [12], Iter [5673125], train_loss:0.157700 Epoch [12], Iter [5683125], train_loss:0.162584 Epoch [12], Iter [5693125], train_loss:0.183801 Epoch [12], Iter [5703125], train_loss:0.167326 Epoch [12], Iter [5713125], train_loss:0.164745 Epoch [12], Iter [5723125], train_loss:0.173292 Epoch [12], Iter [5733125], train_loss:0.153456 Epoch [12], Iter [5743125], train_loss:0.160368 Epoch [12], Iter [5753125], train_loss:0.151965 Epoch [12], Iter [5763125], train_loss:0.154746 Epoch [12], Iter [5773125], train_loss:0.170880 Epoch [12], Iter [5783125], train_loss:0.161438 Epoch [12], Iter [5793125], train_loss:0.180224 Epoch [12], Iter [5803125], train_loss:0.178791 Epoch [12], Iter [5813125], train_loss:0.145772 Epoch [12], Iter [5823125], train_loss:0.160606 Epoch [12], Iter [5833125], train_loss:0.176088 Epoch [12], Iter [5843125], train_loss:0.164863 Epoch [12], Iter [5853125], train_loss:0.181251 Epoch [12], Iter [5863125], train_loss:0.151516 Epoch [12], Iter [5873125], train_loss:0.176537 Epoch [12], Iter [5883125], train_loss:0.159592 Epoch [12], Iter [5893125], train_loss:0.156307 Epoch [12], Iter [5903125], train_loss:0.149772 Epoch [12], Iter [5913125], train_loss:0.168533 Epoch [12], Iter [5923125], train_loss:0.156289 Epoch [12], Iter [5933125], train_loss:0.171735 Epoch [12], Iter [5943125], train_loss:0.159490 Epoch [12], Iter [5953125], train_loss:0.156549 Epoch [12], Iter [5963125], train_loss:0.172349 Epoch [12], Iter [5973125], train_loss:0.163044 Epoch [12], Iter [5983125], train_loss:0.153242 Epoch [12], Iter [5993125], train_loss:0.178958 Epoch [12], Iter [6003125], train_loss:0.154345 Epoch [12], Iter [6013125], train_loss:0.169848 Epoch [12], Iter [6023125], train_loss:0.148637 Epoch [12], Iter [6033125], train_loss:0.168987 Epoch [12], Iter [6043125], train_loss:0.181611 Epoch [12], Iter [6053125], train_loss:0.155290 Epoch [12], Iter [6063125], train_loss:0.159152 Epoch [12], Iter [6073125], train_loss:0.158287 Epoch [12], Iter [6083125], train_loss:0.165115 Epoch [12], Iter [6093125], train_loss:0.170284 Epoch [12], Iter [6103125], train_loss:0.180462 Epoch [12], Iter [6113125], train_loss:0.170581 Epoch [12], Iter [6123125], train_loss:0.156333 Epoch [12], Iter [6133125], train_loss:0.158744 Epoch [12], Iter [6143125], train_loss:0.151848 Epoch [12], Iter [6153125], train_loss:0.146951 Epoch [12], Iter [6163125], train_loss:0.164550 Epoch [12], Iter [6173125], train_loss:0.163717 Epoch [12], Iter [6183125], train_loss:0.143995 Epoch [12], Iter [6193125], train_loss:0.174511 Epoch [12], Iter [6203125], train_loss:0.161177 Epoch [12], Iter [6213125], train_loss:0.178878 Epoch [12], Iter [6223125], train_loss:0.170491 Epoch [12], Iter [6233125], train_loss:0.172630 Epoch [12], Iter [6243125], train_loss:0.185353 Epoch [12], Iter [6253125], train_loss:0.162375 Epoch [12], Iter [6263125], train_loss:0.166046 Epoch [12], Iter [6273125], train_loss:0.187614 Epoch [12], Iter [6283125], train_loss:0.171770 Epoch [12], Iter [6293125], train_loss:0.137850 Epoch [12], Iter [6303125], train_loss:0.160116 Epoch [12], Iter [6313125], train_loss:0.147122 Epoch [12], Iter [6323125], train_loss:0.182244 Epoch [12], Iter [6333125], train_loss:0.143999 Epoch [12], Iter [6343125], train_loss:0.182345 Epoch [12], Iter [6353125], train_loss:0.156759 Epoch [12], Iter [6363125], train_loss:0.148806 Epoch [12], Iter [6373125], train_loss:0.154144 Epoch [12], Iter [6383125], train_loss:0.149763 Epoch [12], Iter [6393125], train_loss:0.154106 Epoch [12], Iter [6403125], train_loss:0.168608 Epoch [12], Iter [6413125], train_loss:0.152673 Epoch [12], Iter [6423125], train_loss:0.173711 Epoch [12], Iter [6433125], train_loss:0.168833 Epoch [12], Iter [6443125], train_loss:0.169643 Epoch [12], Iter [6453125], train_loss:0.155612 Epoch [12], Iter [6463125], train_loss:0.161894 Epoch [12], Iter [6473125], train_loss:0.173931 Epoch [12], Iter [6483125], train_loss:0.195914 Epoch [12], Iter [6493125], train_loss:0.156067 Epoch [12], Iter [6503125], train_loss:0.182341 Epoch [12], Iter [6513125], train_loss:0.162687 Epoch [12], Iter [6523125], train_loss:0.146367 Epoch [12], Iter [6533125], train_loss:0.188726 Epoch [12], Iter [6543125], train_loss:0.141544 Epoch [12], Iter [6553125], train_loss:0.136832 Epoch [12], Iter [6563125], train_loss:0.165494 Epoch [12], Iter [6573125], train_loss:0.173287 Epoch [12], Iter [6583125], train_loss:0.178410 Epoch [12], Iter [6593125], train_loss:0.153449 Epoch [12], Iter [6603125], train_loss:0.141325 Epoch [12], Iter [6613125], train_loss:0.160569 Epoch [12], Iter [6623125], train_loss:0.168849 Epoch [12], Iter [6633125], train_loss:0.170920 Epoch [12], Iter [6643125], train_loss:0.168509 Epoch [12], Iter [6653125], train_loss:0.174167 Epoch [12], Iter [6663125], train_loss:0.165306 Epoch [12], Iter [6673125], train_loss:0.173296 Epoch [12], Iter [6683125], train_loss:0.161691 Epoch [12], Iter [6693125], train_loss:0.164216 Epoch [12], Iter [6703125], train_loss:0.153614 Epoch [12], Iter [6713125], train_loss:0.176628 Epoch [12], Iter [6723125], train_loss:0.170113 Epoch [12], Iter [6733125], train_loss:0.164020 Epoch [12], Iter [6743125], train_loss:0.170262 Epoch [12], Iter [6753125], train_loss:0.160252 Epoch [12], Iter [6763125], train_loss:0.159595 Epoch [12], Iter [6773125], train_loss:0.174482 Epoch [12], Iter [6783125], train_loss:0.174136 Epoch [12], Iter [6793125], train_loss:0.169684 Epoch [12], Iter [6803125], train_loss:0.156718 Epoch [12], Iter [6813125], train_loss:0.172149 Epoch [12], Iter [6823125], train_loss:0.153396 Epoch [12], Iter [6833125], train_loss:0.152438 Epoch [12], Iter [6843125], train_loss:0.175598 Epoch [12], Iter [6853125], train_loss:0.144732 Epoch [12], Iter [6863125], train_loss:0.146447 Epoch [12], Iter [6873125], train_loss:0.149588 Epoch [12], Iter [6883125], train_loss:0.158347 Epoch [12], Iter [6893125], train_loss:0.173472 Epoch [12], Iter [6903125], train_loss:0.164299 Epoch [12], Iter [6913125], train_loss:0.147107 Epoch [12], Iter [6923125], train_loss:0.138865 Epoch [12], Iter [6933125], train_loss:0.147721 Epoch [12], Iter [6943125], train_loss:0.186929 Epoch [12], Iter [6953125], train_loss:0.149825 Epoch [12], Iter [6963125], train_loss:0.159169 Epoch [12], Iter [6973125], train_loss:0.168211 Epoch [12], Iter [6983125], train_loss:0.155869 Epoch [12], Iter [6993125], train_loss:0.175861 Epoch [12], Iter [7003125], train_loss:0.147055 Epoch [12], Iter [7013125], train_loss:0.152602 Epoch [12], Iter [7023125], train_loss:0.165213 Epoch [12], Iter [7033125], train_loss:0.155550 Epoch [12], Iter [7043125], train_loss:0.165959 Epoch [12], Iter [7053125], train_loss:0.184858 Epoch [12], Iter [7063125], train_loss:0.156636 Epoch [12], Iter [7073125], train_loss:0.141014 Epoch [12], Iter [7083125], train_loss:0.172110 Epoch [12], Iter [7093125], train_loss:0.166598 Epoch [12], Iter [7103125], train_loss:0.181486 Epoch [12], Iter [7113125], train_loss:0.149520 Epoch [12], Iter [7123125], train_loss:0.141277 Epoch [12], Iter [7133125], train_loss:0.150582 Epoch [12], Iter [7143125], train_loss:0.170460 Epoch [12], Iter [7153125], train_loss:0.166523 Epoch [12], Iter [7163125], train_loss:0.140562 Epoch [12], Iter [7173125], train_loss:0.157862 Epoch [12], Iter [7183125], train_loss:0.158880 Epoch [12], Iter [7193125], train_loss:0.151162 Epoch [12], Iter [7203125], train_loss:0.150862 Epoch [12], Iter [7213125], train_loss:0.172271 Epoch [12], Iter [7223125], train_loss:0.167076 Epoch [12], Iter [7233125], train_loss:0.160416 Epoch [12], Iter [7243125], train_loss:0.164712 Epoch [12], Iter [7253125], train_loss:0.155195 Epoch [12], Iter [7263125], train_loss:0.173203 Epoch [12], Iter [7273125], train_loss:0.203542 Epoch [12], Iter [7283125], train_loss:0.132789 Epoch [12], Iter [7293125], train_loss:0.170022 Epoch [12], Iter [7303125], train_loss:0.150648 Epoch [12], Iter [7313125], train_loss:0.152137 Epoch [12], Iter [7323125], train_loss:0.165179 Epoch [12], Iter [7333125], train_loss:0.181513 Epoch [12], Iter [7343125], train_loss:0.144627 Epoch [12], Iter [7353125], train_loss:0.156241 Epoch [12], Iter [7363125], train_loss:0.156647 Epoch [12], Iter [7373125], train_loss:0.156439 Epoch [12], Iter [7383125], train_loss:0.184127 Epoch [12], Iter [7393125], train_loss:0.149900 Epoch [12], Iter [7403125], train_loss:0.178831 Epoch [12], Iter [7413125], train_loss:0.154100 Epoch [12], Iter [7423125], train_loss:0.173619 Epoch [12], Iter [7433125], train_loss:0.174960 Epoch [12], Iter [7443125], train_loss:0.158306 Epoch [12], Iter [7453125], train_loss:0.157812 Epoch [12], Iter [7463125], train_loss:0.170903 Epoch [12], Iter [7473125], train_loss:0.158708 Epoch [12], Iter [7483125], train_loss:0.177305 Epoch [12], Iter [7493125], train_loss:0.157574 Epoch [12], Iter [7503125], train_loss:0.163793 Epoch [12], Iter [7513125], train_loss:0.175222 Epoch [12], Iter [7523125], train_loss:0.167615 Epoch [12], Iter [7533125], train_loss:0.175142 Epoch [12], Iter [7543125], train_loss:0.164994 Epoch [12], Iter [7553125], train_loss:0.173740 Epoch [12], Iter [7563125], train_loss:0.184293 Epoch [12], Iter [7573125], train_loss:0.174505 Epoch [12], Iter [7583125], train_loss:0.151717 Epoch [12], Iter [7593125], train_loss:0.149027 Epoch [12], Iter [7603125], train_loss:0.181634 Epoch [12], Iter [7613125], train_loss:0.157314 Epoch [12], Iter [7623125], train_loss:0.137242 Epoch [12], Iter [7633125], train_loss:0.168438 Epoch [12], Iter [7643125], train_loss:0.141019 Epoch [12], Iter [7653125], train_loss:0.154936 Epoch [12], Iter [7663125], train_loss:0.155263 Epoch [12], Iter [7673125], train_loss:0.156193 Epoch [12], Iter [7683125], train_loss:0.154753 Epoch [12], Iter [7693125], train_loss:0.152388 Epoch [12], Iter [7703125], train_loss:0.154891 Epoch [12], Iter [7713125], train_loss:0.150887 Epoch [12], Iter [7723125], train_loss:0.170387 Epoch [12], Iter [7733125], train_loss:0.142415 Epoch [12], Iter [7743125], train_loss:0.157543 Epoch [12], Iter [7753125], train_loss:0.161519 Epoch [12], Iter [7763125], train_loss:0.153466 Epoch [12], Iter [7773125], train_loss:0.164538 Epoch [12], Iter [7783125], train_loss:0.167005 Epoch [12], Iter [7793125], train_loss:0.164542 Epoch [12], Iter [7803125], train_loss:0.136895 Epoch [12], Iter [7813125], train_loss:0.143366 Epoch [12], Iter [7823125], train_loss:0.159515 Epoch [12], Iter [7833125], train_loss:0.159623 Epoch [12], Iter [7843125], train_loss:0.175021 Epoch [12], Iter [7853125], train_loss:0.188726 Epoch [12], Iter [7863125], train_loss:0.167352 Epoch [12], Iter [7873125], train_loss:0.159414 Epoch [12], Iter [7883125], train_loss:0.143568 Epoch [12], Iter [7893125], train_loss:0.157005 Epoch [12], Iter [7903125], train_loss:0.150693 Epoch [12], Iter [7913125], train_loss:0.142032 Epoch [12], Iter [7923125], train_loss:0.158453 Epoch [12], Iter [7933125], train_loss:0.171967 Epoch [12], Iter [7943125], train_loss:0.154673 Epoch [12], Iter [7953125], train_loss:0.161099 Epoch [12], Iter [7963125], train_loss:0.149141 Epoch [12], Iter [7973125], train_loss:0.172768 Epoch [12], Iter [7983125], train_loss:0.136935 Epoch [12], Iter [7993125], train_loss:0.150901 Epoch [12], Iter [8003125], train_loss:0.177802 Epoch [12], Iter [8013125], train_loss:0.151622 Epoch [12], Iter [8023125], train_loss:0.175425 Epoch [12], Iter [8033125], train_loss:0.158219 Epoch [12], Iter [8043125], train_loss:0.160822 Epoch [12], Iter [8053125], train_loss:0.171360 Epoch [12], Iter [8063125], train_loss:0.173840 Epoch [12], Iter [8073125], train_loss:0.170521 Epoch [12], Iter [8083125], train_loss:0.155042 Epoch [12], Iter [8093125], train_loss:0.201056 Epoch [12], Iter [8103125], train_loss:0.167513 Epoch [12], Iter [8113125], train_loss:0.159135 Epoch [12], Iter [8123125], train_loss:0.161629 Epoch [12], Iter [8133125], train_loss:0.172826 Epoch [12], Iter [8143125], train_loss:0.148274 Epoch [12], Iter [8153125], train_loss:0.183451 Epoch [12], Iter [8163125], train_loss:0.164296 Epoch [12], Iter [8173125], train_loss:0.177334 Epoch [12], Iter [8183125], train_loss:0.154336 Epoch [12], Iter [8193125], train_loss:0.170955 Epoch [12], Iter [8203125], train_loss:0.168194 Epoch [12], Iter [8213125], train_loss:0.165284 Epoch [12], Iter [8223125], train_loss:0.153692 Epoch [12], Iter [8233125], train_loss:0.164452 Epoch [12], Iter [8243125], train_loss:0.160168 Epoch [12], Iter [8253125], train_loss:0.143389 Epoch [12], Iter [8263125], train_loss:0.125640 Epoch [12], Iter [8273125], train_loss:0.154325 Epoch [12], Iter [8283125], train_loss:0.170027 Epoch [12], Iter [8293125], train_loss:0.163227 Epoch [12], Iter [8303125], train_loss:0.180084 Epoch [12], Iter [8313125], train_loss:0.153447 Epoch [12], Iter [8323125], train_loss:0.174136 Epoch [12], Iter [8333125], train_loss:0.166332 Epoch [12], Iter [8343125], train_loss:0.157354 Epoch [12], Iter [8353125], train_loss:0.120264 Epoch [12], Iter [8363125], train_loss:0.148319 Epoch [12], Iter [8373125], train_loss:0.156353 Epoch [12], Iter [8383125], train_loss:0.153210 Epoch [12], Iter [8393125], train_loss:0.169396 Epoch [12], Iter [8403125], train_loss:0.163863 Epoch [12], Iter [8413125], train_loss:0.156365 Epoch [12], Iter [8423125], train_loss:0.166741 Epoch [12], Iter [8433125], train_loss:0.153688 Epoch [12], Iter [8443125], train_loss:0.173625 Epoch [12], Iter [8453125], train_loss:0.167021 Epoch [12], Iter [8463125], train_loss:0.149013 Epoch [12], Iter [8473125], train_loss:0.165667 Epoch [12], Iter [8483125], train_loss:0.153663 Epoch [12], Iter [8493125], train_loss:0.179361 Epoch [12], Iter [8503125], train_loss:0.175290 Epoch [12], Iter [8513125], train_loss:0.168034 Epoch [12], Iter [8523125], train_loss:0.161994 Epoch [12], Iter [8533125], train_loss:0.171823 Epoch [12], Iter [8543125], train_loss:0.147653 Epoch [12], Iter [8553125], train_loss:0.159570 Epoch [12], Iter [8563125], train_loss:0.157177 Epoch [12], Iter [8573125], train_loss:0.155356 Epoch [12], Iter [8583125], train_loss:0.159401 Epoch [12], Iter [8593125], train_loss:0.179499 Epoch [12], Iter [8603125], train_loss:0.153504 Epoch [12], Iter [8613125], train_loss:0.174314 Epoch [12], Iter [8623125], train_loss:0.145309 Epoch [12], Iter [8633125], train_loss:0.170880 Epoch [12], Iter [8643125], train_loss:0.171654 Epoch [12], Iter [8653125], train_loss:0.125795 Epoch [12], Iter [8663125], train_loss:0.161326 Epoch [12], Iter [8673125], train_loss:0.170622 Epoch [12], Iter [8683125], train_loss:0.164444 Epoch [12], Iter [8693125], train_loss:0.138547 Epoch [12], Iter [8703125], train_loss:0.158241 Epoch [12], Iter [8713125], train_loss:0.158963 Epoch [12], Iter [8723125], train_loss:0.198872 Epoch [12], Iter [8733125], train_loss:0.171953 Epoch [12], Iter [8743125], train_loss:0.135011 Epoch [12], Iter [8753125], train_loss:0.187574 Epoch [12], Iter [8763125], train_loss:0.183588 Epoch [12], Iter [8773125], train_loss:0.172207 Epoch [12], Iter [8783125], train_loss:0.163572 Epoch [12], Iter [8793125], train_loss:0.177148 Epoch [12], Iter [8803125], train_loss:0.156533 Epoch [12], Iter [8813125], train_loss:0.164676 Epoch [12], Iter [8823125], train_loss:0.155344 Epoch [12], Iter [8833125], train_loss:0.179421 Epoch [12], Iter [8843125], train_loss:0.152775 Epoch [12], Iter [8853125], train_loss:0.183656 Epoch [12], Iter [8863125], train_loss:0.178685 Epoch [12], Iter [8873125], train_loss:0.174813 Epoch [12], Iter [8883125], train_loss:0.164418 Epoch [12], Iter [8893125], train_loss:0.151287 Epoch [12], Iter [8903125], train_loss:0.159186 Epoch [12], Iter [8913125], train_loss:0.176169 Epoch [12], Iter [8923125], train_loss:0.153548 Epoch [12], Iter [8933125], train_loss:0.163016 Epoch [12], Iter [8943125], train_loss:0.152066 Epoch [12], Iter [8953125], train_loss:0.161777 Epoch [12], Iter [8963125], train_loss:0.147675 Epoch [12], Iter [8973125], train_loss:0.176385 Epoch [12], Iter [8983125], train_loss:0.163108 Epoch [12], Iter [8993125], train_loss:0.157772 Epoch [12], Iter [9003125], train_loss:0.176365 Epoch [12], Iter [9013125], train_loss:0.163414 Epoch [12], Iter [9023125], train_loss:0.152687 Epoch [12], Iter [9033125], train_loss:0.149312 Epoch [12], Iter [9043125], train_loss:0.145944 Epoch [12], Iter [9053125], train_loss:0.183935 Epoch [12], Iter [9063125], train_loss:0.141416 Epoch [12], Iter [9073125], train_loss:0.148432 Epoch [12], Iter [9083125], train_loss:0.161458 Epoch [12], Iter [9093125], train_loss:0.159551 Epoch [12], Iter [9103125], train_loss:0.147279 Epoch [12], Iter [9113125], train_loss:0.149100 Epoch [12], Iter [9123125], train_loss:0.147561 Epoch [12], Iter [9133125], train_loss:0.153887 Epoch [12], Iter [9143125], train_loss:0.155617 Epoch [12], Iter [9153125], train_loss:0.138967 Epoch [12], Iter [9163125], train_loss:0.187655 Epoch [12], Iter [9173125], train_loss:0.189089 Epoch [12], Iter [9183125], train_loss:0.185985 Epoch [12], Iter [9193125], train_loss:0.159035 Epoch [12], Iter [9203125], train_loss:0.158106 Epoch [12], Iter [9213125], train_loss:0.160929 Epoch [12], Iter [9223125], train_loss:0.165616 Epoch [12], Iter [9233125], train_loss:0.159126 Epoch [12], Iter [9243125], train_loss:0.166481 Epoch [12], Iter [9253125], train_loss:0.166022 Epoch [12], Iter [9263125], train_loss:0.143194 Epoch [12], Iter [9273125], train_loss:0.166617 Epoch [12], Iter [9283125], train_loss:0.165519 Epoch [12], Iter [9293125], train_loss:0.149431 Epoch [12], Iter [9303125], train_loss:0.158727 Epoch [12], Iter [9313125], train_loss:0.143095 Epoch [12], Iter [9323125], train_loss:0.153236 Epoch [12], Iter [9333125], train_loss:0.148599 Epoch [12], Iter [9343125], train_loss:0.159922 Epoch [12], Iter [9353125], train_loss:0.168778 Epoch [12], Iter [9363125], train_loss:0.149560 Epoch [12], Iter [9373125], train_loss:0.160552 Epoch [12], Iter [9383125], train_loss:0.151009 Epoch [12], Iter [9393125], train_loss:0.171371 Epoch [12], Iter [9403125], train_loss:0.156552 Epoch [12], Iter [9413125], train_loss:0.153480 Epoch [12], Iter [9423125], train_loss:0.144583 Epoch [12], Iter [9433125], train_loss:0.156411 Epoch [12], Iter [9443125], train_loss:0.153091 Epoch [12], Iter [9453125], train_loss:0.158801 Epoch [12], Iter [9463125], train_loss:0.139097 Epoch [12], Iter [9473125], train_loss:0.171316 Epoch [12], Iter [9483125], train_loss:0.179716 Epoch [12], Iter [9493125], train_loss:0.150855 Epoch [12], Iter [9503125], train_loss:0.159264 Epoch [12], Iter [9513125], train_loss:0.178506 Epoch [12], Iter [9523125], train_loss:0.165264 Epoch [12], Iter [9533125], train_loss:0.163345 Epoch [12], Iter [9543125], train_loss:0.163006 Epoch [12], Iter [9553125], train_loss:0.180055 Epoch [12], Iter [9563125], train_loss:0.152678 Epoch [12], Iter [9573125], train_loss:0.149015 Epoch [12], Iter [9583125], train_loss:0.167205 Epoch [12], Iter [9593125], train_loss:0.159652 Epoch [12], Iter [9603125], train_loss:0.172454 Epoch [12], Iter [9613125], train_loss:0.152453 Epoch [12], Iter [9623125], train_loss:0.159779 Epoch [12], Iter [9633125], train_loss:0.157254 Epoch [12], Iter [9643125], train_loss:0.171195 Epoch [12], Iter [9653125], train_loss:0.129605 Epoch [12], Iter [9663125], train_loss:0.171718 Epoch [12], Iter [9673125], train_loss:0.135528 Epoch [12], Iter [9683125], train_loss:0.171078 Epoch [12], Iter [9693125], train_loss:0.177459 Epoch [12], Iter [9703125], train_loss:0.155430 Epoch [12], Iter [9713125], train_loss:0.162782 Epoch [12], Iter [9723125], train_loss:0.179943 Epoch [12], Iter [9733125], train_loss:0.159568 Epoch [12], Iter [9743125], train_loss:0.145395 Epoch [12], Iter [9753125], train_loss:0.162883 Epoch [12], Iter [9763125], train_loss:0.152242 Epoch [12], Iter [9773125], train_loss:0.178401 Epoch [12], Iter [9783125], train_loss:0.149824 Epoch [12], Iter [9793125], train_loss:0.164016 Epoch [12], Iter [9803125], train_loss:0.173642 Epoch [12], Iter [9813125], train_loss:0.184837 Epoch [12], Iter [9823125], train_loss:0.157643 Epoch [12], Iter [9833125], train_loss:0.170323 Epoch [12], Iter [9843125], train_loss:0.145053 Epoch [12], Iter [9853125], train_loss:0.177159 Epoch [12], Iter [9863125], train_loss:0.170435 Epoch [12], Iter [9873125], train_loss:0.140393 Epoch [12], Iter [9883125], train_loss:0.170333 Epoch [12], Iter [9893125], train_loss:0.154973 Epoch [12], Iter [9903125], train_loss:0.168512 Epoch [12], Iter [9913125], train_loss:0.171748 Epoch [12], Iter [9923125], train_loss:0.191529 Epoch [12], Iter [9933125], train_loss:0.164100 Epoch [12], Iter [9943125], train_loss:0.169794 Epoch [12], Iter [9953125], train_loss:0.161297 Epoch [12], Iter [9963125], train_loss:0.154997 Epoch [12], Iter [9973125], train_loss:0.174858 Epoch [12], Iter [9983125], train_loss:0.131562 Epoch [12], Iter [9993125], train_loss:0.170373 Epoch [12], Iter [10003125], train_loss:0.174953 Epoch [12], Iter [10013125], train_loss:0.171201 Epoch [12], Iter [10023125], train_loss:0.157745 Epoch [12], Iter [10033125], train_loss:0.165321 Epoch [12], Iter [10043125], train_loss:0.166191 Epoch [12], Iter [10053125], train_loss:0.161590 Epoch [12], Iter [10063125], train_loss:0.155218 Epoch [12], Iter [10073125], train_loss:0.161306 Epoch [12], Iter [10083125], train_loss:0.160885 Epoch [12], Iter [10093125], train_loss:0.150420 Epoch [12], Iter [10103125], train_loss:0.180716 Epoch [12], Iter [10113125], train_loss:0.170864 Epoch [12], Iter [10123125], train_loss:0.155604 Epoch [12], Iter [10133125], train_loss:0.138882 Epoch [12], Iter [10143125], train_loss:0.163906 Epoch [12], Iter [10153125], train_loss:0.157286 Epoch [12], Iter [10163125], train_loss:0.176689 Epoch [12], Iter [10173125], train_loss:0.164429 Epoch [12], Iter [10183125], train_loss:0.151421 Epoch [12], Iter [10193125], train_loss:0.173269 Epoch [12], Iter [10203125], train_loss:0.159520 Epoch [12], Iter [10213125], train_loss:0.136108 Epoch [12], Iter [10223125], train_loss:0.168635 Epoch [12], Iter [10233125], train_loss:0.172606 Epoch [12], Iter [10243125], train_loss:0.169962 Epoch [12], Iter [10253125], train_loss:0.171667 Epoch [12], Iter [10263125], train_loss:0.186360 Epoch [12], Iter [10273125], train_loss:0.154808 Epoch [12], Iter [10283125], train_loss:0.162741 Epoch [12], Iter [10293125], train_loss:0.168956 Epoch [12], Iter [10303125], train_loss:0.167106 Epoch [12], Iter [10313125], train_loss:0.150996 Epoch [12], Iter [10323125], train_loss:0.148269 Epoch [12], Iter [10333125], train_loss:0.159704 Epoch [12], Iter [10343125], train_loss:0.169828 Epoch [12], Iter [10353125], train_loss:0.170876 Epoch [12], Iter [10363125], train_loss:0.152638 Epoch [12], Iter [10373125], train_loss:0.156386 Epoch [12], Iter [10383125], train_loss:0.158583 Epoch [12], Iter [10393125], train_loss:0.131727 Epoch [12], Iter [10403125], train_loss:0.159804 Epoch [12], Iter [10413125], train_loss:0.150478 Epoch [12], Iter [10423125], train_loss:0.172487 Epoch [12], Iter [10433125], train_loss:0.172604 Epoch [12], Iter [10443125], train_loss:0.176825 Epoch [12], Iter [10453125], train_loss:0.155156 Epoch [12], Iter [10463125], train_loss:0.159919 Epoch [12], Iter [10473125], train_loss:0.158133 Epoch [12], Iter [10483125], train_loss:0.171692 Epoch [12], Iter [10493125], train_loss:0.148961 Epoch [12], Iter [10503125], train_loss:0.145803 Epoch [12], Iter [10513125], train_loss:0.166840 Epoch [12], Iter [10523125], train_loss:0.144305 Epoch [12], Iter [10533125], train_loss:0.148482 Epoch [12], Iter [10543125], train_loss:0.159671 Epoch [12], Iter [10553125], train_loss:0.160208 Epoch [12], Iter [10563125], train_loss:0.167555 Epoch [12], Iter [10573125], train_loss:0.161161 Epoch [12], Iter [10583125], train_loss:0.149388 Epoch [12], Iter [10593125], train_loss:0.181070 Epoch [12], Iter [10603125], train_loss:0.171973 Epoch [12], Iter [10613125], train_loss:0.180709 Epoch [12], Iter [10623125], train_loss:0.153507 Epoch [12], Iter [10633125], train_loss:0.145896 Epoch [12], Iter [10643125], train_loss:0.166199 Epoch [12], Iter [10653125], train_loss:0.166107 Epoch [12], Iter [10663125], train_loss:0.155540 Epoch [12], Iter [10673125], train_loss:0.154284 Epoch [12], Iter [10683125], train_loss:0.187118 Epoch [12], Iter [10693125], train_loss:0.159748 Epoch [12], Iter [10703125], train_loss:0.164387 Epoch [12], Iter [10713125], train_loss:0.142183 Epoch [12], Iter [10723125], train_loss:0.138724 Epoch [12], Iter [10733125], train_loss:0.146154 Epoch [12], Iter [10743125], train_loss:0.162630 Epoch [12], Iter [10753125], train_loss:0.185121 Epoch [12], Iter [10763125], train_loss:0.160997 Epoch [12], Iter [10773125], train_loss:0.179530 Epoch [12], Iter [10783125], train_loss:0.153985 Epoch [12], Iter [10793125], train_loss:0.147778 Epoch [12], Iter [10803125], train_loss:0.149064 Epoch [12], Iter [10813125], train_loss:0.151860 Epoch [12], Iter [10823125], train_loss:0.161012 Epoch [12], Iter [10833125], train_loss:0.197195 Epoch [12], Iter [10843125], train_loss:0.157916 Epoch [12], Iter [10853125], train_loss:0.162013 Epoch [12], Iter [10863125], train_loss:0.160678 Epoch [12], Iter [10873125], train_loss:0.168688 Epoch [12], Iter [10883125], train_loss:0.139971 Epoch [12], Iter [10893125], train_loss:0.184158 Epoch [12], Iter [10903125], train_loss:0.184676 Epoch [12], Iter [10913125], train_loss:0.150608 Epoch [12], Iter [10923125], train_loss:0.151490 Epoch [12], Iter [10933125], train_loss:0.176660 Epoch [12], Iter [10943125], train_loss:0.153394 Epoch [12], Iter [10953125], train_loss:0.163054 Epoch [12], Iter [10963125], train_loss:0.144125 Epoch [12], Iter [10973125], train_loss:0.167320 Epoch [12], Iter [10983125], train_loss:0.158095 Epoch [12], Iter [10993125], train_loss:0.150448 Epoch [12], Iter [11003125], train_loss:0.167379 Epoch [12], Iter [11013125], train_loss:0.151696 Epoch [12], Iter [11023125], train_loss:0.174957 Epoch [12], Iter [11033125], train_loss:0.159035 Epoch [12], Iter [11043125], train_loss:0.163059 Epoch [12], Iter [11053125], train_loss:0.170439 Epoch [12], Iter [11063125], train_loss:0.163471 Epoch [12], Iter [11073125], train_loss:0.180205 Epoch [12], Iter [11083125], train_loss:0.148346 Epoch [12], Iter [11093125], train_loss:0.170757 Epoch [12], Iter [11103125], train_loss:0.155306 Epoch [12], Iter [11113125], train_loss:0.173857 Epoch [12], Iter [11123125], train_loss:0.149888 Epoch [12], Iter [11133125], train_loss:0.164874 Epoch [12], Iter [11143125], train_loss:0.165291 Epoch [12], Iter [11153125], train_loss:0.143524 Epoch [12], Iter [11163125], train_loss:0.151315 Epoch [12], Iter [11173125], train_loss:0.169421 Epoch [12], Iter [11183125], train_loss:0.166722 Epoch [12], Iter [11193125], train_loss:0.167637 Epoch [12], Iter [11203125], train_loss:0.155744 Epoch [12], Iter [11213125], train_loss:0.162011 Epoch [12], Iter [11223125], train_loss:0.160295 Epoch [12], Iter [11233125], train_loss:0.154625 Epoch [12], Iter [11243125], train_loss:0.151765 Epoch [12], Iter [11253125], train_loss:0.170621 Epoch [12], Iter [11263125], train_loss:0.155552 Epoch [12], Iter [11273125], train_loss:0.173134 Epoch [12], Iter [11283125], train_loss:0.153150 Epoch [12], Iter [11293125], train_loss:0.145719 Epoch [12], Iter [11303125], train_loss:0.187136 Epoch [12], Iter [11313125], train_loss:0.169417 Epoch [12], Iter [11323125], train_loss:0.178974 Epoch [12], Iter [11333125], train_loss:0.149931 Epoch [12], Iter [11343125], train_loss:0.155474 Epoch [12], Iter [11353125], train_loss:0.161715 Epoch [12], Iter [11363125], train_loss:0.165408 Epoch [12], Iter [11373125], train_loss:0.170022 Epoch [12], Iter [11383125], train_loss:0.147393 Epoch [12], Iter [11393125], train_loss:0.175394 Epoch [12], Iter [11403125], train_loss:0.157841 Epoch [12], Iter [11413125], train_loss:0.164718 Epoch [12], Iter [11423125], train_loss:0.154701 Epoch [12], Iter [11433125], train_loss:0.168679 Epoch [12], Iter [11443125], train_loss:0.181446 Epoch [12], Iter [11453125], train_loss:0.148103 Epoch [12], Iter [11463125], train_loss:0.151220 Epoch [12], Iter [11473125], train_loss:0.186586 Epoch [12], Iter [11483125], train_loss:0.174347 Epoch [12], Iter [11493125], train_loss:0.170932 Epoch [12], Iter [11503125], train_loss:0.165207 Epoch [12], Iter [11513125], train_loss:0.158725 Epoch [12], Iter [11523125], train_loss:0.155164 Epoch [12], Iter [11533125], train_loss:0.171893 Epoch [12], Iter [11543125], train_loss:0.162601 Epoch [12], Iter [11553125], train_loss:0.160125 Epoch [12], Iter [11563125], train_loss:0.181936 Epoch [12], Iter [11573125], train_loss:0.172337 Epoch [12], Iter [11583125], train_loss:0.147319 Epoch [12], Iter [11593125], train_loss:0.183120 Epoch [12], Iter [11603125], train_loss:0.168000 Epoch [12], Iter [11613125], train_loss:0.163454 Epoch [12], Iter [11623125], train_loss:0.158614 Epoch [12], Iter [11633125], train_loss:0.170988 Epoch [12], Iter [11643125], train_loss:0.162558 Epoch [12], Iter [11653125], train_loss:0.164345 Epoch [12], Iter [11663125], train_loss:0.151922 Epoch [12], Iter [11673125], train_loss:0.182245 Epoch [12], Iter [11683125], train_loss:0.162371 Epoch [12], Iter [11693125], train_loss:0.155639 Epoch [12], Iter [11703125], train_loss:0.157078 Epoch [12], Iter [11713125], train_loss:0.168648 Epoch [12], Iter [11723125], train_loss:0.160894 Epoch [12], Iter [11733125], train_loss:0.172699 Epoch [12], Iter [11743125], train_loss:0.186120 Epoch [12], Iter [11753125], train_loss:0.163291 Epoch [12], Iter [11763125], train_loss:0.160210 Epoch [12], Iter [11773125], train_loss:0.157460 Epoch [12], Iter [11783125], train_loss:0.169464 Epoch [12], Iter [11793125], train_loss:0.155117 Epoch [12], Iter [11803125], train_loss:0.175044 Epoch [12], Iter [11813125], train_loss:0.171335 Epoch [12], Iter [11823125], train_loss:0.156485 Epoch [12], Iter [11833125], train_loss:0.166067 Epoch [12], Iter [11843125], train_loss:0.161618 Epoch [12], Iter [11853125], train_loss:0.158961 Epoch [12], Iter [11863125], train_loss:0.158767 Epoch [12], Iter [11873125], train_loss:0.158581 Epoch [12], Iter [11883125], train_loss:0.150107 Epoch [12], Iter [11893125], train_loss:0.151393 Epoch [12], Iter [11903125], train_loss:0.157746 Epoch [12], Iter [11913125], train_loss:0.162504 Epoch [12], Iter [11923125], train_loss:0.162217 Epoch [12], Iter [11933125], train_loss:0.184125 Epoch [12], Iter [11943125], train_loss:0.155755 Epoch [12], Iter [11953125], train_loss:0.163561 Epoch [12], Iter [11963125], train_loss:0.169904 Epoch [12], Iter [11973125], train_loss:0.163287 Epoch [12], Iter [11983125], train_loss:0.162994 Epoch [12], Iter [11993125], train_loss:0.179970 Epoch [12], Iter [12003125], train_loss:0.175508 Epoch [12], Iter [12013125], train_loss:0.171165 Epoch [12], Iter [12023125], train_loss:0.157112 Epoch [12], Iter [12033125], train_loss:0.162217 Epoch [12], Iter [12043125], train_loss:0.168821 Epoch [12], Iter [12053125], train_loss:0.197255 Epoch [12], Iter [12063125], train_loss:0.160194 Epoch [12], Iter [12073125], train_loss:0.151903 Epoch [12], Iter [12083125], train_loss:0.149178 Epoch [12], Iter [12093125], train_loss:0.146489 Epoch [12], Iter [12103125], train_loss:0.154193 Epoch [12], Iter [12113125], train_loss:0.157028 Epoch [12], Iter [12123125], train_loss:0.162961 Epoch [12], Iter [12133125], train_loss:0.176358 Epoch [12], Iter [12143125], train_loss:0.170513 Epoch [12], Iter [12153125], train_loss:0.166415 Epoch [12], Iter [12163125], train_loss:0.150504 Epoch [12], Iter [12173125], train_loss:0.169194 Epoch [12], Iter [12183125], train_loss:0.173286 Epoch [12], Iter [12193125], train_loss:0.170073 Epoch [12], Iter [12203125], train_loss:0.157464 Epoch [12], Iter [12213125], train_loss:0.153022 Epoch [12], Iter [12223125], train_loss:0.164855 Epoch [12], Iter [12233125], train_loss:0.155083 Epoch [12], Iter [12243125], train_loss:0.165551 Epoch [12], Iter [12253125], train_loss:0.185195 Epoch [12], Iter [12263125], train_loss:0.177821 Epoch [12], Iter [12273125], train_loss:0.154561 Epoch [12], Iter [12283125], train_loss:0.159085 Epoch [12], Iter [12293125], train_loss:0.171906 Epoch [12], Iter [12303125], train_loss:0.160470 Epoch [12], Iter [12313125], train_loss:0.151237 Epoch [12], Iter [12323125], train_loss:0.135055 Epoch [12], Iter [12333125], train_loss:0.140605 Epoch [12], Iter [12343125], train_loss:0.183646 Epoch [12], Iter [12353125], train_loss:0.158728 Epoch [12], Iter [12363125], train_loss:0.163355 Epoch [12], Iter [12373125], train_loss:0.148448 Epoch [12], Iter [12383125], train_loss:0.165396 Epoch [12], Iter [12393125], train_loss:0.181543 Epoch [12], Iter [12403125], train_loss:0.166355 Epoch [12], Iter [12413125], train_loss:0.158869 Epoch [12], Iter [12423125], train_loss:0.153979 Epoch [12], Iter [12433125], train_loss:0.155492 Epoch [12], Iter [12443125], train_loss:0.170940 Epoch [12], Iter [12453125], train_loss:0.166005 Epoch [12], Iter [12463125], train_loss:0.158416 Epoch [12], Iter [12473125], train_loss:0.154584 Epoch [12], Iter [12483125], train_loss:0.152003 Epoch [12], Iter [12493125], train_loss:0.168855 Epoch [12], Iter [12503125], train_loss:0.148871 Epoch [12], Iter [12513125], train_loss:0.175113 Epoch [12], Iter [12523125], train_loss:0.149920 Epoch [12], Iter [12533125], train_loss:0.151580 Epoch [12], Iter [12543125], train_loss:0.168768 Epoch [12], Iter [12553125], train_loss:0.166119 Epoch [12], Iter [12563125], train_loss:0.140963 Epoch [12], Iter [12573125], train_loss:0.168684 Epoch [12], Iter [12583125], train_loss:0.158394 Epoch [12], Iter [12593125], train_loss:0.161410 Epoch [12], Iter [12603125], train_loss:0.148364 Epoch [12], Iter [12613125], train_loss:0.165485 Epoch [12], Iter [12623125], train_loss:0.153689 Epoch [12], Iter [12633125], train_loss:0.171761 Epoch [12], Iter [12643125], train_loss:0.163797 Epoch [12], Iter [12653125], train_loss:0.146530 Epoch [12], Iter [12663125], train_loss:0.158110 Epoch [12], Iter [12673125], train_loss:0.160058 Epoch [12], Iter [12683125], train_loss:0.157368 Epoch [12], Iter [12693125], train_loss:0.151690 Epoch [12], Iter [12703125], train_loss:0.142817 Epoch [12], Iter [12713125], train_loss:0.153046 Epoch [12], Iter [12723125], train_loss:0.162205 Epoch [12], Iter [12733125], train_loss:0.179852 Epoch [12], Iter [12743125], train_loss:0.156627 Epoch [12], Iter [12753125], train_loss:0.158944 Epoch [12], Iter [12763125], train_loss:0.148821 Epoch [12], Iter [12773125], train_loss:0.157448 Epoch [12], Iter [12783125], train_loss:0.178943 Epoch [12], Iter [12793125], train_loss:0.170738 Epoch [12], Iter [12803125], train_loss:0.146238 Epoch [12], Iter [12813125], train_loss:0.166454 Epoch [12], Iter [12823125], train_loss:0.147360 Epoch [12], Iter [12833125], train_loss:0.166235 Epoch [12], Iter [12843125], train_loss:0.160503 Epoch [12], Iter [12853125], train_loss:0.155493 Epoch [12], Iter [12863125], train_loss:0.164259 Epoch [12], Iter [12873125], train_loss:0.159880 Epoch [12], Iter [12883125], train_loss:0.174088 Epoch [12], Iter [12893125], train_loss:0.158363 Epoch [12], Iter [12903125], train_loss:0.160815 Epoch [12], Iter [12913125], train_loss:0.168558 Epoch [12], Iter [12923125], train_loss:0.155379 Epoch [12], Iter [12933125], train_loss:0.158657 Epoch [12], Iter [12943125], train_loss:0.152092 Epoch [12], Iter [12953125], train_loss:0.151002 Epoch [12], Iter [12963125], train_loss:0.177545 Epoch [12], Iter [12973125], train_loss:0.155996 Epoch [12], Iter [12983125], train_loss:0.153431 Epoch [12], Iter [12993125], train_loss:0.160402 Epoch [12], Iter [13003125], train_loss:0.164605 Epoch [12], Iter [13013125], train_loss:0.181966 Epoch [12], Iter [13023125], train_loss:0.150270 Epoch [12], Iter [13033125], train_loss:0.153899 Epoch [12], Iter [13043125], train_loss:0.167255 Epoch [12], Iter [13053125], train_loss:0.164807 Epoch [12], Iter [13063125], train_loss:0.176301 Epoch [12], Iter [13073125], train_loss:0.155036 Epoch [12], Iter [13083125], train_loss:0.167926 Epoch [12], Iter [13093125], train_loss:0.176630 Epoch [12], Iter [13103125], train_loss:0.160102 Epoch [12], Iter [13113125], train_loss:0.173452 Epoch [12], Iter [13123125], train_loss:0.172366 Epoch [12], Iter [13133125], train_loss:0.156772 Epoch [12], Iter [13143125], train_loss:0.168792 Epoch [12], Iter [13153125], train_loss:0.178687 Epoch [12], Iter [13163125], train_loss:0.181647 Epoch [12], Iter [13173125], train_loss:0.154158 Epoch [12], Iter [13183125], train_loss:0.151710 Epoch [12], Iter [13193125], train_loss:0.183539 Epoch [12], Iter [13203125], train_loss:0.160138 Epoch [12], Iter [13213125], train_loss:0.177658 Epoch [12], Iter [13223125], train_loss:0.146497 Epoch [12], Iter [13233125], train_loss:0.196226 Epoch [12], Iter [13243125], train_loss:0.165244 Epoch [12], Iter [13253125], train_loss:0.197831 Epoch [12], Iter [13263125], train_loss:0.175092 Epoch [12], Iter [13273125], train_loss:0.184453 Epoch [12], Iter [13283125], train_loss:0.165453 Epoch [12], Iter [13293125], train_loss:0.145549 Epoch [12], Iter [13303125], train_loss:0.173061 Epoch [12], Iter [13313125], train_loss:0.166073 Epoch [12], Iter [13323125], train_loss:0.156471 Epoch [12], Iter [13333125], train_loss:0.152220 Epoch [12], Iter [13343125], train_loss:0.156158 Epoch [12], Iter [13353125], train_loss:0.165017 Epoch [12], Iter [13363125], train_loss:0.183256 Epoch [12], Iter [13373125], train_loss:0.167704 Epoch [12], Iter [13383125], train_loss:0.154254 Epoch [12], Iter [13393125], train_loss:0.162098 Epoch [12], Iter [13403125], train_loss:0.161697 Epoch [12], Iter [13413125], train_loss:0.164405 Epoch [12], Iter [13423125], train_loss:0.149967 Epoch [12], Iter [13433125], train_loss:0.171982 Epoch [12], Iter [13443125], train_loss:0.155723 Epoch [12], Iter [13453125], train_loss:0.147691 Epoch [12], Iter [13463125], train_loss:0.160214 Epoch [12], Iter [13473125], train_loss:0.154677 Epoch [12], Iter [13483125], train_loss:0.152759 Epoch [12], Iter [13493125], train_loss:0.166476 Epoch [12], Iter [13503125], train_loss:0.163566 Epoch [12], Iter [13513125], train_loss:0.150434 Epoch [12], Iter [13523125], train_loss:0.168793 Epoch [12], Iter [13533125], train_loss:0.162513 Epoch [12], Iter [13543125], train_loss:0.169711 Epoch [12], Iter [13553125], train_loss:0.158046 Epoch [12], Iter [13563125], train_loss:0.151754 Epoch [12], Iter [13573125], train_loss:0.170661 Epoch [12], Iter [13583125], train_loss:0.152679 Epoch [12], Iter [13593125], train_loss:0.167173 Epoch [12], Iter [13603125], train_loss:0.156606 Epoch [12], Iter [13613125], train_loss:0.183170 Epoch [12], Iter [13623125], train_loss:0.142545 Epoch [12], Iter [13633125], train_loss:0.159119 Epoch [12], Iter [13643125], train_loss:0.164405 Epoch [12], Iter [13653125], train_loss:0.159609 Epoch [12], Iter [13663125], train_loss:0.161490 Epoch [12], Iter [13673125], train_loss:0.167248 Epoch [12], Iter [13683125], train_loss:0.165266 Epoch [12], Iter [13693125], train_loss:0.164672 Epoch [12], Iter [13703125], train_loss:0.178968 Epoch [12], Iter [13713125], train_loss:0.139022 Epoch [12], Iter [13723125], train_loss:0.157129 Epoch [12], Iter [13733125], train_loss:0.170236 Epoch [12], Iter [13743125], train_loss:0.172654 Epoch [12], Iter [13753125], train_loss:0.154364 Epoch [12], Iter [13763125], train_loss:0.191031 Epoch [12], Iter [13773125], train_loss:0.154899 Epoch [12], Iter [13783125], train_loss:0.154030 Epoch [12], Iter [13793125], train_loss:0.164986 Epoch [12], Iter [13803125], train_loss:0.149888 Epoch [12], Iter [13813125], train_loss:0.161112 Epoch [12], Iter [13823125], train_loss:0.177446 Epoch [12], Iter [13833125], train_loss:0.181748 Epoch [12], Iter [13843125], train_loss:0.148632 Epoch [12], Iter [13853125], train_loss:0.171001 Epoch [12], Iter [13863125], train_loss:0.146871 Epoch [12], Iter [13873125], train_loss:0.152815 Epoch [12], Iter [13883125], train_loss:0.153880 Epoch [12], Iter [13893125], train_loss:0.167807 Epoch [12], Iter [13903125], train_loss:0.163647 Epoch [12], Iter [13913125], train_loss:0.159752 Epoch [12], Iter [13923125], train_loss:0.148706 Epoch [12], Iter [13933125], train_loss:0.145519 Epoch [12], Iter [13943125], train_loss:0.149635 Epoch [12], Iter [13953125], train_loss:0.156076 Epoch [12], Iter [13963125], train_loss:0.156446 Epoch [12], Iter [13973125], train_loss:0.165825 Epoch [12], Iter [13983125], train_loss:0.145675 Epoch [12], Iter [13993125], train_loss:0.142919 Epoch [12], Iter [14003125], train_loss:0.163214 Epoch [12], Iter [14013125], train_loss:0.155447 Epoch [12], Iter [14023125], train_loss:0.164264 Epoch [12], Iter [14033125], train_loss:0.168581 Epoch [12], Iter [14043125], train_loss:0.149629 Epoch [12], Iter [14053125], train_loss:0.164211 Epoch [12], Iter [14063125], train_loss:0.168869 Epoch [12], Iter [14073125], train_loss:0.153973 Epoch [12], Iter [14083125], train_loss:0.173186 Epoch [12], Iter [14093125], train_loss:0.174420 Epoch [12], Iter [14103125], train_loss:0.154398 Epoch [12], Iter [14113125], train_loss:0.147271 Epoch [12], Iter [14123125], train_loss:0.172150 Epoch [12], Iter [14133125], train_loss:0.144826 Epoch [12], Iter [14143125], train_loss:0.160246 Epoch [12], Iter [14153125], train_loss:0.166100 Epoch [12], Iter [14163125], train_loss:0.151365 Epoch [12], Iter [14173125], train_loss:0.144425 Epoch [12], Iter [14183125], train_loss:0.145632 Epoch [12], Iter [14193125], train_loss:0.167284 Epoch [12], Iter [14203125], train_loss:0.162896 Epoch [12], Iter [14213125], train_loss:0.168027 Epoch [12], Iter [14223125], train_loss:0.160721 Epoch [12], Iter [14233125], train_loss:0.164672 Epoch [12], Iter [14243125], train_loss:0.162177 Epoch [12], Iter [14253125], train_loss:0.166051 Epoch [12], Iter [14263125], train_loss:0.146067 Epoch [12], Iter [14273125], train_loss:0.159922 Epoch [12], Iter [14283125], train_loss:0.152642 Epoch [12], Iter [14293125], train_loss:0.148200 Epoch [12], Iter [14303125], train_loss:0.158262 Epoch [12], Iter [14313125], train_loss:0.149659 Epoch [12], Iter [14323125], train_loss:0.163230 Epoch [12], Iter [14333125], train_loss:0.145847 Epoch [12], Iter [14343125], train_loss:0.173391 Epoch [12], Iter [14353125], train_loss:0.125152 Epoch [12], Iter [14363125], train_loss:0.156048 Epoch [12], Iter [14373125], train_loss:0.157051 Epoch [12], Iter [14383125], train_loss:0.158350 Epoch [12], Iter [14393125], train_loss:0.192877 Epoch [12], Iter [14403125], train_loss:0.167545 Epoch [12], Iter [14413125], train_loss:0.197214 Epoch [12], Iter [14423125], train_loss:0.192135 Epoch [12], Iter [14433125], train_loss:0.172984 Epoch [12], Iter [14443125], train_loss:0.173254 Epoch [12], Iter [14453125], train_loss:0.144135 Epoch [12], Iter [14463125], train_loss:0.169613 Epoch [12], Iter [14473125], train_loss:0.167091 Epoch [12], Iter [14483125], train_loss:0.158223 Epoch [12], Iter [14493125], train_loss:0.172568 Epoch [12], Iter [14503125], train_loss:0.162713 Epoch [12], Iter [14513125], train_loss:0.168839 Epoch [12], Iter [14523125], train_loss:0.168881 Epoch [12], Iter [14533125], train_loss:0.166082 Epoch [12], Iter [14543125], train_loss:0.137113 Epoch [12], Iter [14553125], train_loss:0.156944 Epoch [12], Iter [14563125], train_loss:0.176010 Epoch [12], Iter [14573125], train_loss:0.165683 Epoch [12], Iter [14583125], train_loss:0.166721 Epoch [12], Iter [14593125], train_loss:0.177907 Epoch [12], Iter [14603125], train_loss:0.148519 Epoch [12], Iter [14613125], train_loss:0.178192 Epoch [12], Iter [14623125], train_loss:0.163624 Epoch [12], Iter [14633125], train_loss:0.160104 Epoch [12], Iter [14643125], train_loss:0.175325 Epoch [12], Iter [14653125], train_loss:0.173073 Epoch [12], Iter [14663125], train_loss:0.167916 Epoch [12], Iter [14673125], train_loss:0.161516 Epoch [12], Iter [14683125], train_loss:0.168107 Epoch [12], Iter [14693125], train_loss:0.169824 Epoch [12], Iter [14703125], train_loss:0.160803 Epoch [12], Iter [14713125], train_loss:0.170264 Epoch [12], Iter [14723125], train_loss:0.168911 Epoch [12], Iter [14733125], train_loss:0.143244 Epoch [12], Iter [14743125], train_loss:0.154688 Epoch [12], Iter [14753125], train_loss:0.152704 Epoch [12], Iter [14763125], train_loss:0.153546 Epoch [12], Iter [14773125], train_loss:0.180169 Epoch [12], Iter [14783125], train_loss:0.150831 Epoch [12], Iter [14793125], train_loss:0.171316 Epoch [12], Iter [14803125], train_loss:0.168213 Epoch [12], Iter [14813125], train_loss:0.172205 Epoch [12], Iter [14823125], train_loss:0.142973 Epoch [12], Iter [14833125], train_loss:0.157204 Epoch [12], Iter [14843125], train_loss:0.172524 Epoch [12], Iter [14853125], train_loss:0.157539 Epoch [12], Iter [14863125], train_loss:0.143420 Epoch [12], Iter [14873125], train_loss:0.162053 Epoch [12], Iter [14883125], train_loss:0.167251 Epoch [12], Iter [14893125], train_loss:0.172743 Epoch [12], Iter [14903125], train_loss:0.166958 Epoch [12], Iter [14913125], train_loss:0.168802 Epoch [12], Iter [14923125], train_loss:0.160231 Epoch [12], Iter [14933125], train_loss:0.171343 Epoch [12], Iter [14943125], train_loss:0.167754 Epoch [12], Iter [14953125], train_loss:0.166312 Epoch [12], Iter [14963125], train_loss:0.162917 Epoch [12], Iter [14973125], train_loss:0.162183 Epoch [12], Iter [14983125], train_loss:0.170274 Epoch [12], Iter [14993125], train_loss:0.177937 Epoch [12], Iter [15003125], train_loss:0.142511 Epoch [12], Iter [15013125], train_loss:0.146676 Epoch [12], Iter [15023125], train_loss:0.165919 Epoch [12], Iter [15033125], train_loss:0.153276 Epoch [12], Iter [15043125], train_loss:0.169737 Epoch [12], Iter [15053125], train_loss:0.155799 Epoch [12], Iter [15063125], train_loss:0.160062 Epoch [12], Iter [15073125], train_loss:0.156737 Epoch [12], Iter [15083125], train_loss:0.171055 Epoch [12], Iter [15093125], train_loss:0.155235 Epoch [12], Iter [15103125], train_loss:0.144856 Epoch [12], Iter [15113125], train_loss:0.154941 Epoch [12], Iter [15123125], train_loss:0.141613 Epoch [12], Iter [15133125], train_loss:0.169685 Epoch [12], Iter [15143125], train_loss:0.153574 Epoch [12], Iter [15153125], train_loss:0.165675 Epoch [12], Iter [15163125], train_loss:0.194039 Epoch [12], Iter [15173125], train_loss:0.136731 Epoch [12], Iter [15183125], train_loss:0.162655 Epoch [12], Iter [15193125], train_loss:0.157449 Epoch [12], Iter [15203125], train_loss:0.172672 Epoch [12], Iter [15213125], train_loss:0.185573 Epoch [12], Iter [15223125], train_loss:0.177209 Epoch [12], Iter [15233125], train_loss:0.144910 Epoch [12], Iter [15243125], train_loss:0.160207 Epoch [12], Iter [15253125], train_loss:0.163809 Epoch [12], Iter [15263125], train_loss:0.161429 Epoch [12], Iter [15273125], train_loss:0.149817 Epoch [12], Iter [15283125], train_loss:0.182072 Epoch [12], Iter [15293125], train_loss:0.175234 Epoch [12], Iter [15303125], train_loss:0.170426 Epoch [12], Iter [15313125], train_loss:0.155083 Epoch [12], Iter [15323125], train_loss:0.180693 Epoch [12], Iter [15333125], train_loss:0.168464 Epoch [12], Iter [15343125], train_loss:0.159503 Epoch [12], Iter [15353125], train_loss:0.161271 Epoch [12], Iter [15363125], train_loss:0.141511 Epoch [12], Iter [15373125], train_loss:0.166983 Epoch [12], Iter [15383125], train_loss:0.146959 Epoch [12], Iter [15393125], train_loss:0.161491 Epoch [12], Iter [15403125], train_loss:0.166418 Epoch [12], Iter [15413125], train_loss:0.158611 Epoch [12], Iter [15423125], train_loss:0.152136 Epoch [12], Iter [15433125], train_loss:0.172768 Epoch [12], Iter [15443125], train_loss:0.152095 Epoch [12], Iter [15453125], train_loss:0.142310 Epoch [12], Iter [15463125], train_loss:0.150826 Epoch [12], Iter [15473125], train_loss:0.147781 Epoch [12], Iter [15483125], train_loss:0.171356 Epoch [12], Iter [15493125], train_loss:0.149514 Epoch [12], Iter [15503125], train_loss:0.156635 Epoch [12], Iter [15513125], train_loss:0.172591 Epoch [12], Iter [15523125], train_loss:0.178937 Epoch [12], Iter [15533125], train_loss:0.165982 Epoch [12], Iter [15543125], train_loss:0.169758 Epoch [12], Iter [15553125], train_loss:0.170617 Epoch [12], Iter [15563125], train_loss:0.168998 Epoch [12], Iter [15573125], train_loss:0.165370 Epoch [12], Iter [15583125], train_loss:0.161071 Epoch [12], Iter [15593125], train_loss:0.158345 Epoch [12], Iter [15603125], train_loss:0.186070 Epoch [12], Iter [15613125], train_loss:0.160171 Epoch [12], Iter [15623125], train_loss:0.179954 Epoch [12], Iter [15633125], train_loss:0.172075 Epoch [12], Iter [15643125], train_loss:0.151861 Epoch [12], Iter [15653125], train_loss:0.173611 Epoch [12], Iter [15663125], train_loss:0.167420 Epoch [12], Iter [15673125], train_loss:0.149860 Epoch [12], Iter [15683125], train_loss:0.154862 Epoch [12], Iter [15693125], train_loss:0.168478 Epoch [12], Iter [15703125], train_loss:0.159789 Epoch [12], Iter [15713125], train_loss:0.145618 Epoch [12], Iter [15723125], train_loss:0.171799 Epoch [12], Iter [15733125], train_loss:0.146416 Epoch [12], Iter [15743125], train_loss:0.151151 Epoch [12], Iter [15753125], train_loss:0.179502 Epoch [12], Iter [15763125], train_loss:0.169216 Epoch [12], Iter [15773125], train_loss:0.162661 Epoch [12], Iter [15783125], train_loss:0.155157 Epoch [12], Iter [15793125], train_loss:0.155743 Epoch [12], Iter [15803125], train_loss:0.189926 Epoch [12], Iter [15813125], train_loss:0.164597 Epoch [12], Iter [15823125], train_loss:0.137085 Epoch [12], Iter [15833125], train_loss:0.160498 Epoch [12], Iter [15843125], train_loss:0.179899 Epoch [12], Iter [15853125], train_loss:0.145678 Epoch [12], Iter [15863125], train_loss:0.157172 Epoch [12], Iter [15873125], train_loss:0.168524 Epoch [12], Iter [15883125], train_loss:0.156430 Epoch [12], Iter [15893125], train_loss:0.133350 Epoch [12], Iter [15903125], train_loss:0.176202 Epoch [12], Iter [15913125], train_loss:0.169190 Epoch [12], Iter [15923125], train_loss:0.175895 Epoch [12], Iter [15933125], train_loss:0.174856 Epoch [12], Iter [15943125], train_loss:0.163053 Epoch [12], Iter [15953125], train_loss:0.181598 Epoch [12], Iter [15963125], train_loss:0.144885 Epoch [12], Iter [15973125], train_loss:0.170181 Epoch [12], Iter [15983125], train_loss:0.171142 Epoch [12], Iter [15993125], train_loss:0.141454 Epoch [12], Iter [16003125], train_loss:0.145220 Epoch [12], Iter [16013125], train_loss:0.141769 Epoch [12], Iter [16023125], train_loss:0.154418 Epoch [12], Iter [16033125], train_loss:0.160915 Epoch [12], Iter [16043125], train_loss:0.168919 Epoch [12], Iter [16053125], train_loss:0.180826 Epoch [12], Iter [16063125], train_loss:0.152858 Epoch [12], Iter [16073125], train_loss:0.164291 Epoch [12], Iter [16083125], train_loss:0.163692 Epoch [12], Iter [16093125], train_loss:0.147713 Epoch [12], Iter [16103125], train_loss:0.157055 Epoch [12], Iter [16113125], train_loss:0.194847 Epoch [12], Iter [16123125], train_loss:0.158709 Epoch [12], Iter [16133125], train_loss:0.166231 Epoch [12], Iter [16143125], train_loss:0.186130 Epoch [12], Iter [16153125], train_loss:0.192118 Epoch [12], Iter [16163125], train_loss:0.167463 Epoch [12], Iter [16173125], train_loss:0.137858 Epoch [12], Iter [16183125], train_loss:0.146418 Epoch [12], Iter [16193125], train_loss:0.173478 Epoch [12], Iter [16203125], train_loss:0.161725 Epoch [12], Iter [16213125], train_loss:0.152998 Epoch [12], Iter [16223125], train_loss:0.185276 Epoch [12], Iter [16233125], train_loss:0.152323 Epoch [12], Iter [16243125], train_loss:0.145322 Epoch [12], Iter [16253125], train_loss:0.161513 Epoch [12], Iter [16263125], train_loss:0.153024 Epoch [12], Iter [16273125], train_loss:0.164977 Epoch [12], Iter [16283125], train_loss:0.165822 Epoch [12], Iter [16293125], train_loss:0.151458 Epoch [12], Iter [16303125], train_loss:0.168540 Epoch [12], Iter [16313125], train_loss:0.181315 Epoch [12], Iter [16323125], train_loss:0.169901 Epoch [12], Iter [16333125], train_loss:0.169646 Epoch [12], Iter [16343125], train_loss:0.161900 Epoch [12], Iter [16353125], train_loss:0.141304 Epoch [12], Iter [16363125], train_loss:0.144623 Epoch [12], Iter [16373125], train_loss:0.156594 Epoch [12], Iter [16383125], train_loss:0.150709 Epoch [12], Iter [16393125], train_loss:0.137099 Epoch [12], Iter [16403125], train_loss:0.153333 Epoch [12], Iter [16413125], train_loss:0.157802 Epoch [12], Iter [16423125], train_loss:0.143059 Epoch [12], Iter [16433125], train_loss:0.189253 Epoch [12], Iter [16443125], train_loss:0.155171 Epoch [12], Iter [16453125], train_loss:0.152370 Epoch [12], Iter [16463125], train_loss:0.166632 Epoch [12], Iter [16473125], train_loss:0.179730 Epoch [12], Iter [16483125], train_loss:0.172416 Epoch [12], Iter [16493125], train_loss:0.178696 Epoch [12], Iter [16503125], train_loss:0.160341 Epoch [12], Iter [16513125], train_loss:0.144308 Epoch [12], Iter [16523125], train_loss:0.154410 Epoch [12], Iter [16533125], train_loss:0.173912 Epoch [12], Iter [16543125], train_loss:0.168114 Epoch [12], Iter [16553125], train_loss:0.161952 Epoch [12], Iter [16563125], train_loss:0.169061 Epoch [12], Iter [16573125], train_loss:0.159440 Epoch [12], Iter [16583125], train_loss:0.138091 Epoch [12], Iter [16593125], train_loss:0.155012 Epoch [12], Iter [16603125], train_loss:0.172804 Epoch [12], Iter [16613125], train_loss:0.143058 Epoch [12], Iter [16623125], train_loss:0.162421 Epoch [12], Iter [16633125], train_loss:0.143751 Epoch [12], Iter [16643125], train_loss:0.140241 Epoch [12], Iter [16653125], train_loss:0.172097 Epoch [12], Iter [16663125], train_loss:0.163913 Epoch [12], Iter [16673125], train_loss:0.165221 Epoch [12], Iter [16683125], train_loss:0.174985 Epoch [12], Iter [16693125], train_loss:0.157103 Epoch [12], Iter [16703125], train_loss:0.171044 Epoch [12], Iter [16713125], train_loss:0.179402 Epoch [12], Iter [16723125], train_loss:0.166310 Epoch [12], Iter [16733125], train_loss:0.161387 Epoch [12], Iter [16743125], train_loss:0.159246 Epoch [12], Iter [16753125], train_loss:0.159077 Epoch [12], Iter [16763125], train_loss:0.156243 Epoch [12], Iter [16773125], train_loss:0.177382 Epoch [12], Iter [16783125], train_loss:0.161576 Epoch [12], Iter [16793125], train_loss:0.155681 Epoch [12], Iter [16803125], train_loss:0.182101 Epoch [12], Iter [16813125], train_loss:0.168359 Epoch [12], Iter [16823125], train_loss:0.162136 Epoch [12], Iter [16833125], train_loss:0.175528 Epoch [12], Iter [16843125], train_loss:0.139192 Epoch [12], Iter [16853125], train_loss:0.149815 Epoch [12], Iter [16863125], train_loss:0.182981 Epoch [12], Iter [16873125], train_loss:0.160774 Epoch [12], Iter [16883125], train_loss:0.145968 Epoch [12], Iter [16893125], train_loss:0.158807 Epoch [12], Iter [16903125], train_loss:0.158910 Epoch [12], Iter [16913125], train_loss:0.174940 Epoch [12], Iter [16923125], train_loss:0.155379 Epoch [12], Iter [16933125], train_loss:0.170327 Epoch [12], Iter [16943125], train_loss:0.161909 Epoch [12], Iter [16953125], train_loss:0.150474 Epoch [12], Iter [16963125], train_loss:0.170937 Epoch [12], Iter [16973125], train_loss:0.152703 Epoch [12], Iter [16983125], train_loss:0.168881 Epoch [12], Iter [16993125], train_loss:0.172118 Epoch [12], Iter [17003125], train_loss:0.157837 Epoch [12], Iter [17013125], train_loss:0.160279 Epoch [12], Iter [17023125], train_loss:0.181616 Epoch [12], Iter [17033125], train_loss:0.147026 Epoch [12], Iter [17043125], train_loss:0.157656 Epoch [12], Iter [17053125], train_loss:0.179791 Epoch [12], Iter [17063125], train_loss:0.171684 Epoch [12], Iter [17073125], train_loss:0.138092 Epoch [12], Iter [17083125], train_loss:0.177978 Epoch [12], Iter [17093125], train_loss:0.175673 Epoch [12], Iter [17103125], train_loss:0.151395 Epoch [12], Iter [17113125], train_loss:0.159401 Epoch [12], Iter [17123125], train_loss:0.168381 Epoch [12], Iter [17133125], train_loss:0.166301 Epoch [12], Iter [17143125], train_loss:0.156766 Epoch [12], Iter [17153125], train_loss:0.168902 Epoch [12], Iter [17163125], train_loss:0.169495 Epoch [12], Iter [17173125], train_loss:0.159896 Epoch [12], Iter [17183125], train_loss:0.165244 Epoch [12], Iter [17193125], train_loss:0.145941 Epoch [12], Iter [17203125], train_loss:0.166384 Epoch [12], Iter [17213125], train_loss:0.174706 Epoch [12], Iter [17223125], train_loss:0.141559 Epoch [12], Iter [17233125], train_loss:0.174502 Epoch [12], Iter [17243125], train_loss:0.149242 Epoch [12], Iter [17253125], train_loss:0.143743 Epoch [12], Iter [17263125], train_loss:0.159536 Epoch [12], Iter [17273125], train_loss:0.173931 Epoch [12], Iter [17283125], train_loss:0.152694 Epoch [12], Iter [17293125], train_loss:0.167123 Epoch [12], Iter [17303125], train_loss:0.174618 Epoch [12], Iter [17313125], train_loss:0.187746 Epoch [12], Iter [17323125], train_loss:0.188053 Epoch [12], Iter [17333125], train_loss:0.161420 Epoch [12], Iter [17343125], train_loss:0.143247 Epoch [12], Iter [17353125], train_loss:0.164306 Epoch [12], Iter [17363125], train_loss:0.149670 Epoch [12], Iter [17373125], train_loss:0.180123 Epoch [12], Iter [17383125], train_loss:0.158347 Epoch [12], Iter [17393125], train_loss:0.175313 Epoch [12], Iter [17403125], train_loss:0.154087 Epoch [12], Iter [17413125], train_loss:0.180090 Epoch [12], Iter [17423125], train_loss:0.162183 Epoch [12], Iter [17433125], train_loss:0.164401 Epoch [12], Iter [17443125], train_loss:0.164047 Epoch [12], Iter [17453125], train_loss:0.164262 Epoch [12], Iter [17463125], train_loss:0.155122 Epoch [12], Iter [17473125], train_loss:0.164472 Epoch [12], Iter [17483125], train_loss:0.161191 Epoch [12], Iter [17493125], train_loss:0.160144 Epoch [12], Iter [17503125], train_loss:0.161302 Epoch [12], Iter [17513125], train_loss:0.160503 Epoch [12], Iter [17523125], train_loss:0.155728 Epoch [12], Iter [17533125], train_loss:0.140759 Epoch [12], Iter [17543125], train_loss:0.145626 Epoch [12], Iter [17553125], train_loss:0.164837 Epoch [12], Iter [17563125], train_loss:0.157151 Epoch [12], Iter [17573125], train_loss:0.179853 Epoch [12], Iter [17583125], train_loss:0.150290 Epoch [12], Iter [17593125], train_loss:0.144776 Epoch [12], Iter [17603125], train_loss:0.163736 Epoch [12], Iter [17613125], train_loss:0.161901 Epoch [12], Iter [17623125], train_loss:0.137393 Epoch [12], Iter [17633125], train_loss:0.157102 Epoch [12], Iter [17643125], train_loss:0.147714 Epoch [12], Iter [17653125], train_loss:0.168851 Epoch [12], Iter [17663125], train_loss:0.180556 Epoch [12], Iter [17673125], train_loss:0.145371 Epoch [12], Iter [17683125], train_loss:0.182627 Epoch [12], Iter [17693125], train_loss:0.155184 Epoch [12], Iter [17703125], train_loss:0.170251 Epoch [12], Iter [17713125], train_loss:0.156243 Epoch [12], Iter [17723125], train_loss:0.157432 Epoch [12], Iter [17733125], train_loss:0.165467 Epoch [12], Iter [17743125], train_loss:0.166601 Epoch [12], Iter [17753125], train_loss:0.177986 Epoch [12], Iter [17763125], train_loss:0.165314 Epoch [12], Iter [17773125], train_loss:0.171132 Epoch [12], Iter [17783125], train_loss:0.190048 Epoch [12], Iter [17793125], train_loss:0.165800 Epoch [12], Iter [17803125], train_loss:0.160303 Epoch [12], Iter [17813125], train_loss:0.155642 Epoch [12], Iter [17823125], train_loss:0.146157 Epoch [12], Iter [17833125], train_loss:0.160654 Epoch [12], Iter [17843125], train_loss:0.176773 Epoch [12], Iter [17853125], train_loss:0.169321 Epoch [12], Iter [17863125], train_loss:0.150362 Epoch [12], Iter [17873125], train_loss:0.167345 Epoch [12], Iter [17883125], train_loss:0.145898 Epoch [12], Iter [17893125], train_loss:0.150497 Epoch [12], Iter [17903125], train_loss:0.166425 Epoch [12], Iter [17913125], train_loss:0.171549 Epoch [12], Iter [17923125], train_loss:0.154176 Epoch [12], Iter [17933125], train_loss:0.166127 Epoch [12], Iter [17943125], train_loss:0.165764 Epoch [12], Iter [17953125], train_loss:0.162320 Epoch [12], Iter [17963125], train_loss:0.194941 Epoch [12], Iter [17973125], train_loss:0.157635 Epoch [12], Iter [17983125], train_loss:0.163641 Epoch [12], Iter [17993125], train_loss:0.167187 Epoch [12], Iter [18003125], train_loss:0.145284 Epoch [12], Iter [18013125], train_loss:0.161971 Epoch [12], Iter [18023125], train_loss:0.164058 Epoch [12], Iter [18033125], train_loss:0.142048 Epoch [12], Iter [18043125], train_loss:0.160427 Epoch [12], Iter [18053125], train_loss:0.161583 Epoch [12], Iter [18063125], train_loss:0.155377 Epoch [12], Iter [18073125], train_loss:0.191237 Epoch [12], Iter [18083125], train_loss:0.163925 Epoch [12], Iter [18093125], train_loss:0.190522 Epoch [12], Iter [18103125], train_loss:0.160186 Epoch [12], Iter [18113125], train_loss:0.176043 Epoch [12], Iter [18123125], train_loss:0.170882 Epoch [12], Iter [18133125], train_loss:0.168062 Epoch [12], Iter [18143125], train_loss:0.162766 Epoch [12], Iter [18153125], train_loss:0.168871 Epoch [12], Iter [18163125], train_loss:0.161266 Epoch [12], Iter [18173125], train_loss:0.155407 Epoch [12], Iter [18183125], train_loss:0.145036 Epoch [12], Iter [18193125], train_loss:0.166525 Epoch [12], Iter [18203125], train_loss:0.161894 Epoch [12], Iter [18213125], train_loss:0.179618 Epoch [12], Iter [18223125], train_loss:0.165360 Epoch [12], Iter [18233125], train_loss:0.179443 Epoch [12], Iter [18243125], train_loss:0.182535 Epoch [12], Iter [18253125], train_loss:0.183849 Epoch [12], Iter [18263125], train_loss:0.160797 Epoch [12], Iter [18273125], train_loss:0.155679 Epoch [12], Iter [18283125], train_loss:0.163237 Epoch [12], Iter [18293125], train_loss:0.155929 Epoch [12], Iter [18303125], train_loss:0.169370 Epoch [12], Iter [18313125], train_loss:0.181343 Epoch [12], Iter [18323125], train_loss:0.150245 Epoch [12], Iter [18333125], train_loss:0.173141 Epoch [12], Iter [18343125], train_loss:0.163475 Epoch [12], Iter [18353125], train_loss:0.163326 Epoch [12], Iter [18363125], train_loss:0.157031 Epoch [12], Iter [18373125], train_loss:0.166926 Epoch [12], Iter [18383125], train_loss:0.181456 Epoch [12], Iter [18393125], train_loss:0.166013 Epoch [12], Iter [18403125], train_loss:0.151755 Epoch [12], Iter [18413125], train_loss:0.172941 Epoch [12], Iter [18423125], train_loss:0.175330 Epoch [12], Iter [18433125], train_loss:0.147175 Epoch [12], Iter [18443125], train_loss:0.178653 Epoch [12], Iter [18453125], train_loss:0.152745 Epoch [12], Iter [18463125], train_loss:0.142007 Epoch [12], Iter [18473125], train_loss:0.148765 Epoch [12], Iter [18483125], train_loss:0.166682 Epoch [12], Iter [18493125], train_loss:0.156195 Epoch [12], Iter [18503125], train_loss:0.156262 Epoch [12], Iter [18513125], train_loss:0.160495 Epoch [12], Iter [18523125], train_loss:0.162996 Epoch [12], Iter [18533125], train_loss:0.162435 Epoch [12], Iter [18543125], train_loss:0.161346 Epoch [12], Iter [18553125], train_loss:0.171397 Epoch [12], Iter [18563125], train_loss:0.177385 Epoch [12], Iter [18573125], train_loss:0.130351 Epoch [12], Iter [18583125], train_loss:0.151499 Epoch [12], Iter [18593125], train_loss:0.149441 Epoch [12], Iter [18603125], train_loss:0.164405 Epoch [12], Iter [18613125], train_loss:0.163205 Epoch [12], Iter [18623125], train_loss:0.177325 Epoch [12], Iter [18633125], train_loss:0.155396 Epoch [12], Iter [18643125], train_loss:0.162093 Epoch [12], Iter [18653125], train_loss:0.155531 Epoch [12], Iter [18663125], train_loss:0.147332 Epoch [12], Iter [18673125], train_loss:0.150838 Epoch [12], Iter [18683125], train_loss:0.154241 Epoch [12], Iter [18693125], train_loss:0.142730 Epoch [12], Iter [18703125], train_loss:0.154984 Epoch [12], Iter [18713125], train_loss:0.141732 Epoch [12], Iter [18723125], train_loss:0.169305 Epoch [12], Iter [18733125], train_loss:0.158314 Epoch [12], Iter [18743125], train_loss:0.155676 Epoch [12], Iter [18753125], train_loss:0.162900 Epoch [12], Iter [18763125], train_loss:0.174867 Epoch [12], Iter [18773125], train_loss:0.165536 Epoch [12], Iter [18783125], train_loss:0.153315 Epoch [12], Iter [18793125], train_loss:0.150544 Epoch [12], Iter [18803125], train_loss:0.183719 Epoch [12], Iter [18813125], train_loss:0.160276 Epoch [12], Iter [18823125], train_loss:0.169111 Epoch [12], Iter [18833125], train_loss:0.162062 Epoch [12], Iter [18843125], train_loss:0.136829 Epoch [12], Iter [18853125], train_loss:0.152484 Epoch [12], Iter [18863125], train_loss:0.157395 Epoch [12], Iter [18873125], train_loss:0.153584 Epoch [12], Iter [18883125], train_loss:0.184233 Epoch [12], Iter [18893125], train_loss:0.158605 Epoch [12], Iter [18903125], train_loss:0.160698 Epoch [12], Iter [18913125], train_loss:0.160876 Epoch [12], Iter [18923125], train_loss:0.169683 Epoch [12], Iter [18933125], train_loss:0.157519 Epoch [12], Iter [18943125], train_loss:0.159938 Epoch [12], Iter [18953125], train_loss:0.170259 Epoch [12], Iter [18963125], train_loss:0.184046 Epoch [12], Iter [18973125], train_loss:0.153115 Epoch [12], Iter [18983125], train_loss:0.157097 Epoch [12], Iter [18993125], train_loss:0.162475 Epoch [12], Iter [19003125], train_loss:0.161365 Epoch [12], Iter [19013125], train_loss:0.173105 Epoch [12], Iter [19023125], train_loss:0.148295 Epoch [12], Iter [19033125], train_loss:0.165971 Epoch [12], Iter [19043125], train_loss:0.158941 Epoch [12], Iter [19053125], train_loss:0.167976 Epoch [12], Iter [19063125], train_loss:0.161314 Epoch [12], Iter [19073125], train_loss:0.142002 Epoch [12], Iter [19083125], train_loss:0.155992 Epoch [12], Iter [19093125], train_loss:0.159452 Epoch [12], Iter [19103125], train_loss:0.167375 Epoch [12], Iter [19113125], train_loss:0.160087 Epoch [12], Iter [19123125], train_loss:0.162730 Epoch [12], Iter [19133125], train_loss:0.166080 Epoch [12], Iter [19143125], train_loss:0.186217 Epoch [12], Iter [19153125], train_loss:0.151830 Epoch [12], Iter [19163125], train_loss:0.168950 Epoch [12], Iter [19173125], train_loss:0.153571 Epoch [12], Iter [19183125], train_loss:0.164015 Epoch [12], Iter [19193125], train_loss:0.159809 Epoch [12], Iter [19203125], train_loss:0.146458 Epoch [12], Iter [19213125], train_loss:0.160593 Epoch [12], Iter [19223125], train_loss:0.152458 Epoch [12], Iter [19233125], train_loss:0.170881 Epoch [12], Iter [19243125], train_loss:0.158566 Epoch [12], Iter [19253125], train_loss:0.155870 Epoch [12], Iter [19263125], train_loss:0.188001 Epoch [12], Iter [19273125], train_loss:0.169803 Epoch [12], Iter [19283125], train_loss:0.150111 Epoch [12], Iter [19293125], train_loss:0.163295 Epoch [12], Iter [19303125], train_loss:0.145743 Epoch [12], Iter [19313125], train_loss:0.154151 Epoch [12], Iter [19323125], train_loss:0.160207 Epoch [12], Iter [19333125], train_loss:0.158596 Epoch [12], Iter [19343125], train_loss:0.173918 Epoch [12], Iter [19353125], train_loss:0.184682 Epoch [12], Iter [19363125], train_loss:0.184060 Epoch [12], Iter [19373125], train_loss:0.165681 Epoch [12], Iter [19383125], train_loss:0.172499 Epoch [12], Iter [19393125], train_loss:0.154547 Epoch [12], Iter [19403125], train_loss:0.147814 Epoch [12], Iter [19413125], train_loss:0.161590 Epoch [12], Iter [19423125], train_loss:0.141166 Epoch [12], Iter [19433125], train_loss:0.151419 Epoch [12], Iter [19443125], train_loss:0.152621 Epoch [12], Iter [19453125], train_loss:0.164691 Epoch [12], Iter [19463125], train_loss:0.146373 Epoch [12], Iter [19473125], train_loss:0.148736 Epoch [12], Iter [19483125], train_loss:0.199945 Epoch [12], Iter [19493125], train_loss:0.154226 Epoch [12], Iter [19503125], train_loss:0.173260 Epoch [12], Iter [19513125], train_loss:0.161090 Epoch [12], Iter [19523125], train_loss:0.169187 Epoch [12], Iter [19533125], train_loss:0.164385 Epoch [12], Iter [19543125], train_loss:0.151662 Epoch [12], Iter [19553125], train_loss:0.165125 Epoch [12], Iter [19563125], train_loss:0.154994 Epoch [12], Iter [19573125], train_loss:0.173068 Epoch [12], Iter [19583125], train_loss:0.175447 Epoch [12], Iter [19593125], train_loss:0.170935 Epoch [12], Iter [19603125], train_loss:0.167173 Epoch [12], Iter [19613125], train_loss:0.181798 Epoch [12], Iter [19623125], train_loss:0.149530 Epoch [12], Iter [19633125], train_loss:0.162909 Epoch [12], Iter [19643125], train_loss:0.159980 Epoch [12], Iter [19653125], train_loss:0.152192 Epoch [12], Iter [19663125], train_loss:0.178360 Epoch [12], Iter [19673125], train_loss:0.146795 Epoch [12], Iter [19683125], train_loss:0.143748 Epoch [12], Iter [19693125], train_loss:0.181524 Epoch [12], Iter [19703125], train_loss:0.156961 Epoch [12], Iter [19713125], train_loss:0.157196 Epoch [12], Iter [19723125], train_loss:0.156264 Epoch [12], Iter [19733125], train_loss:0.155585 Epoch [12], Iter [19743125], train_loss:0.165857 Epoch [12], Iter [19753125], train_loss:0.179051 Epoch [12], Iter [19763125], train_loss:0.154581 Epoch [12], Iter [19773125], train_loss:0.169368 Epoch [12], Iter [19783125], train_loss:0.144383 Epoch [12], Iter [19793125], train_loss:0.152714 Epoch [12], Iter [19803125], train_loss:0.148939 Epoch [12], Iter [19813125], train_loss:0.175638 Epoch [12], Iter [19823125], train_loss:0.168751 Epoch [12], Iter [19833125], train_loss:0.162145 Epoch [12], Iter [19843125], train_loss:0.182724 Epoch [12], Iter [19853125], train_loss:0.155977 Epoch [12], Iter [19863125], train_loss:0.155561 Epoch [12], Iter [19873125], train_loss:0.191799 Epoch [12], Iter [19883125], train_loss:0.167943 Epoch [12], Iter [19893125], train_loss:0.163147 Epoch [12], Iter [19903125], train_loss:0.176683 Epoch [12], Iter [19913125], train_loss:0.158023 Epoch [12], Iter [19923125], train_loss:0.160804 Epoch [12], Iter [19933125], train_loss:0.158202 Epoch [12], Iter [19943125], train_loss:0.170246 Epoch [12], Iter [19953125], train_loss:0.165867 Epoch [12], Iter [19963125], train_loss:0.144000 Epoch [12], Iter [19973125], train_loss:0.162011 Epoch [12], Iter [19983125], train_loss:0.168511 Epoch [12], Iter [19993125], train_loss:0.156590 Epoch [12], Iter [20003125], train_loss:0.151475 Epoch [12], Iter [20013125], train_loss:0.172778 Epoch [12], Iter [20023125], train_loss:0.174170 Epoch [12], Iter [20033125], train_loss:0.172485 Epoch [12], Iter [20043125], train_loss:0.151658 Epoch [12], Iter [20053125], train_loss:0.165962 Epoch [12], Iter [20063125], train_loss:0.143169 Epoch [12], Iter [20073125], train_loss:0.170595 Epoch [12], Iter [20083125], train_loss:0.200333 Epoch [12], Iter [20093125], train_loss:0.163445 Epoch [12], Iter [20103125], train_loss:0.150004 Epoch [12], Iter [20113125], train_loss:0.157552 Epoch [12], Iter [20123125], train_loss:0.168187 Epoch [12], Iter [20133125], train_loss:0.153843 Epoch [12], Iter [20143125], train_loss:0.169956 Epoch [12], Iter [20153125], train_loss:0.171310 Epoch [12], Iter [20163125], train_loss:0.152466 Epoch [12], Iter [20173125], train_loss:0.173650 Epoch [12], Iter [20183125], train_loss:0.162068 Epoch [12], Iter [20193125], train_loss:0.130321 Epoch [12], Iter [20203125], train_loss:0.124815 Epoch [12], Iter [20213125], train_loss:0.145361 Epoch [12], Iter [20223125], train_loss:0.146677 Epoch [12], Iter [20233125], train_loss:0.165708 Epoch [12], Iter [20243125], train_loss:0.176067 Epoch [12], Iter [20253125], train_loss:0.168302 Epoch [12], Iter [20263125], train_loss:0.154875 Epoch [12], Iter [20273125], train_loss:0.164601 Epoch [12], Iter [20283125], train_loss:0.171662 Epoch [12], Iter [20293125], train_loss:0.151342 Epoch [12], Iter [20303125], train_loss:0.162905 Epoch [12], Iter [20313125], train_loss:0.155055 Epoch [12], Iter [20323125], train_loss:0.133530 Epoch [12], Iter [20333125], train_loss:0.145367 Epoch [12], Iter [20343125], train_loss:0.140172 Epoch [12], Iter [20353125], train_loss:0.166013 Epoch [12], Iter [20363125], train_loss:0.160138 Epoch [12], Iter [20373125], train_loss:0.149895 Epoch [12], Iter [20383125], train_loss:0.158618 Epoch [12], Iter [20393125], train_loss:0.182976 Epoch [12], Iter [20403125], train_loss:0.163650 Epoch [12], Iter [20413125], train_loss:0.156669 Epoch [12], Iter [20423125], train_loss:0.161290 Epoch [12], Iter [20433125], train_loss:0.162484 Epoch [12], Iter [20443125], train_loss:0.167114 Epoch [12], Iter [20453125], train_loss:0.170945 Epoch [12], Iter [20463125], train_loss:0.155789 Epoch [12], Iter [20473125], train_loss:0.164060 Epoch [12], Iter [20483125], train_loss:0.186333 Epoch [12], Iter [20493125], train_loss:0.160162 Epoch [12], Iter [20503125], train_loss:0.159823 Epoch [12], Iter [20513125], train_loss:0.158371 Epoch [12], Iter [20523125], train_loss:0.159072 Epoch [12], Iter [20533125], train_loss:0.173952 Epoch [12], Iter [20543125], train_loss:0.161498 Epoch [12], Iter [20553125], train_loss:0.147181 Epoch [12], Iter [20563125], train_loss:0.176381 Epoch [12], Iter [20573125], train_loss:0.133942 Epoch [12], Iter [20583125], train_loss:0.144585 Epoch [12], Iter [20593125], train_loss:0.162973 Epoch [12], Iter [20603125], train_loss:0.165241 Epoch [12], Iter [20613125], train_loss:0.174846 Epoch [12], Iter [20623125], train_loss:0.180418 Epoch [12], Iter [20633125], train_loss:0.182369 Epoch [12], Iter [20643125], train_loss:0.148855 Epoch [12], Iter [20653125], train_loss:0.180047 Epoch [12], Iter [20663125], train_loss:0.131797 Epoch [12], Iter [20673125], train_loss:0.161162 Epoch [12], Iter [20683125], train_loss:0.153623 Epoch [12], Iter [20693125], train_loss:0.177079 Epoch [12], Iter [20703125], train_loss:0.166252 Epoch [12], Iter [20713125], train_loss:0.167907 Epoch [12], Iter [20723125], train_loss:0.168837 Epoch [12], Iter [20733125], train_loss:0.178388 Epoch [12], Iter [20743125], train_loss:0.167471 Epoch [12], Iter [20753125], train_loss:0.182263 Epoch [12], Iter [20763125], train_loss:0.164933 Epoch [12], Iter [20773125], train_loss:0.159932 Epoch [12], Iter [20783125], train_loss:0.165879 Epoch [12], Iter [20793125], train_loss:0.168112 Epoch [12], Iter [20803125], train_loss:0.164080 Epoch [12], Iter [20813125], train_loss:0.177289 Epoch [12], Iter [20823125], train_loss:0.156052 Epoch [12], Iter [20833125], train_loss:0.150370 Epoch [12], Iter [20843125], train_loss:0.157389 Epoch [12], Iter [20853125], train_loss:0.164571 Epoch [12], Iter [20863125], train_loss:0.165030 Epoch [12], Iter [20873125], train_loss:0.165491 Epoch [12], Iter [20883125], train_loss:0.157076 Epoch [12], Iter [20893125], train_loss:0.157584 Epoch [12], Iter [20903125], train_loss:0.142475 Epoch [12], Iter [20913125], train_loss:0.161959 Epoch [12], Iter [20923125], train_loss:0.150067 Epoch [12], Iter [20933125], train_loss:0.169877 Epoch [12], Iter [20943125], train_loss:0.175256 Epoch [12], Iter [20953125], train_loss:0.150007 Epoch [12], Iter [20963125], train_loss:0.175035 Epoch [12], Iter [20973125], train_loss:0.143745 Epoch [12], Iter [20983125], train_loss:0.175930 Epoch [12], Iter [20993125], train_loss:0.148834 Epoch [12], Iter [21003125], train_loss:0.165045 Epoch [12], Iter [21013125], train_loss:0.142969 Epoch [12], Iter [21023125], train_loss:0.147515 Epoch [12], Iter [21033125], train_loss:0.144696 Epoch [12], Iter [21043125], train_loss:0.170307 Epoch [12], Iter [21053125], train_loss:0.153275 Epoch [12], Iter [21063125], train_loss:0.174566 Epoch [12], Iter [21073125], train_loss:0.168739 Epoch [12], Iter [21083125], train_loss:0.168275 Epoch [12], Iter [21093125], train_loss:0.156382 Epoch [12], Iter [21103125], train_loss:0.180446 Epoch [12], Iter [21113125], train_loss:0.168478 Epoch [12], Iter [21123125], train_loss:0.161389 Epoch [12], Iter [21133125], train_loss:0.166829 Epoch [12], Iter [21143125], train_loss:0.144316 Epoch [12], Iter [21153125], train_loss:0.180950 Epoch [12], Iter [21163125], train_loss:0.160766 Epoch [12], Iter [21173125], train_loss:0.134064 Epoch [12], Iter [21183125], train_loss:0.133301 Epoch [12], Iter [21193125], train_loss:0.156353 Epoch [12], Iter [21203125], train_loss:0.155335 Epoch [12], Iter [21213125], train_loss:0.156238 Epoch [12], Iter [21223125], train_loss:0.167666 Epoch [12], Iter [21233125], train_loss:0.139103 Epoch [12], Iter [21243125], train_loss:0.164919 Epoch [12], Iter [21253125], train_loss:0.172402 Epoch [12], Iter [21263125], train_loss:0.156982 Epoch [12], Iter [21273125], train_loss:0.174418 Epoch [12], Iter [21283125], train_loss:0.163564 Epoch [12], Iter [21293125], train_loss:0.155914 Epoch [12], Iter [21303125], train_loss:0.155929 Epoch [12], Iter [21313125], train_loss:0.164747 Epoch [12], Iter [21323125], train_loss:0.169162 Epoch [12], Iter [21333125], train_loss:0.176287 Epoch [12], Iter [21343125], train_loss:0.145140 Epoch [12], Iter [21353125], train_loss:0.172772 Epoch [12], Iter [21363125], train_loss:0.172442 Epoch [12], Iter [21373125], train_loss:0.166545 Epoch [12], Iter [21383125], train_loss:0.155658 Epoch [12], Iter [21393125], train_loss:0.144825 Epoch [12], Iter [21403125], train_loss:0.165197 Epoch [12], Iter [21413125], train_loss:0.179990 Epoch [12], Iter [21423125], train_loss:0.155233 Epoch [12], Iter [21433125], train_loss:0.162739 Epoch [12], Iter [21443125], train_loss:0.156480 Epoch [12], Iter [21453125], train_loss:0.155214 Epoch [12], Iter [21463125], train_loss:0.162011 Epoch [12], Iter [21473125], train_loss:0.163268 Epoch [12], Iter [21483125], train_loss:0.180236 Epoch [12], Iter [21493125], train_loss:0.173788 Epoch [12], Iter [21503125], train_loss:0.155130 Epoch [12], Iter [21513125], train_loss:0.165528 Epoch [12], Iter [21523125], train_loss:0.176281 Epoch [12], Iter [21533125], train_loss:0.151886 Epoch [12], Iter [21543125], train_loss:0.145217 Epoch [12], Iter [21553125], train_loss:0.162727 Epoch [12], Iter [21563125], train_loss:0.167274 Epoch [12], Iter [21573125], train_loss:0.192076 Epoch [12], Iter [21583125], train_loss:0.163333 Epoch [12], Iter [21593125], train_loss:0.162825 Epoch [12], Iter [21603125], train_loss:0.187321 Epoch [12], Iter [21613125], train_loss:0.158406 Epoch [12], Iter [21623125], train_loss:0.179870 Epoch [12], Iter [21633125], train_loss:0.138683 Epoch [12], Iter [21643125], train_loss:0.150967 Epoch [12], Iter [21653125], train_loss:0.131095 Epoch [12], Iter [21663125], train_loss:0.183638 Epoch [12], Iter [21673125], train_loss:0.159978 Epoch [12], Iter [21683125], train_loss:0.186739 Epoch [12], Iter [21693125], train_loss:0.181425 Epoch [12], Iter [21703125], train_loss:0.168422 Epoch [12], Iter [21713125], train_loss:0.167889 Epoch [12], Iter [21723125], train_loss:0.140880 Epoch [12], Iter [21733125], train_loss:0.181237 Epoch [12], Iter [21743125], train_loss:0.159820 Epoch [12], Iter [21753125], train_loss:0.157872 Epoch [12], Iter [21763125], train_loss:0.158261 Epoch [12], Iter [21773125], train_loss:0.142904 Epoch [12], Iter [21783125], train_loss:0.172463 Epoch [12], Iter [21793125], train_loss:0.149298 Epoch [12], Iter [21803125], train_loss:0.159796 Epoch [12], Iter [21813125], train_loss:0.169302 Epoch [12], Iter [21823125], train_loss:0.185946 Epoch [12], Iter [21833125], train_loss:0.158634 Epoch [12], Iter [21843125], train_loss:0.163283 Epoch [12], Iter [21853125], train_loss:0.147155 Epoch [12], Iter [21863125], train_loss:0.169214 Epoch [12], Iter [21873125], train_loss:0.170750 Epoch [12], Iter [21883125], train_loss:0.164639 Epoch [12], Iter [21893125], train_loss:0.167140 Epoch [12], Iter [21903125], train_loss:0.165556 Epoch [12], Iter [21913125], train_loss:0.173164 Epoch [12], Iter [21923125], train_loss:0.158743 Epoch [12], Iter [21933125], train_loss:0.165279 Epoch [12], Iter [21943125], train_loss:0.151960 Epoch [12], Iter [21953125], train_loss:0.149383 Epoch [12], Iter [21963125], train_loss:0.157849 Epoch [12], Iter [21973125], train_loss:0.168340 Epoch [12], Iter [21983125], train_loss:0.156435 Epoch [12], Iter [21993125], train_loss:0.139338 Epoch [12], Iter [22003125], train_loss:0.160937 Epoch [12], Iter [22013125], train_loss:0.155327 Epoch [12], Iter [22023125], train_loss:0.177210 Epoch [12], Iter [22033125], train_loss:0.178461 Epoch [12], Iter [22043125], train_loss:0.171101 Epoch [12], Iter [22053125], train_loss:0.184354 Epoch [12], Iter [22063125], train_loss:0.144931 Epoch [12], Iter [22073125], train_loss:0.163896 Epoch [12], Iter [22083125], train_loss:0.169595 Epoch [12], Iter [22093125], train_loss:0.157569 Epoch [12], Iter [22103125], train_loss:0.178770 Epoch [12], Iter [22113125], train_loss:0.143887 Epoch [12], Iter [22123125], train_loss:0.161863 Epoch [12], Iter [22133125], train_loss:0.141911 Epoch [12], Iter [22143125], train_loss:0.141126 Epoch [12], Iter [22153125], train_loss:0.181017 Epoch [12], Iter [22163125], train_loss:0.147786 Epoch [12], Iter [22173125], train_loss:0.141503 Epoch [12], Iter [22183125], train_loss:0.157903 Epoch [12], Iter [22193125], train_loss:0.154843 Epoch [12], Iter [22203125], train_loss:0.148844 Epoch [12], Iter [22213125], train_loss:0.161168 Epoch [12], Iter [22223125], train_loss:0.171695 Epoch [12], Iter [22233125], train_loss:0.163227 Epoch [12], Iter [22243125], train_loss:0.159965 Epoch [12], Iter [22253125], train_loss:0.162049 Epoch [12], Iter [22263125], train_loss:0.172635 Epoch [12], Iter [22273125], train_loss:0.152669 Epoch [12], Iter [22283125], train_loss:0.154830 Epoch [12], Iter [22293125], train_loss:0.163990 Epoch [12], Iter [22303125], train_loss:0.168742 Epoch [12], Iter [22313125], train_loss:0.183449 Epoch [12], Iter [22323125], train_loss:0.148132 Epoch [12], Iter [22333125], train_loss:0.175107 Epoch [12], Iter [22343125], train_loss:0.157387 Epoch [12], Iter [22353125], train_loss:0.150439 Epoch [12], Iter [22363125], train_loss:0.141313 Epoch [12], Iter [22373125], train_loss:0.150460 Epoch [12], Iter [22383125], train_loss:0.157583 Epoch [12], Iter [22393125], train_loss:0.160917 Epoch [12], Iter [22403125], train_loss:0.175020 Epoch [12], Iter [22413125], train_loss:0.172231 Epoch [12], Iter [22423125], train_loss:0.158164 Epoch [12], Iter [22433125], train_loss:0.149750 Epoch [12], Iter [22443125], train_loss:0.160434 Epoch [12], Iter [22453125], train_loss:0.163752 Epoch [12], Iter [22463125], train_loss:0.146884 Epoch [12], Iter [22473125], train_loss:0.158364 Epoch [12], Iter [22483125], train_loss:0.156011 Epoch [12], Iter [22493125], train_loss:0.173126 Epoch [12], Iter [22503125], train_loss:0.193422 Epoch [12], Iter [22513125], train_loss:0.158470 Epoch [12], Iter [22523125], train_loss:0.151245 Epoch [12], Iter [22533125], train_loss:0.158039 Epoch [12], Iter [22543125], train_loss:0.152211 Epoch [12], Iter [22553125], train_loss:0.167252 Epoch [12], Iter [22563125], train_loss:0.156284 Epoch [12], Iter [22573125], train_loss:0.157557 Epoch [12], Iter [22583125], train_loss:0.149407 Epoch [12], Iter [22593125], train_loss:0.166932 Epoch [12], Iter [22603125], train_loss:0.174253 Epoch [12], Iter [22613125], train_loss:0.171375 Epoch [12], Iter [22623125], train_loss:0.166366 Epoch [12], Iter [22633125], train_loss:0.149717 Epoch [12], Iter [22643125], train_loss:0.166810 Epoch [12], Iter [22653125], train_loss:0.162488 Epoch [12], Iter [22663125], train_loss:0.165728 Epoch [12], Iter [22673125], train_loss:0.168702 Epoch [12], Iter [22683125], train_loss:0.143795 Epoch [12], Iter [22693125], train_loss:0.125662 Epoch [12], Iter [22703125], train_loss:0.152566 Epoch [12], Iter [22713125], train_loss:0.166331 Epoch [12], Iter [22723125], train_loss:0.146904 Epoch [12], Iter [22733125], train_loss:0.176470 Epoch [12], Iter [22743125], train_loss:0.166159 Epoch [12], Iter [22753125], train_loss:0.164638 Epoch [12], Iter [22763125], train_loss:0.174697 Epoch [12], Iter [22773125], train_loss:0.172518 Epoch [12], Iter [22783125], train_loss:0.179059 Epoch [12], Iter [22793125], train_loss:0.153997 Epoch [12], Iter [22803125], train_loss:0.164288 Epoch [12], Iter [22813125], train_loss:0.156835 Epoch [12], Iter [22823125], train_loss:0.172427 Epoch [12], Iter [22833125], train_loss:0.140807 Epoch [12], Iter [22843125], train_loss:0.176298 Epoch [12], Iter [22853125], train_loss:0.167197 Epoch [12], Iter [22863125], train_loss:0.155124 Epoch [12], Iter [22873125], train_loss:0.168967 Epoch [12], Iter [22883125], train_loss:0.155021 Epoch [12], Iter [22893125], train_loss:0.200430 Epoch [12], Iter [22903125], train_loss:0.168794 Epoch [12], Iter [22913125], train_loss:0.180748 Epoch [12], Iter [22923125], train_loss:0.151308 Epoch [12], Iter [22933125], train_loss:0.168426 Epoch [12], Iter [22943125], train_loss:0.160170 Epoch [12], Iter [22953125], train_loss:0.170112 Epoch [12], Iter [22963125], train_loss:0.182302 Epoch [12], Iter [22973125], train_loss:0.165573 Epoch [12], Iter [22983125], train_loss:0.154088 Epoch [12], Iter [22993125], train_loss:0.157324 Epoch [12], Iter [23003125], train_loss:0.186557 Epoch [12], Iter [23013125], train_loss:0.159513 Epoch [12], Iter [23023125], train_loss:0.159842 Epoch [12], Iter [23033125], train_loss:0.196757 Epoch [12], Iter [23043125], train_loss:0.164728 Epoch [12], Iter [23053125], train_loss:0.159394 Epoch [12], Iter [23063125], train_loss:0.162070 Epoch [12], Iter [23073125], train_loss:0.150942 Epoch [12], Iter [23083125], train_loss:0.178885 Epoch [12], Iter [23093125], train_loss:0.167701 Epoch [12], Iter [23103125], train_loss:0.172832 Epoch [12], Iter [23113125], train_loss:0.151420 Epoch [12], Iter [23123125], train_loss:0.177722 Epoch [12], Iter [23133125], train_loss:0.152966 Epoch [12], Iter [23143125], train_loss:0.144942 Epoch [12], Iter [23153125], train_loss:0.166451 Epoch [12], Iter [23163125], train_loss:0.167570 Epoch [12], Iter [23173125], train_loss:0.173486 Epoch [12], Iter [23183125], train_loss:0.167726 Epoch [12], Iter [23193125], train_loss:0.150083 Epoch [12], Iter [23203125], train_loss:0.161335 Epoch [12], Iter [23213125], train_loss:0.163541 Epoch [12], Iter [23223125], train_loss:0.139134 Epoch [12], Iter [23233125], train_loss:0.172992 Epoch [12], Iter [23243125], train_loss:0.166975 Epoch [12], Iter [23253125], train_loss:0.161279 Epoch [12], Iter [23263125], train_loss:0.152028 Epoch [12], Iter [23273125], train_loss:0.157792 Epoch [12], Iter [23283125], train_loss:0.146232 Epoch [12], Iter [23293125], train_loss:0.169053 Epoch [12], Iter [23303125], train_loss:0.137772 Epoch [12], Iter [23313125], train_loss:0.153836 Epoch [12], Iter [23323125], train_loss:0.173346 Epoch [12], Iter [23333125], train_loss:0.170181 Epoch [12], Iter [23343125], train_loss:0.153624 Epoch [12], Iter [23353125], train_loss:0.164155 Epoch [12], Iter [23363125], train_loss:0.162456 Epoch [12], Iter [23373125], train_loss:0.165626 Epoch [12], Iter [23383125], train_loss:0.165643 Epoch [12], Iter [23393125], train_loss:0.152838 Epoch [12], Iter [23403125], train_loss:0.166339 Epoch [12], Iter [23413125], train_loss:0.162481 Epoch [12], Iter [23423125], train_loss:0.155828 Epoch [12], Iter [23433125], train_loss:0.180035 Epoch [12], Iter [23443125], train_loss:0.155793 Epoch [12], Iter [23453125], train_loss:0.141963 Epoch [12], Iter [23463125], train_loss:0.175218 Epoch [12], Iter [23473125], train_loss:0.172332 Epoch [12], Iter [23483125], train_loss:0.170206 Epoch [12], Iter [23493125], train_loss:0.158258 Epoch [12], Iter [23503125], train_loss:0.135423 Epoch [12], Iter [23513125], train_loss:0.158765 Epoch [12], Iter [23523125], train_loss:0.161856 Epoch [12], Iter [23533125], train_loss:0.165698 Epoch [12], Iter [23543125], train_loss:0.166844 Epoch [12], Iter [23553125], train_loss:0.167199 Epoch [12], Iter [23563125], train_loss:0.168643 Epoch [12], Iter [23573125], train_loss:0.145062 Epoch [12], Iter [23583125], train_loss:0.159673 Epoch [12], Iter [23593125], train_loss:0.172321 Epoch [12], Iter [23603125], train_loss:0.162261 Epoch [12], Iter [23613125], train_loss:0.160964 Epoch [12], Iter [23623125], train_loss:0.170365 Epoch [12], Iter [23633125], train_loss:0.158219 Epoch [12], Iter [23643125], train_loss:0.151682 Epoch [12], Iter [23653125], train_loss:0.173451 Epoch [12], Iter [23663125], train_loss:0.186411 Epoch [12], Iter [23673125], train_loss:0.151850 Epoch [12], Iter [23683125], train_loss:0.153410 Epoch [12], Iter [23693125], train_loss:0.150387 Epoch [12], Iter [23703125], train_loss:0.151061 Epoch [12], Iter [23713125], train_loss:0.155576 Epoch [12], Iter [23723125], train_loss:0.171615 Epoch [12], Iter [23733125], train_loss:0.152891 Epoch [12], Iter [23743125], train_loss:0.173333 Epoch [12], Iter [23753125], train_loss:0.178193 Epoch [12], Iter [23763125], train_loss:0.158169 Epoch [12], Iter [23773125], train_loss:0.171027 Epoch [12], Iter [23783125], train_loss:0.183264 Epoch [12], Iter [23793125], train_loss:0.153622 Epoch [12], Iter [23803125], train_loss:0.167066 Epoch [12], Iter [23813125], train_loss:0.151149 Epoch [12], Iter [23823125], train_loss:0.149457 Epoch [12], Iter [23833125], train_loss:0.151908 Epoch [12], Iter [23843125], train_loss:0.167173 Epoch [12], Iter [23853125], train_loss:0.146533 Epoch [12], Iter [23863125], train_loss:0.140869 Epoch [12], Iter [23873125], train_loss:0.161093 Epoch [12], Iter [23883125], train_loss:0.174047 Epoch [12], Iter [23893125], train_loss:0.169243 Epoch [12], Iter [23903125], train_loss:0.153055 Epoch [12], Iter [23913125], train_loss:0.166778 Epoch [12], Iter [23923125], train_loss:0.171477 Epoch [12], Iter [23933125], train_loss:0.148076 Epoch [12], Iter [23943125], train_loss:0.174037 Epoch [12], Iter [23953125], train_loss:0.152578 Epoch [12], Iter [23963125], train_loss:0.184196 Epoch [12], Iter [23973125], train_loss:0.167483 Epoch [12], Iter [23983125], train_loss:0.164854 Epoch [12], Iter [23993125], train_loss:0.173233 Epoch [12], Iter [24003125], train_loss:0.138813 Epoch [12], Iter [24013125], train_loss:0.152254 Epoch [12], Iter [24023125], train_loss:0.168025 Epoch [12], Iter [24033125], train_loss:0.157279 Epoch [12], Iter [24043125], train_loss:0.148963 Epoch [12], Iter [24053125], train_loss:0.144112 Epoch [12], Iter [24063125], train_loss:0.169978 Epoch [12], Iter [24073125], train_loss:0.153412 Epoch [12], Iter [24083125], train_loss:0.173826 Epoch [12], Iter [24093125], train_loss:0.169680 Epoch [12], Iter [24103125], train_loss:0.162930 Epoch [12], Iter [24113125], train_loss:0.139202 Epoch [12], Iter [24123125], train_loss:0.154762 Epoch [12], Iter [24133125], train_loss:0.154299 Epoch [12], Iter [24143125], train_loss:0.167414 Epoch [12], Iter [24153125], train_loss:0.178091 Epoch [12], Iter [24163125], train_loss:0.173954 Epoch [12], Iter [24173125], train_loss:0.166982 Epoch [12], Iter [24183125], train_loss:0.170560 Epoch [12], Iter [24193125], train_loss:0.170997 Epoch [12], Iter [24203125], train_loss:0.153861 Epoch [12], Iter [24213125], train_loss:0.177754 Epoch [12], Iter [24223125], train_loss:0.168872 Epoch [12], Iter [24233125], train_loss:0.144303 Epoch [12], Iter [24243125], train_loss:0.164720 Epoch [12], Iter [24253125], train_loss:0.186620 Epoch [12], Iter [24263125], train_loss:0.158638 Epoch [12], Iter [24273125], train_loss:0.172386 Epoch [12], Iter [24283125], train_loss:0.167100 Epoch [12], Iter [24293125], train_loss:0.167147 Epoch [12], Iter [24303125], train_loss:0.182128 Epoch [12], Iter [24313125], train_loss:0.165804 Epoch [12], Iter [24323125], train_loss:0.180088 Epoch [12], Iter [24333125], train_loss:0.165245 Epoch [12], Iter [24343125], train_loss:0.159391 Epoch [12], Iter [24353125], train_loss:0.152686 Epoch [12], Iter [24363125], train_loss:0.161874 Epoch [12], Iter [24373125], train_loss:0.165142 Epoch [12], Iter [24383125], train_loss:0.160963 Epoch [12], Iter [24393125], train_loss:0.166472 Epoch [12], Iter [24403125], train_loss:0.158173 Epoch [12], Iter [24413125], train_loss:0.173994 Epoch [12], Iter [24423125], train_loss:0.151297 Epoch [12], Iter [24433125], train_loss:0.152010 Epoch [12], Iter [24443125], train_loss:0.160982 Epoch [12], Iter [24453125], train_loss:0.182511 Epoch [12], Iter [24463125], train_loss:0.171740 Epoch [12], Iter [24473125], train_loss:0.169194 Epoch [12], Iter [24483125], train_loss:0.160217 Epoch [12], Iter [24493125], train_loss:0.170634 Epoch [12], Iter [24503125], train_loss:0.174725 Epoch [12], Iter [24513125], train_loss:0.162844 Epoch [12], Iter [24523125], train_loss:0.179684 Epoch [12], Iter [24533125], train_loss:0.165793 Epoch [12], Iter [24543125], train_loss:0.147170 Epoch [12], Iter [24553125], train_loss:0.167428 Epoch [12], Iter [24563125], train_loss:0.156832 Epoch [12], Iter [24573125], train_loss:0.163711 Epoch [12], Iter [24583125], train_loss:0.163635 Epoch [12], Iter [24593125], train_loss:0.169788 Epoch [12], Iter [24603125], train_loss:0.161291 Epoch [12], Iter [24613125], train_loss:0.176288 Epoch [12], Iter [24623125], train_loss:0.173527 Epoch [12], Iter [24633125], train_loss:0.198670 Epoch [12], Iter [24643125], train_loss:0.163765 Epoch [12], Iter [24653125], train_loss:0.155121 Epoch [12], Iter [24663125], train_loss:0.157210 Epoch [12], Iter [24673125], train_loss:0.158318 Epoch [12], Iter [24683125], train_loss:0.190069 Epoch [12], Iter [24693125], train_loss:0.157674 Epoch [12], Iter [24703125], train_loss:0.153022 Epoch [12], Iter [24713125], train_loss:0.178211 Epoch [12], Iter [24723125], train_loss:0.165668 Epoch [12], Iter [24733125], train_loss:0.170597 Epoch [12], Iter [24743125], train_loss:0.148514 Epoch [12], Iter [24753125], train_loss:0.161165 Epoch [12], Iter [24763125], train_loss:0.159940 Epoch [12], Iter [24773125], train_loss:0.163364 Epoch [12], Iter [24783125], train_loss:0.160939 Epoch [12], Iter [24793125], train_loss:0.188242 Epoch [12], Iter [24803125], train_loss:0.170161 Epoch [12], Iter [24813125], train_loss:0.166997 Epoch [12], Iter [24823125], train_loss:0.173182 Epoch [12], Iter [24833125], train_loss:0.156736 Epoch [12], Iter [24843125], train_loss:0.162785 Epoch [12], Iter [24853125], train_loss:0.159454 Epoch [12], Iter [24863125], train_loss:0.172418 Epoch [12], Iter [24873125], train_loss:0.166055 Epoch [12], Iter [24883125], train_loss:0.166522 Epoch [12], Iter [24893125], train_loss:0.157236 Epoch [12], Iter [24903125], train_loss:0.173360 Epoch [12], Iter [24913125], train_loss:0.147073 Epoch [12], Iter [24923125], train_loss:0.154806 Epoch [12], Iter [24933125], train_loss:0.159782 Epoch [12], Iter [24943125], train_loss:0.175359 Epoch [12], Iter [24953125], train_loss:0.152874 Epoch [12], Iter [24963125], train_loss:0.175603 Epoch [12], Iter [24973125], train_loss:0.151182 Epoch [12], Iter [24983125], train_loss:0.133273 Epoch [12], Iter [24993125], train_loss:0.162480 Epoch [12], Iter [25003125], train_loss:0.172038 Epoch [12], Iter [25013125], train_loss:0.163592 Epoch [12], Iter [25023125], train_loss:0.168842 Epoch [12], Iter [25033125], train_loss:0.167579 Epoch [12], Iter [25043125], train_loss:0.169892 Epoch [12], Iter [25053125], train_loss:0.184179 Epoch [12], Iter [25063125], train_loss:0.172049 Epoch [12], Iter [25073125], train_loss:0.181183 Epoch [12], Iter [25083125], train_loss:0.157703 Epoch [12], Iter [25093125], train_loss:0.156251 Epoch [12], Iter [25103125], train_loss:0.140083 Epoch [12], Iter [25113125], train_loss:0.155766 Epoch [12], Iter [25123125], train_loss:0.171320 Epoch [12], Iter [25133125], train_loss:0.165249 Epoch [12], Iter [25143125], train_loss:0.144336 Epoch [12], Iter [25153125], train_loss:0.169332 Epoch [12], Iter [25163125], train_loss:0.152470 Epoch [12], Iter [25173125], train_loss:0.161122 Epoch [12], Iter [25183125], train_loss:0.182971 Epoch [12], Iter [25193125], train_loss:0.164621 Epoch [12], Iter [25203125], train_loss:0.175796 Epoch [12], Iter [25213125], train_loss:0.176611 Epoch [12], Iter [25223125], train_loss:0.161589 Epoch [12], Iter [25233125], train_loss:0.153558 Epoch [12], Iter [25243125], train_loss:0.177934 Epoch [12], Iter [25253125], train_loss:0.140108 Epoch [12], Iter [25263125], train_loss:0.170537 Epoch [12], Iter [25273125], train_loss:0.190064 Epoch [12], Iter [25283125], train_loss:0.150987 Epoch [12], Iter [25293125], train_loss:0.153076 Epoch [12], Iter [25303125], train_loss:0.153231 Epoch [12], Iter [25313125], train_loss:0.151433 Epoch [12], Iter [25323125], train_loss:0.165380 Epoch [12], Iter [25333125], train_loss:0.154326 Epoch [12], Iter [25343125], train_loss:0.148860 Epoch [12], Iter [25353125], train_loss:0.182532 Epoch [12], Iter [25363125], train_loss:0.184858 Epoch [12], Iter [25373125], train_loss:0.144190 Epoch [12], Iter [25383125], train_loss:0.160582 Epoch [12], Iter [25393125], train_loss:0.150244 Epoch [12], Iter [25403125], train_loss:0.163084 Epoch [12], Iter [25413125], train_loss:0.173798 Epoch [12], Iter [25423125], train_loss:0.180224 Epoch [12], Iter [25433125], train_loss:0.171645 Epoch [12], Iter [25443125], train_loss:0.170542 Epoch [12], Iter [25453125], train_loss:0.150921 Epoch [12], Iter [25463125], train_loss:0.141499 Epoch [12], Iter [25473125], train_loss:0.154087 Epoch [12], Iter [25483125], train_loss:0.146057 Epoch [12], Iter [25493125], train_loss:0.179915 Epoch [12], Iter [25503125], train_loss:0.178421 Epoch [12], Iter [25513125], train_loss:0.162338 Epoch [12], Iter [25523125], train_loss:0.159943 Epoch [12], Iter [25533125], train_loss:0.166942 Epoch [12], Iter [25543125], train_loss:0.161777 Epoch [12], Iter [25553125], train_loss:0.173371 Epoch [12], Iter [25563125], train_loss:0.149645 Epoch [12], Iter [25573125], train_loss:0.150998 Epoch [12], Iter [25583125], train_loss:0.168478 Epoch [12], Iter [25593125], train_loss:0.161073 Epoch [12], Iter [25603125], train_loss:0.153746 Epoch [12], Iter [25613125], train_loss:0.156996 Epoch [12], Iter [25623125], train_loss:0.175018 Epoch [12], Iter [25633125], train_loss:0.161457 Epoch [12], Iter [25643125], train_loss:0.181512 Epoch [12], Iter [25653125], train_loss:0.159499 Epoch [12], Iter [25663125], train_loss:0.155685 Epoch [12], Iter [25673125], train_loss:0.160816 Epoch [12], Iter [25683125], train_loss:0.167257 Epoch [12], Iter [25693125], train_loss:0.168003 Epoch [12], Iter [25703125], train_loss:0.156276 Epoch [12], Iter [25713125], train_loss:0.166197 Epoch [12], Iter [25723125], train_loss:0.171228 Epoch [12], Iter [25733125], train_loss:0.169274 Epoch [12], Iter [25743125], train_loss:0.178607 Epoch [12], Iter [25753125], train_loss:0.180143 Epoch [12], Iter [25763125], train_loss:0.165496 Epoch [12], Iter [25773125], train_loss:0.164666 Epoch [12], Iter [25783125], train_loss:0.172761 Epoch [12], Iter [25793125], train_loss:0.142597 Epoch [12], Iter [25803125], train_loss:0.166856 Epoch [12], Iter [25813125], train_loss:0.180629 Epoch [12], Iter [25823125], train_loss:0.155988 Epoch [12], Iter [25833125], train_loss:0.190004 Epoch [12], Iter [25843125], train_loss:0.153131 Epoch [12], Iter [25853125], train_loss:0.149209 Epoch [12], Iter [25863125], train_loss:0.182763 Epoch [12], Iter [25873125], train_loss:0.163803 Epoch [12], Iter [25883125], train_loss:0.164377 Epoch [12], Iter [25893125], train_loss:0.165225 Epoch [12], Iter [25903125], train_loss:0.132286 Epoch [12], Iter [25913125], train_loss:0.157618 Epoch [12], Iter [25923125], train_loss:0.180062 Epoch [12], Iter [25933125], train_loss:0.149064 Epoch [12], Iter [25943125], train_loss:0.182419 Epoch [12], Iter [25953125], train_loss:0.152154 Epoch [12], Iter [25963125], train_loss:0.156817 Epoch [12], Iter [25973125], train_loss:0.158894 Epoch [12], Iter [25983125], train_loss:0.174006 Epoch [12], Iter [25993125], train_loss:0.170469 Epoch [12], Iter [26003125], train_loss:0.163272 Epoch [12], Iter [26013125], train_loss:0.165293 Epoch [12], Iter [26023125], train_loss:0.132606 Epoch [12], Iter [26033125], train_loss:0.181648 Epoch [12], Iter [26043125], train_loss:0.172091 Epoch [12], Iter [26053125], train_loss:0.145725 Epoch [12], Iter [26063125], train_loss:0.159542 Epoch [12], Iter [26073125], train_loss:0.166341 Epoch [12], Iter [26083125], train_loss:0.144378 Epoch [12], Iter [26093125], train_loss:0.174001 Epoch [12], Iter [26103125], train_loss:0.154200 Epoch [12], Iter [26113125], train_loss:0.168938 Epoch [12], Iter [26123125], train_loss:0.151330 Epoch [12], Iter [26133125], train_loss:0.158763 Epoch [12], Iter [26143125], train_loss:0.154259 Epoch [12], Iter [26153125], train_loss:0.155223 Epoch [12], Iter [26163125], train_loss:0.173738 Epoch [12], Iter [26173125], train_loss:0.164574 Epoch [12], Iter [26183125], train_loss:0.171280 Epoch [12], Iter [26193125], train_loss:0.167967 Epoch [12], Iter [26203125], train_loss:0.165825 Epoch [12], Iter [26213125], train_loss:0.163001 Epoch [12], Iter [26223125], train_loss:0.166808 Epoch [12], Iter [26233125], train_loss:0.158262 Epoch [12], Iter [26243125], train_loss:0.152927 Epoch [12], Iter [26253125], train_loss:0.151799 Epoch [12], Iter [26263125], train_loss:0.153348 Epoch [12], Iter [26273125], train_loss:0.145824 Epoch [12], Iter [26283125], train_loss:0.149315 Epoch [12], Iter [26293125], train_loss:0.183911 Epoch [12], Iter [26303125], train_loss:0.153068 Epoch [12], Iter [26313125], train_loss:0.163764 Epoch [12], Iter [26323125], train_loss:0.161556 Epoch [12], Iter [26333125], train_loss:0.177212 Epoch [12], Iter [26343125], train_loss:0.149619 Epoch [12], Iter [26353125], train_loss:0.160023 Epoch [12], Iter [26363125], train_loss:0.169547 Epoch [12], Iter [26373125], train_loss:0.147591 Epoch [12], Iter [26383125], train_loss:0.156738 Epoch [12], Iter [26393125], train_loss:0.148298 Epoch [12], Iter [26403125], train_loss:0.161786 Epoch [12], Iter [26413125], train_loss:0.162544 Epoch [12], Iter [26423125], train_loss:0.168581 Epoch [12], Iter [26433125], train_loss:0.167225 Epoch [12], Iter [26443125], train_loss:0.160467 Epoch [12], Iter [26453125], train_loss:0.166200 Epoch [12], Iter [26463125], train_loss:0.167931 Epoch [12], Iter [26473125], train_loss:0.157258 Epoch [12], Iter [26483125], train_loss:0.142979 Epoch [12], Iter [26493125], train_loss:0.169719 Epoch [12], Iter [26503125], train_loss:0.179859 Epoch [12], Iter [26513125], train_loss:0.154542 Epoch [12], Iter [26523125], train_loss:0.157200 Epoch [12], Iter [26533125], train_loss:0.178602 Epoch [12], Iter [26543125], train_loss:0.145348 Epoch [12], Iter [26553125], train_loss:0.156349 Epoch [12], Iter [26563125], train_loss:0.148944 Epoch [12], Iter [26573125], train_loss:0.157309 Epoch [12], Iter [26583125], train_loss:0.162670 Epoch [12], Iter [26593125], train_loss:0.150020 Epoch [12], Iter [26603125], train_loss:0.157252 Epoch [12], Iter [26613125], train_loss:0.166470 Epoch [12], Iter [26623125], train_loss:0.178597 Epoch [12], Iter [26633125], train_loss:0.145679 Epoch [12], Iter [26643125], train_loss:0.142497 Epoch [12], Iter [26653125], train_loss:0.153192 Epoch [12], Iter [26663125], train_loss:0.155716 Epoch [12], Iter [26673125], train_loss:0.174556 Epoch [12], Iter [26683125], train_loss:0.152721 Epoch [12], Iter [26693125], train_loss:0.169619 Epoch [12], Iter [26703125], train_loss:0.167028 Epoch [12], Iter [26713125], train_loss:0.154183 Epoch [12], Iter [26723125], train_loss:0.175002 Epoch [12], Iter [26733125], train_loss:0.139364 Epoch [12], Iter [26743125], train_loss:0.162451 Epoch [12], Iter [26753125], train_loss:0.157143 Epoch [12], Iter [26763125], train_loss:0.166282 Epoch [12], Iter [26773125], train_loss:0.150420 Epoch [12], Iter [26783125], train_loss:0.172134 Epoch [12], Iter [26793125], train_loss:0.170172 Epoch [12], Iter [26803125], train_loss:0.188591 Epoch [12], Iter [26813125], train_loss:0.133006 Epoch [12], Iter [26823125], train_loss:0.154428 Epoch [12], Iter [26833125], train_loss:0.146256 Epoch [12], Iter [26843125], train_loss:0.140180 Epoch [12], Iter [26853125], train_loss:0.150448 Epoch [12], Iter [26863125], train_loss:0.166966 Epoch [12], Iter [26873125], train_loss:0.163846 Epoch [12], Iter [26883125], train_loss:0.151998 Epoch [12], Iter [26893125], train_loss:0.177917 Epoch [12], Iter [26903125], train_loss:0.164405 Epoch [12], Iter [26913125], train_loss:0.149646 Epoch [12], Iter [26923125], train_loss:0.155895 Epoch [12], Iter [26933125], train_loss:0.133467 Epoch [12], Iter [26943125], train_loss:0.181978 Epoch [12], Iter [26953125], train_loss:0.178019 Epoch [12], Iter [26963125], train_loss:0.164970 Epoch [12], Iter [26973125], train_loss:0.153656 Epoch [12], Iter [26983125], train_loss:0.158283 Epoch [12], Iter [26993125], train_loss:0.166151 Epoch [12], Iter [27003125], train_loss:0.152899 Epoch [12], Iter [27013125], train_loss:0.150675 Epoch [12], Iter [27023125], train_loss:0.161370 Epoch [12], Iter [27033125], train_loss:0.162690 Epoch [12], Iter [27043125], train_loss:0.146854 Epoch [12], Iter [27053125], train_loss:0.168728 Epoch [12], Iter [27063125], train_loss:0.156361 Epoch [12], Iter [27073125], train_loss:0.162295 Epoch [12], Iter [27083125], train_loss:0.154698 Epoch [12], Iter [27093125], train_loss:0.162639 Epoch [12], Iter [27103125], train_loss:0.170419 Epoch [12], Iter [27113125], train_loss:0.182608 Epoch [12], Iter [27123125], train_loss:0.174881 Epoch [12], Iter [27133125], train_loss:0.163568 Epoch [12], Iter [27143125], train_loss:0.172464 Epoch [12], Iter [27153125], train_loss:0.152963 Epoch [12], Iter [27163125], train_loss:0.174935 Epoch [12], Iter [27173125], train_loss:0.163978 Epoch [12], Iter [27183125], train_loss:0.149811 Epoch [12], Iter [27193125], train_loss:0.168551 Epoch [12], Iter [27203125], train_loss:0.187687 Epoch [12], Iter [27213125], train_loss:0.170561 Epoch [12], Iter [27223125], train_loss:0.157643 Epoch [12], Iter [27233125], train_loss:0.183448 Epoch [12], Iter [27243125], train_loss:0.156940 Epoch [12], Iter [27253125], train_loss:0.176922 Epoch [12], Iter [27263125], train_loss:0.170941 Epoch [12], Iter [27273125], train_loss:0.161215 Epoch [12], Iter [27283125], train_loss:0.157638 Epoch [12], Iter [27293125], train_loss:0.146765 Epoch [12], Iter [27303125], train_loss:0.186415 Epoch [12], Iter [27313125], train_loss:0.179016 Epoch [12], Iter [27323125], train_loss:0.146862 Epoch [12], Iter [27333125], train_loss:0.160904 Epoch [12], Iter [27343125], train_loss:0.184066 Epoch [12], Iter [27353125], train_loss:0.170018 Epoch [12], Iter [27363125], train_loss:0.151466 Epoch [12], Iter [27373125], train_loss:0.155503 Epoch [12], Iter [27383125], train_loss:0.178504 Epoch [12], Iter [27393125], train_loss:0.182733 Epoch [12], Iter [27403125], train_loss:0.178885 Epoch [12], Iter [27413125], train_loss:0.158115 Epoch [12], Iter [27423125], train_loss:0.166074 Epoch [12], Iter [27433125], train_loss:0.175153 Epoch [12], Iter [27443125], train_loss:0.173695 Epoch [12], Iter [27453125], train_loss:0.140103 Epoch [12], Iter [27463125], train_loss:0.164165 Epoch [12], Iter [27473125], train_loss:0.195799 Epoch [12], Iter [27483125], train_loss:0.165051 Epoch [12], Iter [27493125], train_loss:0.168219 Epoch [12], Iter [27503125], train_loss:0.145761 Epoch [12], Iter [27513125], train_loss:0.184619 Epoch [12], Iter [27523125], train_loss:0.183593 Epoch [12], Iter [27533125], train_loss:0.161479 Epoch [12], Iter [27543125], train_loss:0.165525 Epoch [12], Iter [27553125], train_loss:0.152368 Epoch [12], Iter [27563125], train_loss:0.156252 Epoch [12], Iter [27573125], train_loss:0.160543 Epoch [12], Iter [27583125], train_loss:0.169057 Epoch [12], Iter [27593125], train_loss:0.185539 Epoch [12], Iter [27603125], train_loss:0.150664 Epoch [12], Iter [27613125], train_loss:0.168148 Epoch [12], Iter [27623125], train_loss:0.150886 Epoch [12], Iter [27633125], train_loss:0.153608 Epoch [12], Iter [27643125], train_loss:0.173608 Epoch [12], Iter [27653125], train_loss:0.156316 Epoch [12], Iter [27663125], train_loss:0.155580 Epoch [12], Iter [27673125], train_loss:0.170365 Epoch [12], Iter [27683125], train_loss:0.160952 Epoch [12], Iter [27693125], train_loss:0.178418 Epoch [12], Iter [27703125], train_loss:0.161754 Epoch [12], Iter [27713125], train_loss:0.175010 Epoch [12], Iter [27723125], train_loss:0.177170 Epoch [12], Iter [27733125], train_loss:0.156224 Epoch [12], Iter [27743125], train_loss:0.171853 Epoch [12], Iter [27753125], train_loss:0.175113 Epoch [12], Iter [27763125], train_loss:0.153226 Epoch [12], Iter [27773125], train_loss:0.167736 Epoch [12], Iter [27783125], train_loss:0.160811 Epoch [12], Iter [27793125], train_loss:0.174287 Epoch [12], Iter [27803125], train_loss:0.158126 Epoch [12], Iter [27813125], train_loss:0.170792 Epoch [12], Iter [27823125], train_loss:0.165518 Epoch [12], Iter [27833125], train_loss:0.162349 Epoch [12], Iter [27843125], train_loss:0.145470 Epoch [12], Iter [27853125], train_loss:0.159157 Epoch [12], Iter [27863125], train_loss:0.147954 Epoch [12], Iter [27873125], train_loss:0.170489 Epoch [12], Iter [27883125], train_loss:0.165043 Epoch [12], Iter [27893125], train_loss:0.163622 Epoch [12], Iter [27903125], train_loss:0.154899 Epoch [12], Iter [27913125], train_loss:0.160961 Epoch [12], Iter [27923125], train_loss:0.165133 Epoch [12], Iter [27933125], train_loss:0.183820 Epoch [12], Iter [27943125], train_loss:0.170000 Epoch [12], Iter [27953125], train_loss:0.164589 Epoch [12], Iter [27963125], train_loss:0.180219 Epoch [12], Iter [27973125], train_loss:0.144782 Epoch [12], Iter [27983125], train_loss:0.175786 Epoch [12], Iter [27993125], train_loss:0.128005 Epoch [12], Iter [28003125], train_loss:0.156003 Epoch [12], Iter [28013125], train_loss:0.151638 Epoch [12], Iter [28023125], train_loss:0.162846 Epoch [12], Iter [28033125], train_loss:0.162985 Epoch [12], Iter [28043125], train_loss:0.160361 Epoch [12], Iter [28053125], train_loss:0.151148 Epoch [12], Iter [28063125], train_loss:0.164542 Epoch [12], Iter [28073125], train_loss:0.142881 Epoch [12], Iter [28083125], train_loss:0.156098 Epoch [12], Iter [28093125], train_loss:0.133754 Epoch [12], Iter [28103125], train_loss:0.170719 Epoch [12], Iter [28113125], train_loss:0.149624 Epoch [12], Iter [28123125], train_loss:0.175666 Epoch [12], Iter [28133125], train_loss:0.178650 Epoch [12], Iter [28143125], train_loss:0.160231 Epoch [12], Iter [28153125], train_loss:0.181755 Epoch [12], Iter [28163125], train_loss:0.177022 Epoch [12], Iter [28173125], train_loss:0.143955 Epoch [12], Iter [28183125], train_loss:0.182202 Epoch [12], Iter [28193125], train_loss:0.156804 Epoch [12], Iter [28203125], train_loss:0.158852 Epoch [12], Iter [28213125], train_loss:0.159252 Epoch [12], Iter [28223125], train_loss:0.159138 Epoch [12], Iter [28233125], train_loss:0.158014 Epoch [12], Iter [28243125], train_loss:0.173861 Epoch [12], Iter [28253125], train_loss:0.163103 Epoch [12], Iter [28263125], train_loss:0.169961 Epoch [12], Iter [28273125], train_loss:0.160450 Epoch [12], Iter [28283125], train_loss:0.168754 Epoch [12], Iter [28293125], train_loss:0.145734 Epoch [12], Iter [28303125], train_loss:0.171105 Epoch [12], Iter [28313125], train_loss:0.149704 Epoch [12], Iter [28323125], train_loss:0.157235 Epoch [12], Iter [28333125], train_loss:0.168647 Epoch [12], Iter [28343125], train_loss:0.170278 Epoch [12], Iter [28353125], train_loss:0.164118 Epoch [12], Iter [28363125], train_loss:0.160487 Epoch [12], Iter [28373125], train_loss:0.170349 Epoch [12], Iter [28383125], train_loss:0.153062 Epoch [12], Iter [28393125], train_loss:0.179919 Epoch [12], Iter [28403125], train_loss:0.165033 Epoch [12], Iter [28413125], train_loss:0.159011 Epoch [12], Iter [28423125], train_loss:0.141699 Epoch [12], Iter [28433125], train_loss:0.155806 Epoch [12], Iter [28443125], train_loss:0.180037 Epoch [12], Iter [28453125], train_loss:0.172654 Epoch [12], Iter [28463125], train_loss:0.162126 Epoch [12], Iter [28473125], train_loss:0.174910 Epoch [12], Iter [28483125], train_loss:0.190180 Epoch [12], Iter [28493125], train_loss:0.167382 Epoch [12], Iter [28503125], train_loss:0.140893 Epoch [12], Iter [28513125], train_loss:0.169695 Epoch [12], Iter [28523125], train_loss:0.149698 Epoch [12], Iter [28533125], train_loss:0.150947 Epoch [12], Iter [28543125], train_loss:0.160250 Epoch [12], Iter [28553125], train_loss:0.167571 Epoch [12], Iter [28563125], train_loss:0.158384 Epoch [12], Iter [28573125], train_loss:0.137086 Epoch [12], Iter [28583125], train_loss:0.177784 Epoch [12], Iter [28593125], train_loss:0.172647 Epoch [12], Iter [28603125], train_loss:0.169255 Epoch [12], Iter [28613125], train_loss:0.169094 Epoch [12], Iter [28623125], train_loss:0.159690 Epoch [12], Iter [28633125], train_loss:0.162201 Epoch [12], Iter [28643125], train_loss:0.167594 Epoch [12], Iter [28653125], train_loss:0.167401 Epoch [12], Iter [28663125], train_loss:0.164989 Epoch [12], Iter [28673125], train_loss:0.138895 Epoch [12], Iter [28683125], train_loss:0.155665 Epoch [12], Iter [28693125], train_loss:0.178687 Epoch [12], Iter [28703125], train_loss:0.142473 Epoch [12], Iter [28713125], train_loss:0.167332 Epoch [12], Iter [28723125], train_loss:0.179365 Epoch [12], Iter [28733125], train_loss:0.167223 Epoch [12], Iter [28743125], train_loss:0.178953 Epoch [12], Iter [28753125], train_loss:0.157346 Epoch [12], Iter [28763125], train_loss:0.182048 Epoch [12], Iter [28773125], train_loss:0.172396 Epoch [12], Iter [28783125], train_loss:0.175423 Epoch [12], Iter [28793125], train_loss:0.161872 Epoch [12], Iter [28803125], train_loss:0.169045 Epoch [12], Iter [28813125], train_loss:0.169418 Epoch [12], Iter [28823125], train_loss:0.160182 Epoch [12], Iter [28833125], train_loss:0.186741 Epoch [12], Iter [28843125], train_loss:0.157193 Epoch [12], Iter [28853125], train_loss:0.138638 Epoch [12], Iter [28863125], train_loss:0.150510 Epoch [12], Iter [28873125], train_loss:0.176207 Epoch [12], Iter [28883125], train_loss:0.155249 Epoch [12], Iter [28893125], train_loss:0.159106 Epoch [12], Iter [28903125], train_loss:0.162412 Epoch [12], Iter [28913125], train_loss:0.152091 Epoch [12], Iter [28923125], train_loss:0.176883 Epoch [12], Iter [28933125], train_loss:0.146511 Epoch [12], Iter [28943125], train_loss:0.163757 Epoch [12], Iter [28953125], train_loss:0.160787 Epoch [12], Iter [28963125], train_loss:0.160858 Epoch [12], Iter [28973125], train_loss:0.155350 Epoch [12], Iter [28983125], train_loss:0.169348 Epoch [12], Iter [28993125], train_loss:0.144282 Epoch [12], Iter [29003125], train_loss:0.167706 Epoch [12], Iter [29013125], train_loss:0.182318 Epoch [12], Iter [29023125], train_loss:0.171248 Epoch [12], Iter [29033125], train_loss:0.165353 Epoch [12], Iter [29043125], train_loss:0.151637 Epoch [12], Iter [29053125], train_loss:0.161721 Epoch [12], Iter [29063125], train_loss:0.153006 Epoch [12], Iter [29073125], train_loss:0.161867 Epoch [12], Iter [29083125], train_loss:0.156607 Epoch [12], Iter [29093125], train_loss:0.178779 Epoch [12], Iter [29103125], train_loss:0.192463 Epoch [12], Iter [29113125], train_loss:0.148583 Epoch [12], Iter [29123125], train_loss:0.170696 Epoch [12], Iter [29133125], train_loss:0.168631 Epoch [12], Iter [29143125], train_loss:0.168608 Epoch [12], Iter [29153125], train_loss:0.166084 Epoch [12], Iter [29163125], train_loss:0.164468 Epoch [12], Iter [29173125], train_loss:0.154483 Epoch [12], Iter [29183125], train_loss:0.166607 Epoch [12], Iter [29193125], train_loss:0.175541 Epoch [12], Iter [29203125], train_loss:0.146106 Epoch [12], Iter [29213125], train_loss:0.186289 Epoch [12], Iter [29223125], train_loss:0.148206 Epoch [12], Iter [29233125], train_loss:0.180759 Epoch [12], Iter [29243125], train_loss:0.148458 Epoch [12], Iter [29253125], train_loss:0.153044 Epoch [12], Iter [29263125], train_loss:0.173843 Epoch [12], Iter [29273125], train_loss:0.173281 Epoch [12], Iter [29283125], train_loss:0.173701 Epoch [12], Iter [29293125], train_loss:0.165718 Epoch [12], Iter [29303125], train_loss:0.173092 Epoch [12], Iter [29313125], train_loss:0.171520 Epoch [12], Iter [29323125], train_loss:0.148433 Epoch [12], Iter [29333125], train_loss:0.149291 Epoch [12], Iter [29343125], train_loss:0.173039 Epoch [12], Iter [29353125], train_loss:0.167303 Epoch [12], Iter [29363125], train_loss:0.148045 Epoch [12], Iter [29373125], train_loss:0.160600 Epoch [12], Iter [29383125], train_loss:0.175791 Epoch [12], Iter [29393125], train_loss:0.170290 Epoch [12], Iter [29403125], train_loss:0.168750 Epoch [12], Iter [29413125], train_loss:0.174851 Epoch [12], Iter [29423125], train_loss:0.167067 Epoch [12], Iter [29433125], train_loss:0.147908 Epoch [12], Iter [29443125], train_loss:0.161702 Epoch [12], Iter [29453125], train_loss:0.166226 Epoch [12], Iter [29463125], train_loss:0.152965 Epoch [12], Iter [29473125], train_loss:0.151126 Epoch [12], Iter [29483125], train_loss:0.159228 Epoch [12], Iter [29493125], train_loss:0.147525 Epoch [12], Iter [29503125], train_loss:0.186010 Epoch [12], Iter [29513125], train_loss:0.144456 Epoch [12], Iter [29523125], train_loss:0.144571 Epoch [12], Iter [29533125], train_loss:0.149504 Epoch [12], Iter [29543125], train_loss:0.155754 Epoch [12], Iter [29553125], train_loss:0.157044 Epoch [12], Iter [29563125], train_loss:0.164638 Epoch [12], Iter [29573125], train_loss:0.161717 Epoch [12], Iter [29583125], train_loss:0.150048 Epoch [12], Iter [29593125], train_loss:0.161040 Epoch [12], Iter [29603125], train_loss:0.147002 Epoch [12], Iter [29613125], train_loss:0.168605 Epoch [12], Iter [29623125], train_loss:0.160989 Epoch [12], Iter [29633125], train_loss:0.179867 Epoch [12], Iter [29643125], train_loss:0.173219 Epoch [12], Iter [29653125], train_loss:0.166897 Epoch [12], Iter [29663125], train_loss:0.160661 Epoch [12], Iter [29673125], train_loss:0.161262 Epoch [12], Iter [29683125], train_loss:0.164723 Epoch [12], Iter [29693125], train_loss:0.142853 Epoch [12], Iter [29703125], train_loss:0.171715 Epoch [12], Iter [29713125], train_loss:0.158447 Epoch [12], Iter [29723125], train_loss:0.164181 Epoch [12], Iter [29733125], train_loss:0.177048 Epoch [12], Iter [29743125], train_loss:0.167190 Epoch [12], Iter [29753125], train_loss:0.158204 Epoch [12], Iter [29763125], train_loss:0.151028 Epoch [12], Iter [29773125], train_loss:0.162853 Epoch [12], Iter [29783125], train_loss:0.165735 Epoch [12], Iter [29793125], train_loss:0.173848 Epoch [12], Iter [29803125], train_loss:0.149452 Epoch [12], Iter [29813125], train_loss:0.152468 Epoch [12], Iter [29823125], train_loss:0.168138 Epoch [12], Iter [29833125], train_loss:0.163172 Epoch [12], Iter [29843125], train_loss:0.162576 Epoch [12], Iter [29853125], train_loss:0.188783 Epoch [12], Iter [29863125], train_loss:0.161452 Epoch [12], Iter [29873125], train_loss:0.136657 Epoch [12], Iter [29883125], train_loss:0.145196 Epoch [12], Iter [29893125], train_loss:0.183863 Epoch [12], Iter [29903125], train_loss:0.170865 Epoch [12], Iter [29913125], train_loss:0.155084 Epoch [12], Iter [29923125], train_loss:0.175260 Epoch [12], Iter [29933125], train_loss:0.177893 Epoch [12], Iter [29943125], train_loss:0.171074 Epoch [12], Iter [29953125], train_loss:0.166262 Epoch [12], Iter [29963125], train_loss:0.168631 Epoch [12], Iter [29973125], train_loss:0.142343 Epoch [12], Iter [29983125], train_loss:0.176656 Epoch [12], Iter [29993125], train_loss:0.181024 Epoch [12], Iter [30003125], train_loss:0.164563 Epoch [12], Iter [30013125], train_loss:0.181617 Epoch [12], Iter [30023125], train_loss:0.172865 Epoch [12], Iter [30033125], train_loss:0.179876 Epoch [12], Iter [30043125], train_loss:0.165719 Epoch [12], Iter [30053125], train_loss:0.177486 Epoch [12], Iter [30063125], train_loss:0.176950 Epoch [12], Iter [30073125], train_loss:0.178203 Epoch [12], Iter [30083125], train_loss:0.178196 Epoch [12], Iter [30093125], train_loss:0.171647 Epoch [12], Iter [30103125], train_loss:0.173414 Epoch [12], Iter [30113125], train_loss:0.164811 Epoch [12], Iter [30123125], train_loss:0.147020 Epoch [12], Iter [30133125], train_loss:0.166289 Epoch [12], Iter [30143125], train_loss:0.161090 Epoch [12], Iter [30153125], train_loss:0.162289 Epoch [12], Iter [30163125], train_loss:0.130393 Epoch [12], Iter [30173125], train_loss:0.132035 Epoch [12], Iter [30183125], train_loss:0.174404 Epoch [12], Iter [30193125], train_loss:0.157980 Epoch [12], Iter [30203125], train_loss:0.158861 Epoch [12], Iter [30213125], train_loss:0.182830 Epoch [12], Iter [30223125], train_loss:0.158150 Epoch [12], Iter [30233125], train_loss:0.156165 Epoch [12], Iter [30243125], train_loss:0.145425 Epoch [12], Iter [30253125], train_loss:0.176111 Epoch [12], Iter [30263125], train_loss:0.186718 Epoch [12], Iter [30273125], train_loss:0.150117 Epoch [12], Iter [30283125], train_loss:0.173456 Epoch [12], Iter [30293125], train_loss:0.156002 Epoch [12], Iter [30303125], train_loss:0.175069 Epoch [12], Iter [30313125], train_loss:0.150203 Epoch [12], Iter [30323125], train_loss:0.170119 Epoch [12], Iter [30333125], train_loss:0.161877 Epoch [12], Iter [30343125], train_loss:0.154505 Epoch [12], Iter [30353125], train_loss:0.170968 Epoch [12], Iter [30363125], train_loss:0.143941 Epoch [12], Iter [30373125], train_loss:0.171731 Epoch [12], Iter [30383125], train_loss:0.150052 Epoch [12], Iter [30393125], train_loss:0.155370 Epoch [12], Iter [30403125], train_loss:0.154070 Epoch [12], Iter [30413125], train_loss:0.169434 Epoch [12], Iter [30423125], train_loss:0.153931 Epoch [12], Iter [30433125], train_loss:0.167334 Epoch [12], Iter [30443125], train_loss:0.160416 Epoch [12], Iter [30453125], train_loss:0.161101 Epoch [12], Iter [30463125], train_loss:0.153652 Epoch [12], Iter [30473125], train_loss:0.166452 Epoch [12], Iter [30483125], train_loss:0.148719 Epoch [12], Iter [30493125], train_loss:0.153907 Epoch [12], Iter [30503125], train_loss:0.165748 Epoch [12], Iter [30513125], train_loss:0.177738 Epoch [12], Iter [30523125], train_loss:0.162658 Epoch [12], Iter [30533125], train_loss:0.157725 Epoch [12], Iter [30543125], train_loss:0.168763 Epoch [12], Iter [30553125], train_loss:0.169479 Epoch [12], Iter [30563125], train_loss:0.160464 Epoch [12], Iter [30573125], train_loss:0.165181 Epoch [12], Iter [30583125], train_loss:0.158833 Epoch [12], Iter [30593125], train_loss:0.174259 Epoch [12], Iter [30603125], train_loss:0.197122 Epoch [12], Iter [30613125], train_loss:0.157540 Epoch [12], Iter [30623125], train_loss:0.153574 Epoch [12], Iter [30633125], train_loss:0.158650 Epoch [12], Iter [30643125], train_loss:0.159368 Epoch [12], Iter [30653125], train_loss:0.126841 Epoch [12], Iter [30663125], train_loss:0.190723 Epoch [12], Iter [30673125], train_loss:0.161133 Epoch [12], Iter [30683125], train_loss:0.147794 Epoch [12], Iter [30693125], train_loss:0.154277 Epoch [12], Iter [30703125], train_loss:0.160044 Epoch [12], Iter [30713125], train_loss:0.157531 Epoch [12], Iter [30723125], train_loss:0.168389 Epoch [12], Iter [30733125], train_loss:0.172469 Epoch [12], Iter [30743125], train_loss:0.155994 Epoch [12], Iter [30753125], train_loss:0.147720 Epoch [12], Iter [30763125], train_loss:0.137509 Epoch [12], Iter [30773125], train_loss:0.181711 Epoch [12], Iter [30783125], train_loss:0.177348 Epoch [12], Iter [30793125], train_loss:0.148808 Epoch [12], Iter [30803125], train_loss:0.175595 Epoch [12], Iter [30813125], train_loss:0.165768 Epoch [12], Iter [30823125], train_loss:0.142488 Epoch [12], Iter [30833125], train_loss:0.147224 Epoch [12], Iter [30843125], train_loss:0.168570 Epoch [12], Iter [30853125], train_loss:0.155916 Epoch [12], Iter [30863125], train_loss:0.169448 Epoch [12], Iter [30873125], train_loss:0.148978 Epoch [12], Iter [30883125], train_loss:0.158718 Epoch [12], Iter [30893125], train_loss:0.139569 Epoch [12], Iter [30903125], train_loss:0.179602 Epoch [12], Iter [30913125], train_loss:0.172581 Epoch [12], Iter [30923125], train_loss:0.172989 Epoch [12], Iter [30933125], train_loss:0.174835 Epoch [12], Iter [30943125], train_loss:0.162024 Epoch [12], Iter [30953125], train_loss:0.149372 Epoch [12], Iter [30963125], train_loss:0.182143 Epoch [12], Iter [30973125], train_loss:0.173537 Epoch [12], Iter [30983125], train_loss:0.180467 Epoch [12], Iter [30993125], train_loss:0.138658 Epoch [12], Iter [31003125], train_loss:0.167943 Epoch [12], Iter [31013125], train_loss:0.179498 Epoch [12], Iter [31023125], train_loss:0.168319 Epoch [12], Iter [31033125], train_loss:0.159227 Epoch [12], Iter [31043125], train_loss:0.143851 Epoch [12], Iter [31053125], train_loss:0.162043 Epoch [12], Iter [31063125], train_loss:0.173713 Epoch [12], Iter [31073125], train_loss:0.160019 Epoch [12], Iter [31083125], train_loss:0.187196 Epoch [12], Iter [31093125], train_loss:0.178457 Epoch [12], Iter [31103125], train_loss:0.166758 Epoch [12], Iter [31113125], train_loss:0.162495 Epoch [12], Iter [31123125], train_loss:0.144868 Epoch [12], Iter [31133125], train_loss:0.170601 Epoch [12], Iter [31143125], train_loss:0.152794 Epoch [12], Iter [31153125], train_loss:0.166172 Epoch [12], Iter [31163125], train_loss:0.150413 Epoch [12], Iter [31173125], train_loss:0.146555 Epoch [12], Iter [31183125], train_loss:0.158817 Epoch [12], Iter [31193125], train_loss:0.179008 Epoch [12], Iter [31203125], train_loss:0.183372 Epoch [12], Iter [31213125], train_loss:0.165688 Epoch [12], Iter [31223125], train_loss:0.151766 Epoch [12], Iter [31233125], train_loss:0.147575 Epoch [12], Iter [31243125], train_loss:0.140461 Epoch [12], Iter [31253125], train_loss:0.166029 Epoch [12], train_loss:0.1625, train_acc:9.7080%, test_loss:0.1695, test_acc:10.6200% Epoch [22], Iter [13125], train_loss:0.146202 Epoch [22], Iter [23125], train_loss:0.173672 Epoch [22], Iter [33125], train_loss:0.165151 Epoch [22], Iter [43125], train_loss:0.158770 Epoch [22], Iter [53125], train_loss:0.175999 Epoch [22], Iter [63125], train_loss:0.163998 Epoch [22], Iter [73125], train_loss:0.165410 Epoch [22], Iter [83125], train_loss:0.161637 Epoch [22], Iter [93125], train_loss:0.148239 Epoch [22], Iter [103125], train_loss:0.162426 Epoch [22], Iter [113125], train_loss:0.168900 Epoch [22], Iter [123125], train_loss:0.149848 Epoch [22], Iter [133125], train_loss:0.147608 Epoch [22], Iter [143125], train_loss:0.160673 Epoch [22], Iter [153125], train_loss:0.172021 Epoch [22], Iter [163125], train_loss:0.162101 Epoch [22], Iter [173125], train_loss:0.150480 Epoch [22], Iter [183125], train_loss:0.154776 Epoch [22], Iter [193125], train_loss:0.163754 Epoch [22], Iter [203125], train_loss:0.177525 Epoch [22], Iter [213125], train_loss:0.168097 Epoch [22], Iter [223125], train_loss:0.156192 Epoch [22], Iter [233125], train_loss:0.166126 Epoch [22], Iter [243125], train_loss:0.147863 Epoch [22], Iter [253125], train_loss:0.176202 Epoch [22], Iter [263125], train_loss:0.159570 Epoch [22], Iter [273125], train_loss:0.168702 Epoch [22], Iter [283125], train_loss:0.151392 Epoch [22], Iter [293125], train_loss:0.162362 Epoch [22], Iter [303125], train_loss:0.147167 Epoch [22], Iter [313125], train_loss:0.155992 Epoch [22], Iter [323125], train_loss:0.143932 Epoch [22], Iter [333125], train_loss:0.167568 Epoch [22], Iter [343125], train_loss:0.156876 Epoch [22], Iter [353125], train_loss:0.149783 Epoch [22], Iter [363125], train_loss:0.184439 Epoch [22], Iter [373125], train_loss:0.162946 Epoch [22], Iter [383125], train_loss:0.148541 Epoch [22], Iter [393125], train_loss:0.165627 Epoch [22], Iter [403125], train_loss:0.169342 Epoch [22], Iter [413125], train_loss:0.165507 Epoch [22], Iter [423125], train_loss:0.166825 Epoch [22], Iter [433125], train_loss:0.180178 Epoch [22], Iter [443125], train_loss:0.174066 Epoch [22], Iter [453125], train_loss:0.175319 Epoch [22], Iter [463125], train_loss:0.159672 Epoch [22], Iter [473125], train_loss:0.155855 Epoch [22], Iter [483125], train_loss:0.166862 Epoch [22], Iter [493125], train_loss:0.157197 Epoch [22], Iter [503125], train_loss:0.154708 Epoch [22], Iter [513125], train_loss:0.169141 Epoch [22], Iter [523125], train_loss:0.189146 Epoch [22], Iter [533125], train_loss:0.147940 Epoch [22], Iter [543125], train_loss:0.173229 Epoch [22], Iter [553125], train_loss:0.147851 Epoch [22], Iter [563125], train_loss:0.166568 Epoch [22], Iter [573125], train_loss:0.157517 Epoch [22], Iter [583125], train_loss:0.157088 Epoch [22], Iter [593125], train_loss:0.170904 Epoch [22], Iter [603125], train_loss:0.130077 Epoch [22], Iter [613125], train_loss:0.162462 Epoch [22], Iter [623125], train_loss:0.167202 Epoch [22], Iter [633125], train_loss:0.144449 Epoch [22], Iter [643125], train_loss:0.147543 Epoch [22], Iter [653125], train_loss:0.178345 Epoch [22], Iter [663125], train_loss:0.171756 Epoch [22], Iter [673125], train_loss:0.182125 Epoch [22], Iter [683125], train_loss:0.163568 Epoch [22], Iter [693125], train_loss:0.168720 Epoch [22], Iter [703125], train_loss:0.166233 Epoch [22], Iter [713125], train_loss:0.165497 Epoch [22], Iter [723125], train_loss:0.158568 Epoch [22], Iter [733125], train_loss:0.158017 Epoch [22], Iter [743125], train_loss:0.146704 Epoch [22], Iter [753125], train_loss:0.168960 Epoch [22], Iter [763125], train_loss:0.176339 Epoch [22], Iter [773125], train_loss:0.157601 Epoch [22], Iter [783125], train_loss:0.150234 Epoch [22], Iter [793125], train_loss:0.171131 Epoch [22], Iter [803125], train_loss:0.168470 Epoch [22], Iter [813125], train_loss:0.165504 Epoch [22], Iter [823125], train_loss:0.182929 Epoch [22], Iter [833125], train_loss:0.149121 Epoch [22], Iter [843125], train_loss:0.170251 Epoch [22], Iter [853125], train_loss:0.176452 Epoch [22], Iter [863125], train_loss:0.163143 Epoch [22], Iter [873125], train_loss:0.149888 Epoch [22], Iter [883125], train_loss:0.158223 Epoch [22], Iter [893125], train_loss:0.165219 Epoch [22], Iter [903125], train_loss:0.175566 Epoch [22], Iter [913125], train_loss:0.172680 Epoch [22], Iter [923125], train_loss:0.157610 Epoch [22], Iter [933125], train_loss:0.149683 Epoch [22], Iter [943125], train_loss:0.150491 Epoch [22], Iter [953125], train_loss:0.143823 Epoch [22], Iter [963125], train_loss:0.147380 Epoch [22], Iter [973125], train_loss:0.162991 Epoch [22], Iter [983125], train_loss:0.142088 Epoch [22], Iter [993125], train_loss:0.165098 Epoch [22], Iter [1003125], train_loss:0.142414 Epoch [22], Iter [1013125], train_loss:0.171030 Epoch [22], Iter [1023125], train_loss:0.164070 Epoch [22], Iter [1033125], train_loss:0.155812 Epoch [22], Iter [1043125], train_loss:0.166394 Epoch [22], Iter [1053125], train_loss:0.162388 Epoch [22], Iter [1063125], train_loss:0.156700 Epoch [22], Iter [1073125], train_loss:0.153787 Epoch [22], Iter [1083125], train_loss:0.146724 Epoch [22], Iter [1093125], train_loss:0.146993 Epoch [22], Iter [1103125], train_loss:0.161078 Epoch [22], Iter [1113125], train_loss:0.141862 Epoch [22], Iter [1123125], train_loss:0.164413 Epoch [22], Iter [1133125], train_loss:0.172509 Epoch [22], Iter [1143125], train_loss:0.133704 Epoch [22], Iter [1153125], train_loss:0.156570 Epoch [22], Iter [1163125], train_loss:0.149274 Epoch [22], Iter [1173125], train_loss:0.172428 Epoch [22], Iter [1183125], train_loss:0.158011 Epoch [22], Iter [1193125], train_loss:0.180269 Epoch [22], Iter [1203125], train_loss:0.133947 Epoch [22], Iter [1213125], train_loss:0.160919 Epoch [22], Iter [1223125], train_loss:0.160910 Epoch [22], Iter [1233125], train_loss:0.156073 Epoch [22], Iter [1243125], train_loss:0.170647 Epoch [22], Iter [1253125], train_loss:0.168909 Epoch [22], Iter [1263125], train_loss:0.163942 Epoch [22], Iter [1273125], train_loss:0.185147 Epoch [22], Iter [1283125], train_loss:0.147694 Epoch [22], Iter [1293125], train_loss:0.154867 Epoch [22], Iter [1303125], train_loss:0.156400 Epoch [22], Iter [1313125], train_loss:0.159859 Epoch [22], Iter [1323125], train_loss:0.163676 Epoch [22], Iter [1333125], train_loss:0.164885 Epoch [22], Iter [1343125], train_loss:0.157290 Epoch [22], Iter [1353125], train_loss:0.153076 Epoch [22], Iter [1363125], train_loss:0.170953 Epoch [22], Iter [1373125], train_loss:0.161285 Epoch [22], Iter [1383125], train_loss:0.176708 Epoch [22], Iter [1393125], train_loss:0.164216 Epoch [22], Iter [1403125], train_loss:0.157998 Epoch [22], Iter [1413125], train_loss:0.161874 Epoch [22], Iter [1423125], train_loss:0.165788 Epoch [22], Iter [1433125], train_loss:0.147918 Epoch [22], Iter [1443125], train_loss:0.168310 Epoch [22], Iter [1453125], train_loss:0.157749 Epoch [22], Iter [1463125], train_loss:0.170075 Epoch [22], Iter [1473125], train_loss:0.162752 Epoch [22], Iter [1483125], train_loss:0.170934 Epoch [22], Iter [1493125], train_loss:0.184253 Epoch [22], Iter [1503125], train_loss:0.178670 Epoch [22], Iter [1513125], train_loss:0.168679 Epoch [22], Iter [1523125], train_loss:0.175516 Epoch [22], Iter [1533125], train_loss:0.155538 Epoch [22], Iter [1543125], train_loss:0.161324 Epoch [22], Iter [1553125], train_loss:0.156795 Epoch [22], Iter [1563125], train_loss:0.154852 Epoch [22], Iter [1573125], train_loss:0.156921 Epoch [22], Iter [1583125], train_loss:0.163482 Epoch [22], Iter [1593125], train_loss:0.173362 Epoch [22], Iter [1603125], train_loss:0.167319 Epoch [22], Iter [1613125], train_loss:0.173615 Epoch [22], Iter [1623125], train_loss:0.160354 Epoch [22], Iter [1633125], train_loss:0.167696 Epoch [22], Iter [1643125], train_loss:0.161250 Epoch [22], Iter [1653125], train_loss:0.160384 Epoch [22], Iter [1663125], train_loss:0.164563 Epoch [22], Iter [1673125], train_loss:0.161137 Epoch [22], Iter [1683125], train_loss:0.169574 Epoch [22], Iter [1693125], train_loss:0.175531 Epoch [22], Iter [1703125], train_loss:0.169590 Epoch [22], Iter [1713125], train_loss:0.157394 Epoch [22], Iter [1723125], train_loss:0.156446 Epoch [22], Iter [1733125], train_loss:0.176099 Epoch [22], Iter [1743125], train_loss:0.169188 Epoch [22], Iter [1753125], train_loss:0.181089 Epoch [22], Iter [1763125], train_loss:0.157710 Epoch [22], Iter [1773125], train_loss:0.154907 Epoch [22], Iter [1783125], train_loss:0.139118 Epoch [22], Iter [1793125], train_loss:0.148639 Epoch [22], Iter [1803125], train_loss:0.149552 Epoch [22], Iter [1813125], train_loss:0.181338 Epoch [22], Iter [1823125], train_loss:0.162902 Epoch [22], Iter [1833125], train_loss:0.173415 Epoch [22], Iter [1843125], train_loss:0.163751 Epoch [22], Iter [1853125], train_loss:0.148597 Epoch [22], Iter [1863125], train_loss:0.174917 Epoch [22], Iter [1873125], train_loss:0.182508 Epoch [22], Iter [1883125], train_loss:0.152830 Epoch [22], Iter [1893125], train_loss:0.153870 Epoch [22], Iter [1903125], train_loss:0.163149 Epoch [22], Iter [1913125], train_loss:0.148616 Epoch [22], Iter [1923125], train_loss:0.148913 Epoch [22], Iter [1933125], train_loss:0.187292 Epoch [22], Iter [1943125], train_loss:0.163163 Epoch [22], Iter [1953125], train_loss:0.157831 Epoch [22], Iter [1963125], train_loss:0.183797 Epoch [22], Iter [1973125], train_loss:0.171313 Epoch [22], Iter [1983125], train_loss:0.157854 Epoch [22], Iter [1993125], train_loss:0.162880 Epoch [22], Iter [2003125], train_loss:0.176139 Epoch [22], Iter [2013125], train_loss:0.170941 Epoch [22], Iter [2023125], train_loss:0.177162 Epoch [22], Iter [2033125], train_loss:0.150648 Epoch [22], Iter [2043125], train_loss:0.171486 Epoch [22], Iter [2053125], train_loss:0.150289 Epoch [22], Iter [2063125], train_loss:0.168230 Epoch [22], Iter [2073125], train_loss:0.163843 Epoch [22], Iter [2083125], train_loss:0.162255 Epoch [22], Iter [2093125], train_loss:0.162224 Epoch [22], Iter [2103125], train_loss:0.147608 Epoch [22], Iter [2113125], train_loss:0.153870 Epoch [22], Iter [2123125], train_loss:0.141862 Epoch [22], Iter [2133125], train_loss:0.148429 Epoch [22], Iter [2143125], train_loss:0.156956 Epoch [22], Iter [2153125], train_loss:0.160064 Epoch [22], Iter [2163125], train_loss:0.155396 Epoch [22], Iter [2173125], train_loss:0.158974 Epoch [22], Iter [2183125], train_loss:0.164166 Epoch [22], Iter [2193125], train_loss:0.150157 Epoch [22], Iter [2203125], train_loss:0.159278 Epoch [22], Iter [2213125], train_loss:0.145524 Epoch [22], Iter [2223125], train_loss:0.153799 Epoch [22], Iter [2233125], train_loss:0.156198 Epoch [22], Iter [2243125], train_loss:0.161148 Epoch [22], Iter [2253125], train_loss:0.142585 Epoch [22], Iter [2263125], train_loss:0.146489 Epoch [22], Iter [2273125], train_loss:0.172975 Epoch [22], Iter [2283125], train_loss:0.194386 Epoch [22], Iter [2293125], train_loss:0.172534 Epoch [22], Iter [2303125], train_loss:0.147119 Epoch [22], Iter [2313125], train_loss:0.153974 Epoch [22], Iter [2323125], train_loss:0.156483 Epoch [22], Iter [2333125], train_loss:0.153530 Epoch [22], Iter [2343125], train_loss:0.164038 Epoch [22], Iter [2353125], train_loss:0.173976 Epoch [22], Iter [2363125], train_loss:0.174818 Epoch [22], Iter [2373125], train_loss:0.156790 Epoch [22], Iter [2383125], train_loss:0.164833 Epoch [22], Iter [2393125], train_loss:0.142041 Epoch [22], Iter [2403125], train_loss:0.151814 Epoch [22], Iter [2413125], train_loss:0.178047 Epoch [22], Iter [2423125], train_loss:0.177161 Epoch [22], Iter [2433125], train_loss:0.183264 Epoch [22], Iter [2443125], train_loss:0.149528 Epoch [22], Iter [2453125], train_loss:0.148756 Epoch [22], Iter [2463125], train_loss:0.190471 Epoch [22], Iter [2473125], train_loss:0.176104 Epoch [22], Iter [2483125], train_loss:0.156350 Epoch [22], Iter [2493125], train_loss:0.142632 Epoch [22], Iter [2503125], train_loss:0.174584 Epoch [22], Iter [2513125], train_loss:0.154501 Epoch [22], Iter [2523125], train_loss:0.163151 Epoch [22], Iter [2533125], train_loss:0.166830 Epoch [22], Iter [2543125], train_loss:0.151940 Epoch [22], Iter [2553125], train_loss:0.172570 Epoch [22], Iter [2563125], train_loss:0.149426 Epoch [22], Iter [2573125], train_loss:0.167744 Epoch [22], Iter [2583125], train_loss:0.167243 Epoch [22], Iter [2593125], train_loss:0.150426 Epoch [22], Iter [2603125], train_loss:0.143742 Epoch [22], Iter [2613125], train_loss:0.154619 Epoch [22], Iter [2623125], train_loss:0.177493 Epoch [22], Iter [2633125], train_loss:0.149127 Epoch [22], Iter [2643125], train_loss:0.145748 Epoch [22], Iter [2653125], train_loss:0.159908 Epoch [22], Iter [2663125], train_loss:0.173237 Epoch [22], Iter [2673125], train_loss:0.148302 Epoch [22], Iter [2683125], train_loss:0.153039 Epoch [22], Iter [2693125], train_loss:0.153943 Epoch [22], Iter [2703125], train_loss:0.159962 Epoch [22], Iter [2713125], train_loss:0.168486 Epoch [22], Iter [2723125], train_loss:0.174194 Epoch [22], Iter [2733125], train_loss:0.177417 Epoch [22], Iter [2743125], train_loss:0.169610 Epoch [22], Iter [2753125], train_loss:0.153916 Epoch [22], Iter [2763125], train_loss:0.162009 Epoch [22], Iter [2773125], train_loss:0.173930 Epoch [22], Iter [2783125], train_loss:0.154844 Epoch [22], Iter [2793125], train_loss:0.144510 Epoch [22], Iter [2803125], train_loss:0.174670 Epoch [22], Iter [2813125], train_loss:0.147663 Epoch [22], Iter [2823125], train_loss:0.161231 Epoch [22], Iter [2833125], train_loss:0.164567 Epoch [22], Iter [2843125], train_loss:0.148298 Epoch [22], Iter [2853125], train_loss:0.174240 Epoch [22], Iter [2863125], train_loss:0.151915 Epoch [22], Iter [2873125], train_loss:0.164254 Epoch [22], Iter [2883125], train_loss:0.174495 Epoch [22], Iter [2893125], train_loss:0.142919 Epoch [22], Iter [2903125], train_loss:0.164818 Epoch [22], Iter [2913125], train_loss:0.148046 Epoch [22], Iter [2923125], train_loss:0.133363 Epoch [22], Iter [2933125], train_loss:0.160022 Epoch [22], Iter [2943125], train_loss:0.155773 Epoch [22], Iter [2953125], train_loss:0.176180 Epoch [22], Iter [2963125], train_loss:0.164451 Epoch [22], Iter [2973125], train_loss:0.167795 Epoch [22], Iter [2983125], train_loss:0.165779 Epoch [22], Iter [2993125], train_loss:0.176171 Epoch [22], Iter [3003125], train_loss:0.171345 Epoch [22], Iter [3013125], train_loss:0.184329 Epoch [22], Iter [3023125], train_loss:0.172903 Epoch [22], Iter [3033125], train_loss:0.178375 Epoch [22], Iter [3043125], train_loss:0.155158 Epoch [22], Iter [3053125], train_loss:0.171172 Epoch [22], Iter [3063125], train_loss:0.154146 Epoch [22], Iter [3073125], train_loss:0.162431 Epoch [22], Iter [3083125], train_loss:0.163887 Epoch [22], Iter [3093125], train_loss:0.174687 Epoch [22], Iter [3103125], train_loss:0.165460 Epoch [22], Iter [3113125], train_loss:0.181555 Epoch [22], Iter [3123125], train_loss:0.150162 Epoch [22], Iter [3133125], train_loss:0.153412 Epoch [22], Iter [3143125], train_loss:0.149629 Epoch [22], Iter [3153125], train_loss:0.158892 Epoch [22], Iter [3163125], train_loss:0.156130 Epoch [22], Iter [3173125], train_loss:0.187546 Epoch [22], Iter [3183125], train_loss:0.153912 Epoch [22], Iter [3193125], train_loss:0.151770 Epoch [22], Iter [3203125], train_loss:0.176303 Epoch [22], Iter [3213125], train_loss:0.167846 Epoch [22], Iter [3223125], train_loss:0.150853 Epoch [22], Iter [3233125], train_loss:0.174334 Epoch [22], Iter [3243125], train_loss:0.152363 Epoch [22], Iter [3253125], train_loss:0.182887 Epoch [22], Iter [3263125], train_loss:0.149897 Epoch [22], Iter [3273125], train_loss:0.170501 Epoch [22], Iter [3283125], train_loss:0.186834 Epoch [22], Iter [3293125], train_loss:0.163417 Epoch [22], Iter [3303125], train_loss:0.182607 Epoch [22], Iter [3313125], train_loss:0.167527 Epoch [22], Iter [3323125], train_loss:0.171005 Epoch [22], Iter [3333125], train_loss:0.162520 Epoch [22], Iter [3343125], train_loss:0.160567 Epoch [22], Iter [3353125], train_loss:0.165600 Epoch [22], Iter [3363125], train_loss:0.155164 Epoch [22], Iter [3373125], train_loss:0.175315 Epoch [22], Iter [3383125], train_loss:0.171219 Epoch [22], Iter [3393125], train_loss:0.162644 Epoch [22], Iter [3403125], train_loss:0.159048 Epoch [22], Iter [3413125], train_loss:0.162782 Epoch [22], Iter [3423125], train_loss:0.165438 Epoch [22], Iter [3433125], train_loss:0.153910 Epoch [22], Iter [3443125], train_loss:0.174372 Epoch [22], Iter [3453125], train_loss:0.177340 Epoch [22], Iter [3463125], train_loss:0.177186 Epoch [22], Iter [3473125], train_loss:0.163347 Epoch [22], Iter [3483125], train_loss:0.164975 Epoch [22], Iter [3493125], train_loss:0.202241 Epoch [22], Iter [3503125], train_loss:0.176461 Epoch [22], Iter [3513125], train_loss:0.155909 Epoch [22], Iter [3523125], train_loss:0.161746 Epoch [22], Iter [3533125], train_loss:0.161433 Epoch [22], Iter [3543125], train_loss:0.161199 Epoch [22], Iter [3553125], train_loss:0.176037 Epoch [22], Iter [3563125], train_loss:0.165718 Epoch [22], Iter [3573125], train_loss:0.144140 Epoch [22], Iter [3583125], train_loss:0.142182 Epoch [22], Iter [3593125], train_loss:0.151589 Epoch [22], Iter [3603125], train_loss:0.170065 Epoch [22], Iter [3613125], train_loss:0.155288 Epoch [22], Iter [3623125], train_loss:0.153488 Epoch [22], Iter [3633125], train_loss:0.156576 Epoch [22], Iter [3643125], train_loss:0.161076 Epoch [22], Iter [3653125], train_loss:0.161203 Epoch [22], Iter [3663125], train_loss:0.164802 Epoch [22], Iter [3673125], train_loss:0.166324 Epoch [22], Iter [3683125], train_loss:0.178081 Epoch [22], Iter [3693125], train_loss:0.144357 Epoch [22], Iter [3703125], train_loss:0.174453 Epoch [22], Iter [3713125], train_loss:0.168766 Epoch [22], Iter [3723125], train_loss:0.147773 Epoch [22], Iter [3733125], train_loss:0.143407 Epoch [22], Iter [3743125], train_loss:0.154440 Epoch [22], Iter [3753125], train_loss:0.144308 Epoch [22], Iter [3763125], train_loss:0.146517 Epoch [22], Iter [3773125], train_loss:0.168994 Epoch [22], Iter [3783125], train_loss:0.155020 Epoch [22], Iter [3793125], train_loss:0.136322 Epoch [22], Iter [3803125], train_loss:0.165164 Epoch [22], Iter [3813125], train_loss:0.165966 Epoch [22], Iter [3823125], train_loss:0.149831 Epoch [22], Iter [3833125], train_loss:0.153939 Epoch [22], Iter [3843125], train_loss:0.150713 Epoch [22], Iter [3853125], train_loss:0.149525 Epoch [22], Iter [3863125], train_loss:0.186537 Epoch [22], Iter [3873125], train_loss:0.155550 Epoch [22], Iter [3883125], train_loss:0.130376 Epoch [22], Iter [3893125], train_loss:0.168143 Epoch [22], Iter [3903125], train_loss:0.153200 Epoch [22], Iter [3913125], train_loss:0.156268 Epoch [22], Iter [3923125], train_loss:0.138514 Epoch [22], Iter [3933125], train_loss:0.186347 Epoch [22], Iter [3943125], train_loss:0.167708 Epoch [22], Iter [3953125], train_loss:0.156236 Epoch [22], Iter [3963125], train_loss:0.161214 Epoch [22], Iter [3973125], train_loss:0.164827 Epoch [22], Iter [3983125], train_loss:0.162833 Epoch [22], Iter [3993125], train_loss:0.148330 Epoch [22], Iter [4003125], train_loss:0.151244 Epoch [22], Iter [4013125], train_loss:0.175030 Epoch [22], Iter [4023125], train_loss:0.167966 Epoch [22], Iter [4033125], train_loss:0.174009 Epoch [22], Iter [4043125], train_loss:0.133342 Epoch [22], Iter [4053125], train_loss:0.160444 Epoch [22], Iter [4063125], train_loss:0.173592 Epoch [22], Iter [4073125], train_loss:0.176786 Epoch [22], Iter [4083125], train_loss:0.161026 Epoch [22], Iter [4093125], train_loss:0.173543 Epoch [22], Iter [4103125], train_loss:0.147663 Epoch [22], Iter [4113125], train_loss:0.170319 Epoch [22], Iter [4123125], train_loss:0.185939 Epoch [22], Iter [4133125], train_loss:0.165246 Epoch [22], Iter [4143125], train_loss:0.185627 Epoch [22], Iter [4153125], train_loss:0.131443 Epoch [22], Iter [4163125], train_loss:0.150096 Epoch [22], Iter [4173125], train_loss:0.143120 Epoch [22], Iter [4183125], train_loss:0.193534 Epoch [22], Iter [4193125], train_loss:0.152602 Epoch [22], Iter [4203125], train_loss:0.170830 Epoch [22], Iter [4213125], train_loss:0.174716 Epoch [22], Iter [4223125], train_loss:0.174463 Epoch [22], Iter [4233125], train_loss:0.169858 Epoch [22], Iter [4243125], train_loss:0.142388 Epoch [22], Iter [4253125], train_loss:0.172615 Epoch [22], Iter [4263125], train_loss:0.177286 Epoch [22], Iter [4273125], train_loss:0.167227 Epoch [22], Iter [4283125], train_loss:0.157363 Epoch [22], Iter [4293125], train_loss:0.166516 Epoch [22], Iter [4303125], train_loss:0.172313 Epoch [22], Iter [4313125], train_loss:0.161539 Epoch [22], Iter [4323125], train_loss:0.163159 Epoch [22], Iter [4333125], train_loss:0.144575 Epoch [22], Iter [4343125], train_loss:0.168186 Epoch [22], Iter [4353125], train_loss:0.157193 Epoch [22], Iter [4363125], train_loss:0.161615 Epoch [22], Iter [4373125], train_loss:0.169740 Epoch [22], Iter [4383125], train_loss:0.165369 Epoch [22], Iter [4393125], train_loss:0.171216 Epoch [22], Iter [4403125], train_loss:0.162590 Epoch [22], Iter [4413125], train_loss:0.185242 Epoch [22], Iter [4423125], train_loss:0.161350 Epoch [22], Iter [4433125], train_loss:0.160137 Epoch [22], Iter [4443125], train_loss:0.151255 Epoch [22], Iter [4453125], train_loss:0.174243 Epoch [22], Iter [4463125], train_loss:0.163636 Epoch [22], Iter [4473125], train_loss:0.155706 Epoch [22], Iter [4483125], train_loss:0.165992 Epoch [22], Iter [4493125], train_loss:0.157281 Epoch [22], Iter [4503125], train_loss:0.180386 Epoch [22], Iter [4513125], train_loss:0.180637 Epoch [22], Iter [4523125], train_loss:0.159181 Epoch [22], Iter [4533125], train_loss:0.167303 Epoch [22], Iter [4543125], train_loss:0.161755 Epoch [22], Iter [4553125], train_loss:0.154677 Epoch [22], Iter [4563125], train_loss:0.167636 Epoch [22], Iter [4573125], train_loss:0.180807 Epoch [22], Iter [4583125], train_loss:0.139945 Epoch [22], Iter [4593125], train_loss:0.165975 Epoch [22], Iter [4603125], train_loss:0.153326 Epoch [22], Iter [4613125], train_loss:0.187807 Epoch [22], Iter [4623125], train_loss:0.166080 Epoch [22], Iter [4633125], train_loss:0.164084 Epoch [22], Iter [4643125], train_loss:0.178732 Epoch [22], Iter [4653125], train_loss:0.139112 Epoch [22], Iter [4663125], train_loss:0.154262 Epoch [22], Iter [4673125], train_loss:0.156984 Epoch [22], Iter [4683125], train_loss:0.153696 Epoch [22], Iter [4693125], train_loss:0.167890 Epoch [22], Iter [4703125], train_loss:0.146530 Epoch [22], Iter [4713125], train_loss:0.173568 Epoch [22], Iter [4723125], train_loss:0.172920 Epoch [22], Iter [4733125], train_loss:0.172191 Epoch [22], Iter [4743125], train_loss:0.177066 Epoch [22], Iter [4753125], train_loss:0.166096 Epoch [22], Iter [4763125], train_loss:0.145177 Epoch [22], Iter [4773125], train_loss:0.154965 Epoch [22], Iter [4783125], train_loss:0.154901 Epoch [22], Iter [4793125], train_loss:0.161373 Epoch [22], Iter [4803125], train_loss:0.164218 Epoch [22], Iter [4813125], train_loss:0.163394 Epoch [22], Iter [4823125], train_loss:0.179960 Epoch [22], Iter [4833125], train_loss:0.152761 Epoch [22], Iter [4843125], train_loss:0.148085 Epoch [22], Iter [4853125], train_loss:0.158129 Epoch [22], Iter [4863125], train_loss:0.164468 Epoch [22], Iter [4873125], train_loss:0.140875 Epoch [22], Iter [4883125], train_loss:0.153898 Epoch [22], Iter [4893125], train_loss:0.183179 Epoch [22], Iter [4903125], train_loss:0.159658 Epoch [22], Iter [4913125], train_loss:0.149543 Epoch [22], Iter [4923125], train_loss:0.162857 Epoch [22], Iter [4933125], train_loss:0.146819 Epoch [22], Iter [4943125], train_loss:0.162568 Epoch [22], Iter [4953125], train_loss:0.186698 Epoch [22], Iter [4963125], train_loss:0.152870 Epoch [22], Iter [4973125], train_loss:0.160796 Epoch [22], Iter [4983125], train_loss:0.150789 Epoch [22], Iter [4993125], train_loss:0.143901 Epoch [22], Iter [5003125], train_loss:0.146307 Epoch [22], Iter [5013125], train_loss:0.156505 Epoch [22], Iter [5023125], train_loss:0.170537 Epoch [22], Iter [5033125], train_loss:0.165219 Epoch [22], Iter [5043125], train_loss:0.131376 Epoch [22], Iter [5053125], train_loss:0.150592 Epoch [22], Iter [5063125], train_loss:0.154510 Epoch [22], Iter [5073125], train_loss:0.185317 Epoch [22], Iter [5083125], train_loss:0.155880 Epoch [22], Iter [5093125], train_loss:0.166343 Epoch [22], Iter [5103125], train_loss:0.170775 Epoch [22], Iter [5113125], train_loss:0.158124 Epoch [22], Iter [5123125], train_loss:0.162436 Epoch [22], Iter [5133125], train_loss:0.171975 Epoch [22], Iter [5143125], train_loss:0.158008 Epoch [22], Iter [5153125], train_loss:0.180108 Epoch [22], Iter [5163125], train_loss:0.166079 Epoch [22], Iter [5173125], train_loss:0.187777 Epoch [22], Iter [5183125], train_loss:0.179959 Epoch [22], Iter [5193125], train_loss:0.174720 Epoch [22], Iter [5203125], train_loss:0.159333 Epoch [22], Iter [5213125], train_loss:0.170574 Epoch [22], Iter [5223125], train_loss:0.162373 Epoch [22], Iter [5233125], train_loss:0.165549 Epoch [22], Iter [5243125], train_loss:0.171584 Epoch [22], Iter [5253125], train_loss:0.174756 Epoch [22], Iter [5263125], train_loss:0.161434 Epoch [22], Iter [5273125], train_loss:0.168083 Epoch [22], Iter [5283125], train_loss:0.167138 Epoch [22], Iter [5293125], train_loss:0.140973 Epoch [22], Iter [5303125], train_loss:0.159618 Epoch [22], Iter [5313125], train_loss:0.176200 Epoch [22], Iter [5323125], train_loss:0.162572 Epoch [22], Iter [5333125], train_loss:0.168972 Epoch [22], Iter [5343125], train_loss:0.173325 Epoch [22], Iter [5353125], train_loss:0.163866 Epoch [22], Iter [5363125], train_loss:0.163720 Epoch [22], Iter [5373125], train_loss:0.168137 Epoch [22], Iter [5383125], train_loss:0.175345 Epoch [22], Iter [5393125], train_loss:0.158390 Epoch [22], Iter [5403125], train_loss:0.159162 Epoch [22], Iter [5413125], train_loss:0.144704 Epoch [22], Iter [5423125], train_loss:0.149428 Epoch [22], Iter [5433125], train_loss:0.158572 Epoch [22], Iter [5443125], train_loss:0.172126 Epoch [22], Iter [5453125], train_loss:0.176276 Epoch [22], Iter [5463125], train_loss:0.177032 Epoch [22], Iter [5473125], train_loss:0.173978 Epoch [22], Iter [5483125], train_loss:0.164149 Epoch [22], Iter [5493125], train_loss:0.160977 Epoch [22], Iter [5503125], train_loss:0.141250 Epoch [22], Iter [5513125], train_loss:0.167351 Epoch [22], Iter [5523125], train_loss:0.154863 Epoch [22], Iter [5533125], train_loss:0.176878 Epoch [22], Iter [5543125], train_loss:0.152597 Epoch [22], Iter [5553125], train_loss:0.173390 Epoch [22], Iter [5563125], train_loss:0.163720 Epoch [22], Iter [5573125], train_loss:0.160260 Epoch [22], Iter [5583125], train_loss:0.178257 Epoch [22], Iter [5593125], train_loss:0.175589 Epoch [22], Iter [5603125], train_loss:0.148475 Epoch [22], Iter [5613125], train_loss:0.173594 Epoch [22], Iter [5623125], train_loss:0.165406 Epoch [22], Iter [5633125], train_loss:0.171584 Epoch [22], Iter [5643125], train_loss:0.167694 Epoch [22], Iter [5653125], train_loss:0.163094 Epoch [22], Iter [5663125], train_loss:0.157451 Epoch [22], Iter [5673125], train_loss:0.163195 Epoch [22], Iter [5683125], train_loss:0.145743 Epoch [22], Iter [5693125], train_loss:0.165041 Epoch [22], Iter [5703125], train_loss:0.155912 Epoch [22], Iter [5713125], train_loss:0.150290 Epoch [22], Iter [5723125], train_loss:0.162542 Epoch [22], Iter [5733125], train_loss:0.147671 Epoch [22], Iter [5743125], train_loss:0.153121 Epoch [22], Iter [5753125], train_loss:0.151718 Epoch [22], Iter [5763125], train_loss:0.167825 Epoch [22], Iter [5773125], train_loss:0.148835 Epoch [22], Iter [5783125], train_loss:0.151512 Epoch [22], Iter [5793125], train_loss:0.187779 Epoch [22], Iter [5803125], train_loss:0.157333 Epoch [22], Iter [5813125], train_loss:0.165742 Epoch [22], Iter [5823125], train_loss:0.167597 Epoch [22], Iter [5833125], train_loss:0.163270 Epoch [22], Iter [5843125], train_loss:0.144670 Epoch [22], Iter [5853125], train_loss:0.149435 Epoch [22], Iter [5863125], train_loss:0.170580 Epoch [22], Iter [5873125], train_loss:0.160914 Epoch [22], Iter [5883125], train_loss:0.151355 Epoch [22], Iter [5893125], train_loss:0.167059 Epoch [22], Iter [5903125], train_loss:0.151443 Epoch [22], Iter [5913125], train_loss:0.147637 Epoch [22], Iter [5923125], train_loss:0.173933 Epoch [22], Iter [5933125], train_loss:0.157407 Epoch [22], Iter [5943125], train_loss:0.169269 Epoch [22], Iter [5953125], train_loss:0.155772 Epoch [22], Iter [5963125], train_loss:0.189058 Epoch [22], Iter [5973125], train_loss:0.147937 Epoch [22], Iter [5983125], train_loss:0.179247 Epoch [22], Iter [5993125], train_loss:0.167485 Epoch [22], Iter [6003125], train_loss:0.153575 Epoch [22], Iter [6013125], train_loss:0.143053 Epoch [22], Iter [6023125], train_loss:0.150471 Epoch [22], Iter [6033125], train_loss:0.143764 Epoch [22], Iter [6043125], train_loss:0.161357 Epoch [22], Iter [6053125], train_loss:0.177912 Epoch [22], Iter [6063125], train_loss:0.193015 Epoch [22], Iter [6073125], train_loss:0.165355 Epoch [22], Iter [6083125], train_loss:0.160645 Epoch [22], Iter [6093125], train_loss:0.153148 Epoch [22], Iter [6103125], train_loss:0.161745 Epoch [22], Iter [6113125], train_loss:0.177804 Epoch [22], Iter [6123125], train_loss:0.169567 Epoch [22], Iter [6133125], train_loss:0.163330 Epoch [22], Iter [6143125], train_loss:0.156796 Epoch [22], Iter [6153125], train_loss:0.176123 Epoch [22], Iter [6163125], train_loss:0.154425 Epoch [22], Iter [6173125], train_loss:0.152680 Epoch [22], Iter [6183125], train_loss:0.150936 Epoch [22], Iter [6193125], train_loss:0.174734 Epoch [22], Iter [6203125], train_loss:0.164248 Epoch [22], Iter [6213125], train_loss:0.154376 Epoch [22], Iter [6223125], train_loss:0.181289 Epoch [22], Iter [6233125], train_loss:0.154710 Epoch [22], Iter [6243125], train_loss:0.173619 Epoch [22], Iter [6253125], train_loss:0.160207 Epoch [22], Iter [6263125], train_loss:0.164651 Epoch [22], Iter [6273125], train_loss:0.168672 Epoch [22], Iter [6283125], train_loss:0.152033 Epoch [22], Iter [6293125], train_loss:0.145318 Epoch [22], Iter [6303125], train_loss:0.153201 Epoch [22], Iter [6313125], train_loss:0.136641 Epoch [22], Iter [6323125], train_loss:0.165298 Epoch [22], Iter [6333125], train_loss:0.146980 Epoch [22], Iter [6343125], train_loss:0.157089 Epoch [22], Iter [6353125], train_loss:0.153481 Epoch [22], Iter [6363125], train_loss:0.180023 Epoch [22], Iter [6373125], train_loss:0.177965 Epoch [22], Iter [6383125], train_loss:0.168382 Epoch [22], Iter [6393125], train_loss:0.170590 Epoch [22], Iter [6403125], train_loss:0.146684 Epoch [22], Iter [6413125], train_loss:0.154656 Epoch [22], Iter [6423125], train_loss:0.148962 Epoch [22], Iter [6433125], train_loss:0.162826 Epoch [22], Iter [6443125], train_loss:0.154299 Epoch [22], Iter [6453125], train_loss:0.140432 Epoch [22], Iter [6463125], train_loss:0.169591 Epoch [22], Iter [6473125], train_loss:0.160964 Epoch [22], Iter [6483125], train_loss:0.163820 Epoch [22], Iter [6493125], train_loss:0.180686 Epoch [22], Iter [6503125], train_loss:0.149200 Epoch [22], Iter [6513125], train_loss:0.165878 Epoch [22], Iter [6523125], train_loss:0.153168 Epoch [22], Iter [6533125], train_loss:0.158429 Epoch [22], Iter [6543125], train_loss:0.164462 Epoch [22], Iter [6553125], train_loss:0.173659 Epoch [22], Iter [6563125], train_loss:0.158212 Epoch [22], Iter [6573125], train_loss:0.147685 Epoch [22], Iter [6583125], train_loss:0.165053 Epoch [22], Iter [6593125], train_loss:0.147815 Epoch [22], Iter [6603125], train_loss:0.156994 Epoch [22], Iter [6613125], train_loss:0.166037 Epoch [22], Iter [6623125], train_loss:0.172137 Epoch [22], Iter [6633125], train_loss:0.164935 Epoch [22], Iter [6643125], train_loss:0.135215 Epoch [22], Iter [6653125], train_loss:0.158562 Epoch [22], Iter [6663125], train_loss:0.160104 Epoch [22], Iter [6673125], train_loss:0.151053 Epoch [22], Iter [6683125], train_loss:0.170116 Epoch [22], Iter [6693125], train_loss:0.137139 Epoch [22], Iter [6703125], train_loss:0.157071 Epoch [22], Iter [6713125], train_loss:0.188446 Epoch [22], Iter [6723125], train_loss:0.161760 Epoch [22], Iter [6733125], train_loss:0.155279 Epoch [22], Iter [6743125], train_loss:0.179824 Epoch [22], Iter [6753125], train_loss:0.167790 Epoch [22], Iter [6763125], train_loss:0.146095 Epoch [22], Iter [6773125], train_loss:0.177003 Epoch [22], Iter [6783125], train_loss:0.148537 Epoch [22], Iter [6793125], train_loss:0.152893 Epoch [22], Iter [6803125], train_loss:0.159080 Epoch [22], Iter [6813125], train_loss:0.156266 Epoch [22], Iter [6823125], train_loss:0.166901 Epoch [22], Iter [6833125], train_loss:0.168217 Epoch [22], Iter [6843125], train_loss:0.169070 Epoch [22], Iter [6853125], train_loss:0.162491 Epoch [22], Iter [6863125], train_loss:0.168951 Epoch [22], Iter [6873125], train_loss:0.125869 Epoch [22], Iter [6883125], train_loss:0.181195 Epoch [22], Iter [6893125], train_loss:0.177369 Epoch [22], Iter [6903125], train_loss:0.161117 Epoch [22], Iter [6913125], train_loss:0.157555 Epoch [22], Iter [6923125], train_loss:0.159016 Epoch [22], Iter [6933125], train_loss:0.157256 Epoch [22], Iter [6943125], train_loss:0.164547 Epoch [22], Iter [6953125], train_loss:0.165163 Epoch [22], Iter [6963125], train_loss:0.168598 Epoch [22], Iter [6973125], train_loss:0.167152 Epoch [22], Iter [6983125], train_loss:0.174982 Epoch [22], Iter [6993125], train_loss:0.150731 Epoch [22], Iter [7003125], train_loss:0.144726 Epoch [22], Iter [7013125], train_loss:0.161515 Epoch [22], Iter [7023125], train_loss:0.168019 Epoch [22], Iter [7033125], train_loss:0.151221 Epoch [22], Iter [7043125], train_loss:0.155330 Epoch [22], Iter [7053125], train_loss:0.162497 Epoch [22], Iter [7063125], train_loss:0.146891 Epoch [22], Iter [7073125], train_loss:0.144152 Epoch [22], Iter [7083125], train_loss:0.169863 Epoch [22], Iter [7093125], train_loss:0.151497 Epoch [22], Iter [7103125], train_loss:0.171949 Epoch [22], Iter [7113125], train_loss:0.144536 Epoch [22], Iter [7123125], train_loss:0.174258 Epoch [22], Iter [7133125], train_loss:0.156956 Epoch [22], Iter [7143125], train_loss:0.143885 Epoch [22], Iter [7153125], train_loss:0.154764 Epoch [22], Iter [7163125], train_loss:0.158947 Epoch [22], Iter [7173125], train_loss:0.169612 Epoch [22], Iter [7183125], train_loss:0.183921 Epoch [22], Iter [7193125], train_loss:0.164853 Epoch [22], Iter [7203125], train_loss:0.152667 Epoch [22], Iter [7213125], train_loss:0.164879 Epoch [22], Iter [7223125], train_loss:0.162339 Epoch [22], Iter [7233125], train_loss:0.155902 Epoch [22], Iter [7243125], train_loss:0.166309 Epoch [22], Iter [7253125], train_loss:0.169535 Epoch [22], Iter [7263125], train_loss:0.157821 Epoch [22], Iter [7273125], train_loss:0.177206 Epoch [22], Iter [7283125], train_loss:0.161878 Epoch [22], Iter [7293125], train_loss:0.165634 Epoch [22], Iter [7303125], train_loss:0.162080 Epoch [22], Iter [7313125], train_loss:0.149615 Epoch [22], Iter [7323125], train_loss:0.157824 Epoch [22], Iter [7333125], train_loss:0.160058 Epoch [22], Iter [7343125], train_loss:0.164464 Epoch [22], Iter [7353125], train_loss:0.173593 Epoch [22], Iter [7363125], train_loss:0.177152 Epoch [22], Iter [7373125], train_loss:0.185746 Epoch [22], Iter [7383125], train_loss:0.161387 Epoch [22], Iter [7393125], train_loss:0.163264 Epoch [22], Iter [7403125], train_loss:0.165813 Epoch [22], Iter [7413125], train_loss:0.172456 Epoch [22], Iter [7423125], train_loss:0.173366 Epoch [22], Iter [7433125], train_loss:0.167722 Epoch [22], Iter [7443125], train_loss:0.152204 Epoch [22], Iter [7453125], train_loss:0.162796 Epoch [22], Iter [7463125], train_loss:0.148085 Epoch [22], Iter [7473125], train_loss:0.138988 Epoch [22], Iter [7483125], train_loss:0.165154 Epoch [22], Iter [7493125], train_loss:0.163704 Epoch [22], Iter [7503125], train_loss:0.139482 Epoch [22], Iter [7513125], train_loss:0.146638 Epoch [22], Iter [7523125], train_loss:0.179230 Epoch [22], Iter [7533125], train_loss:0.168096 Epoch [22], Iter [7543125], train_loss:0.157946 Epoch [22], Iter [7553125], train_loss:0.121326 Epoch [22], Iter [7563125], train_loss:0.160800 Epoch [22], Iter [7573125], train_loss:0.143741 Epoch [22], Iter [7583125], train_loss:0.164546 Epoch [22], Iter [7593125], train_loss:0.153188 Epoch [22], Iter [7603125], train_loss:0.153755 Epoch [22], Iter [7613125], train_loss:0.156617 Epoch [22], Iter [7623125], train_loss:0.165343 Epoch [22], Iter [7633125], train_loss:0.152439 Epoch [22], Iter [7643125], train_loss:0.150895 Epoch [22], Iter [7653125], train_loss:0.171088 Epoch [22], Iter [7663125], train_loss:0.152008 Epoch [22], Iter [7673125], train_loss:0.159565 Epoch [22], Iter [7683125], train_loss:0.141178 Epoch [22], Iter [7693125], train_loss:0.151271 Epoch [22], Iter [7703125], train_loss:0.141239 Epoch [22], Iter [7713125], train_loss:0.178049 Epoch [22], Iter [7723125], train_loss:0.181188 Epoch [22], Iter [7733125], train_loss:0.173826 Epoch [22], Iter [7743125], train_loss:0.175326 Epoch [22], Iter [7753125], train_loss:0.167236 Epoch [22], Iter [7763125], train_loss:0.149285 Epoch [22], Iter [7773125], train_loss:0.153321 Epoch [22], Iter [7783125],