{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Train CNN-RNN"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Paper related https://arxiv.org/abs/1512.02595\n",
    "\n",
    "CNN-RNN actually a small size of DeepSpeech2, renamed to CNN-RNN to avoid confusion."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<div class=\"alert alert-info\">\n",
    "\n",
    "This tutorial is available as an IPython notebook at [malaya-speech/example/train-asr](https://github.com/huseinzol05/malaya-speech/tree/master/example/train-asr).\n",
    "    \n",
    "</div>"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<div class=\"alert alert-warning\">\n",
    "\n",
    "This example trained on a very small dataset, do not use it for production.\n",
    "    \n",
    "</div>"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Model Interface\n",
    "\n",
    "To initiate CNN-RNN,\n",
    "\n",
    "```python\n",
    "import malaya_speech.train.model.cnn_rnn as cnn_rnn\n",
    "\n",
    "x = tf.placeholder(tf.float32, [None, None, num_features])\n",
    "cnn_rnn.Model(x)\n",
    "```\n",
    "\n",
    "This model interface do not required input length because we can calculate output length using `ctc.utils.calculate_input_length_deep_speech`."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {},
   "outputs": [],
   "source": [
    "import os\n",
    "\n",
    "os.environ['CUDA_VISIBLE_DEVICES'] = '1'"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {
    "scrolled": true
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "WARNING:tensorflow:From /home/husein/malaya-speech/malaya_speech/train/model/quartznet/layer.py:6: The name tf.layers.Conv1D is deprecated. Please use tf.compat.v1.layers.Conv1D instead.\n",
      "\n",
      "WARNING:tensorflow:\n",
      "The TensorFlow contrib module will not be included in TensorFlow 2.0.\n",
      "For more information, please see:\n",
      "  * https://github.com/tensorflow/community/blob/master/rfcs/20180907-contrib-sunset.md\n",
      "  * https://github.com/tensorflow/addons\n",
      "  * https://github.com/tensorflow/io (for I/O related ops)\n",
      "If you depend on functionality not listed there, please file an issue.\n",
      "\n"
     ]
    }
   ],
   "source": [
    "import tensorflow as tf\n",
    "from glob import glob\n",
    "import malaya_speech.config\n",
    "import malaya_speech.train.model.cnn_rnn as cnn_rnn\n",
    "import malaya_speech.train.model.ctc as ctc\n",
    "import malaya_speech.train as train\n",
    "import numpy as np"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Load Featurizer\n",
    "\n",
    "We prefer use `malaya_speech.tf_featurization.STTFeaturizer` for ASR."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {},
   "outputs": [],
   "source": [
    "config = malaya_speech.config.transducer_featurizer_config\n",
    "featurizer = malaya_speech.tf_featurization.STTFeaturizer(**config)\n",
    "n_mels = config['num_feature_bins']\n",
    "initial_learning_rate = 1e-3\n",
    "max_gradient_norm = 5.0\n",
    "train_steps = 1000"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Define Data Pipeline"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {},
   "outputs": [],
   "source": [
    "def preprocess_inputs(example):\n",
    "    s = featurizer.vectorize(example['waveforms'])\n",
    "    mel_fbanks = tf.reshape(s, (-1, n_mels))\n",
    "    example['inputs'] = mel_fbanks\n",
    "\n",
    "    return example"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {},
   "outputs": [],
   "source": [
    "def parse(serialized_example):\n",
    "\n",
    "    data_fields = {\n",
    "        'waveforms': tf.VarLenFeature(tf.float32),\n",
    "        'targets': tf.VarLenFeature(tf.int64),\n",
    "    }\n",
    "    features = tf.parse_single_example(\n",
    "        serialized_example, features = data_fields\n",
    "    )\n",
    "    for k in features.keys():\n",
    "        features[k] = features[k].values\n",
    "\n",
    "    features = preprocess_inputs(features)\n",
    "\n",
    "    keys = list(features.keys())\n",
    "    for k in keys:\n",
    "        if k not in ['inputs', 'targets']:\n",
    "            features.pop(k, None)\n",
    "\n",
    "    return features\n",
    "\n",
    "\n",
    "def get_dataset(path, batch_size = 2, shuffle_size = 32, thread_count = 24):\n",
    "    def get():\n",
    "        files = glob(path)\n",
    "        dataset = tf.data.TFRecordDataset(files)\n",
    "        dataset = dataset.shuffle(shuffle_size)\n",
    "        dataset = dataset.map(parse, num_parallel_calls = thread_count)\n",
    "        dataset = dataset.padded_batch(\n",
    "            batch_size,\n",
    "            padded_shapes = {\n",
    "                'inputs': tf.TensorShape([None, n_mels]),\n",
    "                'targets': tf.TensorShape([None]),\n",
    "            },\n",
    "            padding_values = {\n",
    "                'inputs': tf.constant(0, dtype = tf.float32),\n",
    "                'targets': tf.constant(0, dtype = tf.int64),\n",
    "            },\n",
    "        )\n",
    "        dataset = dataset.repeat()\n",
    "        return dataset\n",
    "\n",
    "    return get"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Define Model definition\n",
    "\n",
    "1. Use malaya_speech CTC loss,\n",
    "\n",
    "```python\n",
    "mean_error, sum_error, sum_weight = ctc.loss.ctc_loss(\n",
    "    logits, targets_int32, seq_lens\n",
    ")\n",
    "```\n",
    "\n",
    "2. Use malaya_speech CTC sequence accuracy,\n",
    "\n",
    "```python\n",
    "accuracy = ctc.metrics.ctc_sequence_accuracy(\n",
    "    logits, targets_int32, seq_lens\n",
    ")\n",
    "```\n",
    "\n",
    "This will automatically recorded in Tensorboard.\n",
    "\n",
    "3. Use malaya_speech output length calculation,\n",
    "\n",
    "```python\n",
    "seq_lens = ctc.utils.calculate_input_length_deep_speech(\n",
    "    features['inputs'], logits\n",
    ")\n",
    "```\n",
    "\n",
    "4. Use malaya_speech metrics for Evaluation session,\n",
    "\n",
    "```python\n",
    "elif mode == tf.estimator.ModeKeys.EVAL:\n",
    "\n",
    "    estimator_spec = tf.estimator.EstimatorSpec(\n",
    "        mode = tf.estimator.ModeKeys.EVAL,\n",
    "        loss = loss,\n",
    "        eval_metric_ops = {\n",
    "            'accuracy': ctc.metrics.ctc_sequence_accuracy_estimator(\n",
    "                logits, targets_int32, seq_lens\n",
    "            ),\n",
    "            'WER': ctc.metrics.word_error_rate_estimator(\n",
    "                logits, targets_int32\n",
    "            ),\n",
    "        },\n",
    "    )\n",
    "```\n",
    "\n",
    "If we passed directly tensor values to `eval_metric_ops`, Tensorflow will throw error, required update operations. So just stick with that implementation."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {},
   "outputs": [],
   "source": [
    "def model_fn(features, labels, mode, params):\n",
    "    model = cnn_rnn.Model(features['inputs'], training = True)\n",
    "    logits = tf.layers.dense(model.logits, malaya_speech.char.VOCAB_SIZE)\n",
    "\n",
    "    seq_lens = ctc.utils.calculate_input_length_deep_speech(\n",
    "        features['inputs'], logits\n",
    "    )\n",
    "    targets_int32 = tf.cast(features['targets'], tf.int32)\n",
    "\n",
    "    mean_error, sum_error, sum_weight = ctc.loss.ctc_loss(\n",
    "        logits, targets_int32, seq_lens\n",
    "    )\n",
    "\n",
    "    loss = mean_error\n",
    "    accuracy = ctc.metrics.ctc_sequence_accuracy(\n",
    "        logits, targets_int32, seq_lens\n",
    "    )\n",
    "\n",
    "    tf.identity(loss, 'train_loss')\n",
    "    tf.identity(accuracy, name = 'train_accuracy')\n",
    "\n",
    "    if mode == tf.estimator.ModeKeys.TRAIN:\n",
    "        global_step = tf.train.get_or_create_global_step()\n",
    "        learning_rate = tf.train.polynomial_decay(\n",
    "            initial_learning_rate,\n",
    "            global_step,\n",
    "            train_steps,\n",
    "            end_learning_rate = 1e-4,\n",
    "            power = 1.0,\n",
    "            cycle = False,\n",
    "        )\n",
    "        optimizer = tf.train.AdamOptimizer(learning_rate = learning_rate)\n",
    "        train_op = optimizer.minimize(loss, global_step = global_step)\n",
    "        estimator_spec = tf.estimator.EstimatorSpec(\n",
    "            mode = mode, loss = loss, train_op = train_op\n",
    "        )\n",
    "\n",
    "    elif mode == tf.estimator.ModeKeys.EVAL:\n",
    "\n",
    "        estimator_spec = tf.estimator.EstimatorSpec(\n",
    "            mode = tf.estimator.ModeKeys.EVAL,\n",
    "            loss = loss,\n",
    "            eval_metric_ops = {\n",
    "                'accuracy': ctc.metrics.ctc_sequence_accuracy_estimator(\n",
    "                    logits, targets_int32, seq_lens\n",
    "                ),\n",
    "                'WER': ctc.metrics.word_error_rate_estimator(\n",
    "                    logits, targets_int32\n",
    "                ),\n",
    "            },\n",
    "        )\n",
    "\n",
    "    return estimator_spec"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {},
   "outputs": [],
   "source": [
    "train_hooks = [\n",
    "    tf.train.LoggingTensorHook(\n",
    "        ['train_accuracy', 'train_loss'], every_n_iter = 1\n",
    "    )\n",
    "]\n",
    "train_dataset = get_dataset('tolong-sebut/data/tolong-sebut-train*', batch_size = 32)\n",
    "dev_dataset = get_dataset('tolong-sebut/data/tolong-sebut-dev*', batch_size = 32)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {},
   "outputs": [],
   "source": [
    "!rm -rf asr-cnn-rnn"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Initate training session"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "WARNING:tensorflow:From /home/husein/malaya-speech/malaya_speech/train/__init__.py:38: The name tf.logging.set_verbosity is deprecated. Please use tf.compat.v1.logging.set_verbosity instead.\n",
      "\n",
      "WARNING:tensorflow:From /home/husein/malaya-speech/malaya_speech/train/__init__.py:38: The name tf.logging.INFO is deprecated. Please use tf.compat.v1.logging.INFO instead.\n",
      "\n",
      "INFO:tensorflow:Using config: {'_model_dir': 'asr-cnn-rnn', '_tf_random_seed': None, '_save_summary_steps': 100, '_save_checkpoints_steps': 200, '_save_checkpoints_secs': None, '_session_config': allow_soft_placement: true\n",
      "graph_options {\n",
      "  rewrite_options {\n",
      "    meta_optimizer_iterations: ONE\n",
      "  }\n",
      "}\n",
      ", '_keep_checkpoint_max': 5, '_keep_checkpoint_every_n_hours': 10000, '_log_step_count_steps': 1, '_train_distribute': None, '_device_fn': None, '_protocol': None, '_eval_distribute': None, '_experimental_distribute': None, '_experimental_max_worker_delay_secs': None, '_session_creation_timeout_secs': 7200, '_service': None, '_cluster_spec': <tensorflow.python.training.server_lib.ClusterSpec object at 0x7f4eb5224208>, '_task_type': 'worker', '_task_id': 0, '_global_id_in_cluster': 0, '_master': '', '_evaluation_master': '', '_is_chief': True, '_num_ps_replicas': 0, '_num_worker_replicas': 1}\n",
      "INFO:tensorflow:Not using Distribute Coordinator.\n",
      "INFO:tensorflow:Running training and evaluation locally (non-distributed).\n",
      "INFO:tensorflow:Start train and evaluate loop. The evaluate will happen after every checkpoint. Checkpoint frequency is determined based on RunConfig arguments: save_checkpoints_steps 200 or save_checkpoints_secs None.\n",
      "WARNING:tensorflow:From /home/husein/.local/lib/python3.6/site-packages/tensorflow_core/python/training/training_util.py:236: Variable.initialized_value (from tensorflow.python.ops.variables) is deprecated and will be removed in a future version.\n",
      "Instructions for updating:\n",
      "Use Variable.read_value. Variables in 2.X are initialized automatically both in eager and graph (inside tf.defun) contexts.\n",
      "WARNING:tensorflow:From /home/husein/.local/lib/python3.6/site-packages/tensorflow_core/python/autograph/converters/directives.py:119: The name tf.VarLenFeature is deprecated. Please use tf.io.VarLenFeature instead.\n",
      "\n",
      "WARNING:tensorflow:From /home/husein/.local/lib/python3.6/site-packages/tensorflow_core/python/autograph/converters/directives.py:119: The name tf.parse_single_example is deprecated. Please use tf.io.parse_single_example instead.\n",
      "\n",
      "INFO:tensorflow:Calling model_fn.\n",
      "WARNING:tensorflow:From /home/husein/.local/lib/python3.6/site-packages/tensorflow_core/python/ops/resource_variable_ops.py:1630: calling BaseResourceVariable.__init__ (from tensorflow.python.ops.resource_variable_ops) with constraint is deprecated and will be removed in a future version.\n",
      "Instructions for updating:\n",
      "If using Keras pass *_constraint arguments to layers.\n",
      "WARNING:tensorflow:From /home/husein/.local/lib/python3.6/site-packages/tensorflow_core/python/ops/init_ops.py:97: calling GlorotUniform.__init__ (from tensorflow.python.ops.init_ops) with dtype is deprecated and will be removed in a future version.\n",
      "Instructions for updating:\n",
      "Call initializer instance with the dtype argument instead of passing it to the constructor\n",
      "WARNING:tensorflow:From /home/husein/.local/lib/python3.6/site-packages/tensorflow_core/python/ops/init_ops.py:97: calling Orthogonal.__init__ (from tensorflow.python.ops.init_ops) with dtype is deprecated and will be removed in a future version.\n",
      "Instructions for updating:\n",
      "Call initializer instance with the dtype argument instead of passing it to the constructor\n",
      "WARNING:tensorflow:From /home/husein/.local/lib/python3.6/site-packages/tensorflow_core/python/ops/init_ops.py:97: calling Zeros.__init__ (from tensorflow.python.ops.init_ops) with dtype is deprecated and will be removed in a future version.\n",
      "Instructions for updating:\n",
      "Call initializer instance with the dtype argument instead of passing it to the constructor\n",
      "WARNING:tensorflow:From <ipython-input-7-206efaa2081d>:3: dense (from tensorflow.python.layers.core) is deprecated and will be removed in a future version.\n",
      "Instructions for updating:\n",
      "Use keras.layers.Dense instead.\n",
      "WARNING:tensorflow:From /home/husein/.local/lib/python3.6/site-packages/tensorflow_core/python/layers/core.py:187: Layer.apply (from tensorflow.python.keras.engine.base_layer) is deprecated and will be removed in a future version.\n",
      "Instructions for updating:\n",
      "Please use `layer.__call__` method instead.\n",
      "WARNING:tensorflow:From /home/husein/.local/lib/python3.6/site-packages/tensorflow_core/python/util/deprecation.py:507: calling count_nonzero (from tensorflow.python.ops.math_ops) with axis is deprecated and will be removed in a future version.\n",
      "Instructions for updating:\n",
      "reduction_indices is deprecated, use axis instead\n",
      "WARNING:tensorflow:From /home/husein/malaya-speech/malaya_speech/train/model/ctc/loss.py:14: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version.\n",
      "Instructions for updating:\n",
      "Use `tf.cast` instead.\n",
      "WARNING:tensorflow:From /home/husein/.local/lib/python3.6/site-packages/tensorflow_core/python/ops/array_ops.py:1475: where (from tensorflow.python.ops.array_ops) is deprecated and will be removed in a future version.\n",
      "Instructions for updating:\n",
      "Use tf.where in 2.0, which has the same broadcast rule as np.where\n",
      "WARNING:tensorflow:From /home/husein/malaya-speech/malaya_speech/train/model/ctc/loss.py:20: The name tf.nn.ctc_loss is deprecated. Please use tf.compat.v1.nn.ctc_loss instead.\n",
      "\n",
      "INFO:tensorflow:Done calling model_fn.\n",
      "INFO:tensorflow:Create CheckpointSaverHook.\n",
      "INFO:tensorflow:Graph was finalized.\n",
      "INFO:tensorflow:Running local_init_op.\n",
      "INFO:tensorflow:Done running local_init_op.\n",
      "INFO:tensorflow:Saving checkpoints for 0 into asr-cnn-rnn/model.ckpt.\n",
      "INFO:tensorflow:train_accuracy = 0.0064850845, train_loss = 400.50488\n",
      "INFO:tensorflow:loss = 400.50488, step = 0\n",
      "INFO:tensorflow:global_step/sec: 0.251293\n",
      "INFO:tensorflow:train_accuracy = 0.033678755, train_loss = 213.68706 (3.979 sec)\n",
      "INFO:tensorflow:loss = 213.68706, step = 1 (3.977 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.579527\n",
      "INFO:tensorflow:train_accuracy = 0.067065865, train_loss = 192.7349 (1.726 sec)\n",
      "INFO:tensorflow:loss = 192.7349, step = 2 (1.726 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.730324\n",
      "INFO:tensorflow:train_accuracy = 0.030534351, train_loss = 166.42717 (1.369 sec)\n",
      "INFO:tensorflow:loss = 166.42717, step = 3 (1.369 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.754977\n",
      "INFO:tensorflow:train_accuracy = 0.04593176, train_loss = 101.395645 (1.324 sec)\n",
      "INFO:tensorflow:loss = 101.395645, step = 4 (1.324 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.671165\n",
      "INFO:tensorflow:train_accuracy = 0.07058824, train_loss = 88.14012 (1.490 sec)\n",
      "INFO:tensorflow:loss = 88.14012, step = 5 (1.490 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.700335\n",
      "INFO:tensorflow:train_accuracy = 0.05703422, train_loss = 85.8887 (1.428 sec)\n",
      "INFO:tensorflow:loss = 85.8887, step = 6 (1.428 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.852786\n",
      "INFO:tensorflow:train_accuracy = 0.034946237, train_loss = 73.55212 (1.172 sec)\n",
      "INFO:tensorflow:loss = 73.55212, step = 7 (1.172 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.590208\n",
      "INFO:tensorflow:train_accuracy = 0.062893085, train_loss = 71.20036 (1.695 sec)\n",
      "INFO:tensorflow:loss = 71.20036, step = 8 (1.695 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.667784\n",
      "INFO:tensorflow:train_accuracy = 0.022106633, train_loss = 64.64287 (1.497 sec)\n",
      "INFO:tensorflow:loss = 64.64287, step = 9 (1.498 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.659787\n",
      "INFO:tensorflow:train_accuracy = 0.026595745, train_loss = 62.235577 (1.516 sec)\n",
      "INFO:tensorflow:loss = 62.235577, step = 10 (1.516 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.714976\n",
      "INFO:tensorflow:train_accuracy = 0.061251663, train_loss = 66.45854 (1.399 sec)\n",
      "INFO:tensorflow:loss = 66.45854, step = 11 (1.399 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.805882\n",
      "INFO:tensorflow:train_accuracy = 0.089646466, train_loss = 74.11623 (1.241 sec)\n",
      "INFO:tensorflow:loss = 74.11623, step = 12 (1.241 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.758918\n",
      "INFO:tensorflow:train_accuracy = 0.062246278, train_loss = 59.561787 (1.318 sec)\n",
      "INFO:tensorflow:loss = 59.561787, step = 13 (1.318 sec)\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "INFO:tensorflow:global_step/sec: 0.811702\n",
      "INFO:tensorflow:train_accuracy = 0.07387863, train_loss = 52.932514 (1.232 sec)\n",
      "INFO:tensorflow:loss = 52.932514, step = 14 (1.232 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.972217\n",
      "INFO:tensorflow:train_accuracy = 0.055190537, train_loss = 53.59869 (1.029 sec)\n",
      "INFO:tensorflow:loss = 53.59869, step = 15 (1.029 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.750876\n",
      "INFO:tensorflow:train_accuracy = 0.032133676, train_loss = 61.812477 (1.332 sec)\n",
      "INFO:tensorflow:loss = 61.812477, step = 16 (1.332 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.784571\n",
      "INFO:tensorflow:train_accuracy = 0.10344828, train_loss = 53.76927 (1.275 sec)\n",
      "INFO:tensorflow:loss = 53.76927, step = 17 (1.275 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.928189\n",
      "INFO:tensorflow:train_accuracy = 0.12717536, train_loss = 46.00486 (1.077 sec)\n",
      "INFO:tensorflow:loss = 46.00486, step = 18 (1.077 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.991931\n",
      "INFO:tensorflow:train_accuracy = 0.044, train_loss = 48.279 (1.008 sec)\n",
      "INFO:tensorflow:loss = 48.279, step = 19 (1.008 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.62401\n",
      "INFO:tensorflow:train_accuracy = 0.04, train_loss = 55.896088 (1.602 sec)\n",
      "INFO:tensorflow:loss = 55.896088, step = 20 (1.602 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.771058\n",
      "INFO:tensorflow:train_accuracy = 0.09468223, train_loss = 47.190643 (1.297 sec)\n",
      "INFO:tensorflow:loss = 47.190643, step = 21 (1.296 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.965099\n",
      "INFO:tensorflow:train_accuracy = 0.17885117, train_loss = 47.852516 (1.036 sec)\n",
      "INFO:tensorflow:loss = 47.852516, step = 22 (1.037 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.682357\n",
      "INFO:tensorflow:train_accuracy = 0.10463576, train_loss = 44.89679 (1.466 sec)\n",
      "INFO:tensorflow:loss = 44.89679, step = 23 (1.466 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.814882\n",
      "INFO:tensorflow:train_accuracy = 0.11473273, train_loss = 42.242233 (1.227 sec)\n",
      "INFO:tensorflow:loss = 42.242233, step = 24 (1.227 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.805951\n",
      "INFO:tensorflow:train_accuracy = 0.18850267, train_loss = 43.169556 (1.241 sec)\n",
      "INFO:tensorflow:loss = 43.169556, step = 25 (1.241 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.772253\n",
      "INFO:tensorflow:train_accuracy = 0.14580645, train_loss = 47.07773 (1.295 sec)\n",
      "INFO:tensorflow:loss = 47.07773, step = 26 (1.295 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.580853\n",
      "INFO:tensorflow:train_accuracy = 0.03329223, train_loss = 51.645195 (1.722 sec)\n",
      "INFO:tensorflow:loss = 51.645195, step = 27 (1.722 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.761796\n",
      "INFO:tensorflow:train_accuracy = 0.28383705, train_loss = 37.997437 (1.313 sec)\n",
      "INFO:tensorflow:loss = 37.997437, step = 28 (1.313 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.657744\n",
      "INFO:tensorflow:train_accuracy = 0.29301745, train_loss = 44.680035 (1.520 sec)\n",
      "INFO:tensorflow:loss = 44.680035, step = 29 (1.520 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.608629\n",
      "INFO:tensorflow:train_accuracy = 0.25814536, train_loss = 46.657303 (1.643 sec)\n",
      "INFO:tensorflow:loss = 46.657303, step = 30 (1.643 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.99435\n",
      "INFO:tensorflow:train_accuracy = 0.110091746, train_loss = 38.423523 (1.006 sec)\n",
      "INFO:tensorflow:loss = 38.423523, step = 31 (1.006 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.819351\n",
      "INFO:tensorflow:train_accuracy = 0.29204693, train_loss = 37.753273 (1.220 sec)\n",
      "INFO:tensorflow:loss = 37.753273, step = 32 (1.220 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.688647\n",
      "INFO:tensorflow:train_accuracy = 0.31670824, train_loss = 41.08673 (1.452 sec)\n",
      "INFO:tensorflow:loss = 41.08673, step = 33 (1.453 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.950845\n",
      "INFO:tensorflow:train_accuracy = 0.1851369, train_loss = 43.510838 (1.051 sec)\n",
      "INFO:tensorflow:loss = 43.510838, step = 34 (1.050 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.03543\n",
      "INFO:tensorflow:train_accuracy = 0.33417085, train_loss = 40.457714 (0.966 sec)\n",
      "INFO:tensorflow:loss = 40.457714, step = 35 (0.966 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.58208\n",
      "INFO:tensorflow:train_accuracy = 0.32043532, train_loss = 45.637886 (1.718 sec)\n",
      "INFO:tensorflow:loss = 45.637886, step = 36 (1.718 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.958547\n",
      "INFO:tensorflow:train_accuracy = 0.47096774, train_loss = 36.28048 (1.043 sec)\n",
      "INFO:tensorflow:loss = 36.28048, step = 37 (1.043 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.759149\n",
      "INFO:tensorflow:train_accuracy = 0.34514436, train_loss = 35.879852 (1.317 sec)\n",
      "INFO:tensorflow:loss = 35.879852, step = 38 (1.317 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.03566\n",
      "INFO:tensorflow:train_accuracy = 0.34877735, train_loss = 34.507057 (0.966 sec)\n",
      "INFO:tensorflow:loss = 34.507057, step = 39 (0.965 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.789467\n",
      "INFO:tensorflow:train_accuracy = 0.29434955, train_loss = 36.82743 (1.267 sec)\n",
      "INFO:tensorflow:loss = 36.82743, step = 40 (1.268 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.885736\n",
      "INFO:tensorflow:train_accuracy = 0.3025099, train_loss = 34.79054 (1.129 sec)\n",
      "INFO:tensorflow:loss = 34.79054, step = 41 (1.129 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.933818\n",
      "INFO:tensorflow:train_accuracy = 0.43063933, train_loss = 40.688293 (1.070 sec)\n",
      "INFO:tensorflow:loss = 40.688293, step = 42 (1.070 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.703692\n",
      "INFO:tensorflow:train_accuracy = 0.513834, train_loss = 32.75071 (1.422 sec)\n",
      "INFO:tensorflow:loss = 32.75071, step = 43 (1.422 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.793053\n",
      "INFO:tensorflow:train_accuracy = 0.541555, train_loss = 31.41516 (1.261 sec)\n",
      "INFO:tensorflow:loss = 31.41516, step = 44 (1.261 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.987124\n",
      "INFO:tensorflow:train_accuracy = 0.5185185, train_loss = 31.544426 (1.012 sec)\n",
      "INFO:tensorflow:loss = 31.544426, step = 45 (1.012 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.874595\n",
      "INFO:tensorflow:train_accuracy = 0.536193, train_loss = 27.106533 (1.144 sec)\n",
      "INFO:tensorflow:loss = 27.106533, step = 46 (1.144 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.779711\n",
      "INFO:tensorflow:train_accuracy = 0.47439024, train_loss = 43.21688 (1.283 sec)\n",
      "INFO:tensorflow:loss = 43.21688, step = 47 (1.283 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.890727\n",
      "INFO:tensorflow:train_accuracy = 0.49318463, train_loss = 34.648903 (1.122 sec)\n",
      "INFO:tensorflow:loss = 34.648903, step = 48 (1.122 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.945163\n",
      "INFO:tensorflow:train_accuracy = 0.5118899, train_loss = 33.807053 (1.058 sec)\n",
      "INFO:tensorflow:loss = 33.807053, step = 49 (1.058 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.810196\n",
      "INFO:tensorflow:train_accuracy = 0.5353805, train_loss = 30.305 (1.234 sec)\n",
      "INFO:tensorflow:loss = 30.305, step = 50 (1.234 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.893047\n",
      "INFO:tensorflow:train_accuracy = 0.5057915, train_loss = 31.915113 (1.120 sec)\n",
      "INFO:tensorflow:loss = 31.915113, step = 51 (1.119 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.751548\n",
      "INFO:tensorflow:train_accuracy = 0.49872774, train_loss = 33.62224 (1.331 sec)\n",
      "INFO:tensorflow:loss = 33.62224, step = 52 (1.332 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.84044\n",
      "INFO:tensorflow:train_accuracy = 0.5343915, train_loss = 29.627312 (1.190 sec)\n",
      "INFO:tensorflow:loss = 29.627312, step = 53 (1.189 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.745756\n",
      "INFO:tensorflow:train_accuracy = 0.49042144, train_loss = 35.790558 (1.341 sec)\n",
      "INFO:tensorflow:loss = 35.790558, step = 54 (1.341 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.715774\n",
      "INFO:tensorflow:train_accuracy = 0.50199205, train_loss = 31.66386 (1.397 sec)\n",
      "INFO:tensorflow:loss = 31.66386, step = 55 (1.397 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.832043\n",
      "INFO:tensorflow:train_accuracy = 0.5328084, train_loss = 29.957571 (1.202 sec)\n",
      "INFO:tensorflow:loss = 29.957571, step = 56 (1.202 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.719286\n",
      "INFO:tensorflow:train_accuracy = 0.5095109, train_loss = 27.549057 (1.391 sec)\n",
      "INFO:tensorflow:loss = 27.549057, step = 57 (1.391 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.773109\n",
      "INFO:tensorflow:train_accuracy = 0.4769614, train_loss = 36.24977 (1.293 sec)\n",
      "INFO:tensorflow:loss = 36.24977, step = 58 (1.292 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.947289\n",
      "INFO:tensorflow:train_accuracy = 0.52519894, train_loss = 27.983501 (1.056 sec)\n",
      "INFO:tensorflow:loss = 27.983501, step = 59 (1.056 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.80427\n",
      "INFO:tensorflow:train_accuracy = 0.5169147, train_loss = 29.436512 (1.243 sec)\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "INFO:tensorflow:loss = 29.436512, step = 60 (1.243 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.97681\n",
      "INFO:tensorflow:train_accuracy = 0.5193299, train_loss = 30.282953 (1.024 sec)\n",
      "INFO:tensorflow:loss = 30.282953, step = 61 (1.024 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.05999\n",
      "INFO:tensorflow:train_accuracy = 0.5184244, train_loss = 33.104588 (0.944 sec)\n",
      "INFO:tensorflow:loss = 33.104588, step = 62 (0.945 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.865661\n",
      "INFO:tensorflow:train_accuracy = 0.5483444, train_loss = 26.311527 (1.155 sec)\n",
      "INFO:tensorflow:loss = 26.311527, step = 63 (1.154 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.986108\n",
      "INFO:tensorflow:train_accuracy = 0.5399449, train_loss = 27.897413 (1.014 sec)\n",
      "INFO:tensorflow:loss = 27.897413, step = 64 (1.014 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.978341\n",
      "INFO:tensorflow:train_accuracy = 0.494311, train_loss = 32.23047 (1.022 sec)\n",
      "INFO:tensorflow:loss = 32.23047, step = 65 (1.022 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.827942\n",
      "INFO:tensorflow:train_accuracy = 0.50246304, train_loss = 35.92723 (1.208 sec)\n",
      "INFO:tensorflow:loss = 35.92723, step = 66 (1.208 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.953766\n",
      "INFO:tensorflow:train_accuracy = 0.5349144, train_loss = 27.33134 (1.048 sec)\n",
      "INFO:tensorflow:loss = 27.33134, step = 67 (1.049 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.900985\n",
      "INFO:tensorflow:train_accuracy = 0.5281046, train_loss = 29.330795 (1.110 sec)\n",
      "INFO:tensorflow:loss = 29.330795, step = 68 (1.110 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.12109\n",
      "INFO:tensorflow:train_accuracy = 0.52741516, train_loss = 28.022503 (0.892 sec)\n",
      "INFO:tensorflow:loss = 28.022503, step = 69 (0.891 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.927712\n",
      "INFO:tensorflow:train_accuracy = 0.55209744, train_loss = 26.11704 (1.078 sec)\n",
      "INFO:tensorflow:loss = 26.11704, step = 70 (1.079 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.966281\n",
      "INFO:tensorflow:train_accuracy = 0.53756475, train_loss = 26.499966 (1.035 sec)\n",
      "INFO:tensorflow:loss = 26.499966, step = 71 (1.035 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.761975\n",
      "INFO:tensorflow:train_accuracy = 0.4954955, train_loss = 31.251194 (1.312 sec)\n",
      "INFO:tensorflow:loss = 31.251194, step = 72 (1.312 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.778167\n",
      "INFO:tensorflow:train_accuracy = 0.48263028, train_loss = 33.484673 (1.285 sec)\n",
      "INFO:tensorflow:loss = 33.484673, step = 73 (1.285 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.791377\n",
      "INFO:tensorflow:train_accuracy = 0.54210526, train_loss = 26.382092 (1.264 sec)\n",
      "INFO:tensorflow:loss = 26.382092, step = 74 (1.265 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.978818\n",
      "INFO:tensorflow:train_accuracy = 0.512979, train_loss = 32.50041 (1.021 sec)\n",
      "INFO:tensorflow:loss = 32.50041, step = 75 (1.021 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.771623\n",
      "INFO:tensorflow:train_accuracy = 0.52234995, train_loss = 30.776253 (1.296 sec)\n",
      "INFO:tensorflow:loss = 30.776253, step = 76 (1.296 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.799705\n",
      "INFO:tensorflow:train_accuracy = 0.526658, train_loss = 28.46892 (1.251 sec)\n",
      "INFO:tensorflow:loss = 28.46892, step = 77 (1.251 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.824763\n",
      "INFO:tensorflow:train_accuracy = 0.54461944, train_loss = 27.131033 (1.213 sec)\n",
      "INFO:tensorflow:loss = 27.131033, step = 78 (1.213 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.837694\n",
      "INFO:tensorflow:train_accuracy = 0.5124688, train_loss = 30.584589 (1.193 sec)\n",
      "INFO:tensorflow:loss = 30.584589, step = 79 (1.193 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.923506\n",
      "INFO:tensorflow:train_accuracy = 0.5266498, train_loss = 27.094414 (1.083 sec)\n",
      "INFO:tensorflow:loss = 27.094414, step = 80 (1.083 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.684429\n",
      "INFO:tensorflow:train_accuracy = 0.5249376, train_loss = 32.062073 (1.461 sec)\n",
      "INFO:tensorflow:loss = 32.062073, step = 81 (1.462 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.784035\n",
      "INFO:tensorflow:train_accuracy = 0.5168539, train_loss = 30.854208 (1.275 sec)\n",
      "INFO:tensorflow:loss = 30.854208, step = 82 (1.275 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.875804\n",
      "INFO:tensorflow:train_accuracy = 0.52611464, train_loss = 28.65008 (1.142 sec)\n",
      "INFO:tensorflow:loss = 28.65008, step = 83 (1.142 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.848097\n",
      "INFO:tensorflow:train_accuracy = 0.53835976, train_loss = 25.566914 (1.179 sec)\n",
      "INFO:tensorflow:loss = 25.566914, step = 84 (1.179 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.853146\n",
      "INFO:tensorflow:train_accuracy = 0.51692706, train_loss = 26.539383 (1.172 sec)\n",
      "INFO:tensorflow:loss = 26.539383, step = 85 (1.172 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.927612\n",
      "INFO:tensorflow:train_accuracy = 0.53968257, train_loss = 25.907673 (1.078 sec)\n",
      "INFO:tensorflow:loss = 25.907673, step = 86 (1.078 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.907677\n",
      "INFO:tensorflow:train_accuracy = 0.50791717, train_loss = 34.63329 (1.102 sec)\n",
      "INFO:tensorflow:loss = 34.63329, step = 87 (1.102 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.06987\n",
      "INFO:tensorflow:train_accuracy = 0.55481285, train_loss = 23.758015 (0.934 sec)\n",
      "INFO:tensorflow:loss = 23.758015, step = 88 (0.934 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.981612\n",
      "INFO:tensorflow:train_accuracy = 0.5309618, train_loss = 26.40632 (1.019 sec)\n",
      "INFO:tensorflow:loss = 26.40632, step = 89 (1.020 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.849558\n",
      "INFO:tensorflow:train_accuracy = 0.5539281, train_loss = 24.954243 (1.177 sec)\n",
      "INFO:tensorflow:loss = 24.954243, step = 90 (1.177 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.892613\n",
      "INFO:tensorflow:train_accuracy = 0.4957627, train_loss = 34.897255 (1.120 sec)\n",
      "INFO:tensorflow:loss = 34.897255, step = 91 (1.120 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.862442\n",
      "INFO:tensorflow:train_accuracy = 0.5563003, train_loss = 23.60681 (1.159 sec)\n",
      "INFO:tensorflow:loss = 23.60681, step = 92 (1.159 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.870044\n",
      "INFO:tensorflow:train_accuracy = 0.5108557, train_loss = 29.315643 (1.149 sec)\n",
      "INFO:tensorflow:loss = 29.315643, step = 93 (1.149 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.80824\n",
      "INFO:tensorflow:train_accuracy = 0.49939686, train_loss = 31.636858 (1.238 sec)\n",
      "INFO:tensorflow:loss = 31.636858, step = 94 (1.238 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.728393\n",
      "INFO:tensorflow:train_accuracy = 0.50432634, train_loss = 32.50003 (1.373 sec)\n",
      "INFO:tensorflow:loss = 32.50003, step = 95 (1.373 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.791646\n",
      "INFO:tensorflow:train_accuracy = 0.5338542, train_loss = 25.6198 (1.263 sec)\n",
      "INFO:tensorflow:loss = 25.6198, step = 96 (1.263 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.786902\n",
      "INFO:tensorflow:train_accuracy = 0.54498047, train_loss = 27.020454 (1.271 sec)\n",
      "INFO:tensorflow:loss = 27.020454, step = 97 (1.271 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.08279\n",
      "INFO:tensorflow:train_accuracy = 0.53108805, train_loss = 25.675282 (0.923 sec)\n",
      "INFO:tensorflow:loss = 25.675282, step = 98 (0.923 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.913109\n",
      "INFO:tensorflow:train_accuracy = 0.5402597, train_loss = 28.078167 (1.095 sec)\n",
      "INFO:tensorflow:loss = 28.078167, step = 99 (1.095 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.853954\n",
      "INFO:tensorflow:train_accuracy = 0.53806454, train_loss = 27.732206 (1.172 sec)\n",
      "INFO:tensorflow:loss = 27.732206, step = 100 (1.173 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.771567\n",
      "INFO:tensorflow:train_accuracy = 0.5431607, train_loss = 26.988804 (1.295 sec)\n",
      "INFO:tensorflow:loss = 26.988804, step = 101 (1.294 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.90737\n",
      "INFO:tensorflow:train_accuracy = 0.5149157, train_loss = 27.602228 (1.102 sec)\n",
      "INFO:tensorflow:loss = 27.602228, step = 102 (1.103 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.873388\n",
      "INFO:tensorflow:train_accuracy = 0.5639615, train_loss = 23.159576 (1.145 sec)\n",
      "INFO:tensorflow:loss = 23.159576, step = 103 (1.145 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.945854\n",
      "INFO:tensorflow:train_accuracy = 0.5275995, train_loss = 26.497011 (1.057 sec)\n",
      "INFO:tensorflow:loss = 26.497011, step = 104 (1.057 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.965071\n",
      "INFO:tensorflow:train_accuracy = 0.5253576, train_loss = 28.091572 (1.036 sec)\n",
      "INFO:tensorflow:loss = 28.091572, step = 105 (1.036 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.812524\n",
      "INFO:tensorflow:train_accuracy = 0.5324503, train_loss = 25.215752 (1.231 sec)\n",
      "INFO:tensorflow:loss = 25.215752, step = 106 (1.232 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.919286\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "INFO:tensorflow:train_accuracy = 0.5349144, train_loss = 25.283634 (1.088 sec)\n",
      "INFO:tensorflow:loss = 25.283634, step = 107 (1.087 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.942203\n",
      "INFO:tensorflow:train_accuracy = 0.5241117, train_loss = 26.692331 (1.062 sec)\n",
      "INFO:tensorflow:loss = 26.692331, step = 108 (1.062 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.02958\n",
      "INFO:tensorflow:train_accuracy = 0.5168961, train_loss = 28.804419 (0.971 sec)\n",
      "INFO:tensorflow:loss = 28.804419, step = 109 (0.971 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.04589\n",
      "INFO:tensorflow:train_accuracy = 0.55989236, train_loss = 22.20596 (0.956 sec)\n",
      "INFO:tensorflow:loss = 22.20596, step = 110 (0.955 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.07368\n",
      "INFO:tensorflow:train_accuracy = 0.53978777, train_loss = 25.103392 (0.932 sec)\n",
      "INFO:tensorflow:loss = 25.103392, step = 111 (0.933 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.715678\n",
      "INFO:tensorflow:train_accuracy = 0.53737116, train_loss = 26.209068 (1.397 sec)\n",
      "INFO:tensorflow:loss = 26.209068, step = 112 (1.396 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.909332\n",
      "INFO:tensorflow:train_accuracy = 0.5032175, train_loss = 26.364038 (1.100 sec)\n",
      "INFO:tensorflow:loss = 26.364038, step = 113 (1.100 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.838528\n",
      "INFO:tensorflow:train_accuracy = 0.5416667, train_loss = 27.88387 (1.193 sec)\n",
      "INFO:tensorflow:loss = 27.88387, step = 114 (1.193 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.995626\n",
      "INFO:tensorflow:train_accuracy = 0.5577957, train_loss = 23.005016 (1.004 sec)\n",
      "INFO:tensorflow:loss = 23.005016, step = 115 (1.004 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.06402\n",
      "INFO:tensorflow:train_accuracy = 0.52459013, train_loss = 26.380558 (0.940 sec)\n",
      "INFO:tensorflow:loss = 26.380558, step = 116 (0.940 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.01713\n",
      "INFO:tensorflow:train_accuracy = 0.55026454, train_loss = 23.390884 (0.983 sec)\n",
      "INFO:tensorflow:loss = 23.390884, step = 117 (0.983 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.991834\n",
      "INFO:tensorflow:train_accuracy = 0.54953766, train_loss = 24.088467 (1.009 sec)\n",
      "INFO:tensorflow:loss = 24.088467, step = 118 (1.009 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.886472\n",
      "INFO:tensorflow:train_accuracy = 0.50560397, train_loss = 29.484411 (1.128 sec)\n",
      "INFO:tensorflow:loss = 29.484411, step = 119 (1.128 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.774688\n",
      "INFO:tensorflow:train_accuracy = 0.5177665, train_loss = 28.67995 (1.291 sec)\n",
      "INFO:tensorflow:loss = 28.67995, step = 120 (1.291 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.03136\n",
      "INFO:tensorflow:train_accuracy = 0.53846157, train_loss = 23.812191 (0.970 sec)\n",
      "INFO:tensorflow:loss = 23.812191, step = 121 (0.969 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.768466\n",
      "INFO:tensorflow:train_accuracy = 0.52986026, train_loss = 27.106922 (1.301 sec)\n",
      "INFO:tensorflow:loss = 27.106922, step = 122 (1.301 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.02952\n",
      "INFO:tensorflow:train_accuracy = 0.5252525, train_loss = 27.89293 (0.971 sec)\n",
      "INFO:tensorflow:loss = 27.89293, step = 123 (0.971 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.816251\n",
      "INFO:tensorflow:train_accuracy = 0.53248405, train_loss = 24.660885 (1.225 sec)\n",
      "INFO:tensorflow:loss = 24.660885, step = 124 (1.225 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.886479\n",
      "INFO:tensorflow:train_accuracy = 0.5258512, train_loss = 29.298859 (1.128 sec)\n",
      "INFO:tensorflow:loss = 29.298859, step = 125 (1.128 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.737399\n",
      "INFO:tensorflow:train_accuracy = 0.5299363, train_loss = 26.522179 (1.356 sec)\n",
      "INFO:tensorflow:loss = 26.522179, step = 126 (1.355 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.96043\n",
      "INFO:tensorflow:train_accuracy = 0.5265151, train_loss = 25.056087 (1.041 sec)\n",
      "INFO:tensorflow:loss = 25.056087, step = 127 (1.042 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.826667\n",
      "INFO:tensorflow:train_accuracy = 0.5278481, train_loss = 26.969967 (1.210 sec)\n",
      "INFO:tensorflow:loss = 26.969967, step = 128 (1.210 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.970068\n",
      "INFO:tensorflow:train_accuracy = 0.5068493, train_loss = 28.734037 (1.031 sec)\n",
      "INFO:tensorflow:loss = 28.734037, step = 129 (1.031 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.899817\n",
      "INFO:tensorflow:train_accuracy = 0.53957784, train_loss = 25.159191 (1.111 sec)\n",
      "INFO:tensorflow:loss = 25.159191, step = 130 (1.111 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.791122\n",
      "INFO:tensorflow:train_accuracy = 0.54593176, train_loss = 24.651814 (1.264 sec)\n",
      "INFO:tensorflow:loss = 24.651814, step = 131 (1.264 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.915674\n",
      "INFO:tensorflow:train_accuracy = 0.5436767, train_loss = 25.99098 (1.092 sec)\n",
      "INFO:tensorflow:loss = 25.99098, step = 132 (1.092 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.941393\n",
      "INFO:tensorflow:train_accuracy = 0.5093867, train_loss = 27.844229 (1.062 sec)\n",
      "INFO:tensorflow:loss = 27.844229, step = 133 (1.062 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.987641\n",
      "INFO:tensorflow:train_accuracy = 0.50924784, train_loss = 27.200542 (1.013 sec)\n",
      "INFO:tensorflow:loss = 27.200542, step = 134 (1.013 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.03027\n",
      "INFO:tensorflow:train_accuracy = 0.55898124, train_loss = 22.229849 (0.970 sec)\n",
      "INFO:tensorflow:loss = 22.229849, step = 135 (0.970 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.997935\n",
      "INFO:tensorflow:train_accuracy = 0.5606469, train_loss = 21.522228 (1.002 sec)\n",
      "INFO:tensorflow:loss = 21.522228, step = 136 (1.002 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.78193\n",
      "INFO:tensorflow:train_accuracy = 0.5539906, train_loss = 26.390717 (1.279 sec)\n",
      "INFO:tensorflow:loss = 26.390717, step = 137 (1.279 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.871336\n",
      "INFO:tensorflow:train_accuracy = 0.5396619, train_loss = 23.87276 (1.147 sec)\n",
      "INFO:tensorflow:loss = 23.87276, step = 138 (1.147 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.72522\n",
      "INFO:tensorflow:train_accuracy = 0.5024213, train_loss = 31.6741 (1.379 sec)\n",
      "INFO:tensorflow:loss = 31.6741, step = 139 (1.380 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.935057\n",
      "INFO:tensorflow:train_accuracy = 0.52465236, train_loss = 29.786064 (1.069 sec)\n",
      "INFO:tensorflow:loss = 29.786064, step = 140 (1.069 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.722419\n",
      "INFO:tensorflow:train_accuracy = 0.5265823, train_loss = 26.27922 (1.384 sec)\n",
      "INFO:tensorflow:loss = 26.27922, step = 141 (1.384 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.948969\n",
      "INFO:tensorflow:train_accuracy = 0.54461944, train_loss = 22.76053 (1.054 sec)\n",
      "INFO:tensorflow:loss = 22.76053, step = 142 (1.054 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.910164\n",
      "INFO:tensorflow:train_accuracy = 0.55525964, train_loss = 24.020037 (1.099 sec)\n",
      "INFO:tensorflow:loss = 24.020037, step = 143 (1.098 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.79202\n",
      "INFO:tensorflow:train_accuracy = 0.5353925, train_loss = 26.57714 (1.262 sec)\n",
      "INFO:tensorflow:loss = 26.57714, step = 144 (1.262 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.994711\n",
      "INFO:tensorflow:train_accuracy = 0.55245686, train_loss = 23.625973 (1.006 sec)\n",
      "INFO:tensorflow:loss = 23.625973, step = 145 (1.006 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.828956\n",
      "INFO:tensorflow:train_accuracy = 0.5319693, train_loss = 25.28297 (1.206 sec)\n",
      "INFO:tensorflow:loss = 25.28297, step = 146 (1.207 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.745933\n",
      "INFO:tensorflow:train_accuracy = 0.55135137, train_loss = 22.762512 (1.340 sec)\n",
      "INFO:tensorflow:loss = 22.762512, step = 147 (1.340 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.986583\n",
      "INFO:tensorflow:train_accuracy = 0.5305592, train_loss = 23.735691 (1.014 sec)\n",
      "INFO:tensorflow:loss = 23.735691, step = 148 (1.014 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.901865\n",
      "INFO:tensorflow:train_accuracy = 0.5271808, train_loss = 26.309196 (1.109 sec)\n",
      "INFO:tensorflow:loss = 26.309196, step = 149 (1.109 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.961486\n",
      "INFO:tensorflow:train_accuracy = 0.5497312, train_loss = 23.636206 (1.040 sec)\n",
      "INFO:tensorflow:loss = 23.636206, step = 150 (1.040 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.985936\n",
      "INFO:tensorflow:train_accuracy = 0.53776044, train_loss = 23.921494 (1.014 sec)\n",
      "INFO:tensorflow:loss = 23.921494, step = 151 (1.014 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.04796\n",
      "INFO:tensorflow:train_accuracy = 0.5430809, train_loss = 24.614983 (0.954 sec)\n",
      "INFO:tensorflow:loss = 24.614983, step = 152 (0.954 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.965075\n",
      "INFO:tensorflow:train_accuracy = 0.54498047, train_loss = 25.456984 (1.036 sec)\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "INFO:tensorflow:loss = 25.456984, step = 153 (1.036 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.988419\n",
      "INFO:tensorflow:train_accuracy = 0.5388601, train_loss = 24.609137 (1.012 sec)\n",
      "INFO:tensorflow:loss = 24.609137, step = 154 (1.012 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.01656\n",
      "INFO:tensorflow:train_accuracy = 0.5410691, train_loss = 23.714384 (0.984 sec)\n",
      "INFO:tensorflow:loss = 23.714384, step = 155 (0.984 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.948728\n",
      "INFO:tensorflow:train_accuracy = 0.52902377, train_loss = 22.971615 (1.054 sec)\n",
      "INFO:tensorflow:loss = 22.971615, step = 156 (1.053 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.976495\n",
      "INFO:tensorflow:train_accuracy = 0.5567423, train_loss = 24.720615 (1.024 sec)\n",
      "INFO:tensorflow:loss = 24.720615, step = 157 (1.024 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.794895\n",
      "INFO:tensorflow:train_accuracy = 0.51294696, train_loss = 28.691193 (1.258 sec)\n",
      "INFO:tensorflow:loss = 28.691193, step = 158 (1.259 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.695228\n",
      "INFO:tensorflow:train_accuracy = 0.53324807, train_loss = 26.157387 (1.438 sec)\n",
      "INFO:tensorflow:loss = 26.157387, step = 159 (1.438 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.826798\n",
      "INFO:tensorflow:train_accuracy = 0.53896105, train_loss = 22.553371 (1.209 sec)\n",
      "INFO:tensorflow:loss = 22.553371, step = 160 (1.209 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.932544\n",
      "INFO:tensorflow:train_accuracy = 0.5679348, train_loss = 21.93082 (1.072 sec)\n",
      "INFO:tensorflow:loss = 21.93082, step = 161 (1.072 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.971326\n",
      "INFO:tensorflow:train_accuracy = 0.5530504, train_loss = 21.978397 (1.031 sec)\n",
      "INFO:tensorflow:loss = 21.978397, step = 162 (1.031 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.0874\n",
      "INFO:tensorflow:train_accuracy = 0.5489418, train_loss = 21.7752 (0.918 sec)\n",
      "INFO:tensorflow:loss = 21.7752, step = 163 (0.918 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.675099\n",
      "INFO:tensorflow:train_accuracy = 0.5374677, train_loss = 24.899267 (1.481 sec)\n",
      "INFO:tensorflow:loss = 24.899267, step = 164 (1.481 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.03132\n",
      "INFO:tensorflow:train_accuracy = 0.534282, train_loss = 25.94657 (0.970 sec)\n",
      "INFO:tensorflow:loss = 25.94657, step = 165 (0.970 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.799585\n",
      "INFO:tensorflow:train_accuracy = 0.51995015, train_loss = 26.605858 (1.251 sec)\n",
      "INFO:tensorflow:loss = 26.605858, step = 166 (1.250 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.955995\n",
      "INFO:tensorflow:train_accuracy = 0.5169385, train_loss = 26.12045 (1.046 sec)\n",
      "INFO:tensorflow:loss = 26.12045, step = 167 (1.046 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.770158\n",
      "INFO:tensorflow:train_accuracy = 0.53128994, train_loss = 26.326504 (1.298 sec)\n",
      "INFO:tensorflow:loss = 26.326504, step = 168 (1.298 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.976171\n",
      "INFO:tensorflow:train_accuracy = 0.55059135, train_loss = 24.339317 (1.024 sec)\n",
      "INFO:tensorflow:loss = 24.339317, step = 169 (1.025 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.826038\n",
      "INFO:tensorflow:train_accuracy = 0.52644837, train_loss = 25.59846 (1.211 sec)\n",
      "INFO:tensorflow:loss = 25.59846, step = 170 (1.211 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.9117\n",
      "INFO:tensorflow:train_accuracy = 0.51548946, train_loss = 27.398296 (1.097 sec)\n",
      "INFO:tensorflow:loss = 27.398296, step = 171 (1.097 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.880765\n",
      "INFO:tensorflow:train_accuracy = 0.5285896, train_loss = 23.608929 (1.135 sec)\n",
      "INFO:tensorflow:loss = 23.608929, step = 172 (1.135 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.694641\n",
      "INFO:tensorflow:train_accuracy = 0.52598226, train_loss = 25.78184 (1.439 sec)\n",
      "INFO:tensorflow:loss = 25.78184, step = 173 (1.439 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.886342\n",
      "INFO:tensorflow:train_accuracy = 0.5175, train_loss = 26.234222 (1.129 sec)\n",
      "INFO:tensorflow:loss = 26.234222, step = 174 (1.129 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.821342\n",
      "INFO:tensorflow:train_accuracy = 0.5252525, train_loss = 26.937912 (1.217 sec)\n",
      "INFO:tensorflow:loss = 26.937912, step = 175 (1.217 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.898672\n",
      "INFO:tensorflow:train_accuracy = 0.539559, train_loss = 24.056969 (1.113 sec)\n",
      "INFO:tensorflow:loss = 24.056969, step = 176 (1.113 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.707127\n",
      "INFO:tensorflow:train_accuracy = 0.5253165, train_loss = 24.616978 (1.414 sec)\n",
      "INFO:tensorflow:loss = 24.616978, step = 177 (1.415 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.880153\n",
      "INFO:tensorflow:train_accuracy = 0.540856, train_loss = 26.37318 (1.136 sec)\n",
      "INFO:tensorflow:loss = 26.37318, step = 178 (1.136 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.928591\n",
      "INFO:tensorflow:train_accuracy = 0.5508587, train_loss = 22.445126 (1.077 sec)\n",
      "INFO:tensorflow:loss = 22.445126, step = 179 (1.077 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.880352\n",
      "INFO:tensorflow:train_accuracy = 0.5318066, train_loss = 25.814518 (1.136 sec)\n",
      "INFO:tensorflow:loss = 25.814518, step = 180 (1.136 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.962466\n",
      "INFO:tensorflow:train_accuracy = 0.52918285, train_loss = 23.476992 (1.039 sec)\n",
      "INFO:tensorflow:loss = 23.476992, step = 181 (1.039 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.991651\n",
      "INFO:tensorflow:train_accuracy = 0.5614035, train_loss = 20.70608 (1.008 sec)\n",
      "INFO:tensorflow:loss = 20.70608, step = 182 (1.008 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.04501\n",
      "INFO:tensorflow:train_accuracy = 0.55714285, train_loss = 21.358727 (0.957 sec)\n",
      "INFO:tensorflow:loss = 21.358727, step = 183 (0.958 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.90051\n",
      "INFO:tensorflow:train_accuracy = 0.54677206, train_loss = 22.84766 (1.110 sec)\n",
      "INFO:tensorflow:loss = 22.84766, step = 184 (1.110 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.722772\n",
      "INFO:tensorflow:train_accuracy = 0.49701315, train_loss = 31.189629 (1.384 sec)\n",
      "INFO:tensorflow:loss = 31.189629, step = 185 (1.384 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.974931\n",
      "INFO:tensorflow:train_accuracy = 0.5407503, train_loss = 25.216496 (1.026 sec)\n",
      "INFO:tensorflow:loss = 25.216496, step = 186 (1.026 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.881042\n",
      "INFO:tensorflow:train_accuracy = 0.53097343, train_loss = 26.07528 (1.135 sec)\n",
      "INFO:tensorflow:loss = 26.07528, step = 187 (1.135 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.900211\n",
      "INFO:tensorflow:train_accuracy = 0.55941254, train_loss = 23.115774 (1.111 sec)\n",
      "INFO:tensorflow:loss = 23.115774, step = 188 (1.111 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.798038\n",
      "INFO:tensorflow:train_accuracy = 0.53188777, train_loss = 25.860792 (1.253 sec)\n",
      "INFO:tensorflow:loss = 25.860792, step = 189 (1.253 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.890795\n",
      "INFO:tensorflow:train_accuracy = 0.54046994, train_loss = 24.022158 (1.123 sec)\n",
      "INFO:tensorflow:loss = 24.022158, step = 190 (1.123 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.911936\n",
      "INFO:tensorflow:train_accuracy = 0.5275995, train_loss = 25.3322 (1.097 sec)\n",
      "INFO:tensorflow:loss = 25.3322, step = 191 (1.097 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.794371\n",
      "INFO:tensorflow:train_accuracy = 0.5353017, train_loss = 23.201141 (1.259 sec)\n",
      "INFO:tensorflow:loss = 23.201141, step = 192 (1.259 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.724342\n",
      "INFO:tensorflow:train_accuracy = 0.53937006, train_loss = 24.755402 (1.380 sec)\n",
      "INFO:tensorflow:loss = 24.755402, step = 193 (1.380 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.960961\n",
      "INFO:tensorflow:train_accuracy = 0.5539281, train_loss = 23.285278 (1.041 sec)\n",
      "INFO:tensorflow:loss = 23.285278, step = 194 (1.041 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.865231\n",
      "INFO:tensorflow:train_accuracy = 0.5501319, train_loss = 21.825184 (1.156 sec)\n",
      "INFO:tensorflow:loss = 21.825184, step = 195 (1.156 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.958456\n",
      "INFO:tensorflow:train_accuracy = 0.54285717, train_loss = 24.397572 (1.043 sec)\n",
      "INFO:tensorflow:loss = 24.397572, step = 196 (1.043 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.07044\n",
      "INFO:tensorflow:train_accuracy = 0.539267, train_loss = 22.66737 (0.934 sec)\n",
      "INFO:tensorflow:loss = 22.66737, step = 197 (0.934 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.828851\n",
      "INFO:tensorflow:train_accuracy = 0.56216216, train_loss = 21.767622 (1.206 sec)\n",
      "INFO:tensorflow:loss = 21.767622, step = 198 (1.206 sec)\n",
      "INFO:tensorflow:Saving checkpoints for 200 into asr-cnn-rnn/model.ckpt.\n",
      "INFO:tensorflow:Calling model_fn.\n",
      "WARNING:tensorflow:From /home/husein/malaya-speech/malaya_speech/train/model/ctc/metrics.py:58: The name tf.metrics.mean is deprecated. Please use tf.compat.v1.metrics.mean instead.\n",
      "\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "WARNING:tensorflow:From /home/husein/malaya-speech/malaya_speech/train/model/ctc/metrics.py:119: The name tf.variable_scope is deprecated. Please use tf.compat.v1.variable_scope instead.\n",
      "\n",
      "WARNING:tensorflow:From /home/husein/malaya-speech/malaya_speech/train/model/ctc/metrics.py:106: The name tf.regex_replace is deprecated. Please use tf.strings.regex_replace instead.\n",
      "\n",
      "INFO:tensorflow:Done calling model_fn.\n",
      "INFO:tensorflow:Starting evaluation at 2020-10-25T18:57:52Z\n",
      "INFO:tensorflow:Graph was finalized.\n",
      "INFO:tensorflow:Restoring parameters from asr-cnn-rnn/model.ckpt-200\n",
      "INFO:tensorflow:Running local_init_op.\n",
      "INFO:tensorflow:Done running local_init_op.\n",
      "INFO:tensorflow:Evaluation [1/10]\n",
      "INFO:tensorflow:Evaluation [2/10]\n",
      "INFO:tensorflow:Evaluation [3/10]\n",
      "INFO:tensorflow:Evaluation [4/10]\n",
      "INFO:tensorflow:Evaluation [5/10]\n",
      "INFO:tensorflow:Evaluation [6/10]\n",
      "INFO:tensorflow:Evaluation [7/10]\n",
      "INFO:tensorflow:Evaluation [8/10]\n",
      "INFO:tensorflow:Evaluation [9/10]\n",
      "INFO:tensorflow:Evaluation [10/10]\n",
      "INFO:tensorflow:Finished evaluation at 2020-10-25-18:57:57\n",
      "INFO:tensorflow:Saving dict for global step 200: WER = 0.69767433, accuracy = 0.53987736, global_step = 200, loss = 24.807085\n",
      "INFO:tensorflow:Saving 'checkpoint_path' summary for global step 200: asr-cnn-rnn/model.ckpt-200\n",
      "INFO:tensorflow:global_step/sec: 0.11412\n",
      "INFO:tensorflow:train_accuracy = 0.5251889, train_loss = 26.156418 (8.762 sec)\n",
      "INFO:tensorflow:loss = 26.156418, step = 199 (8.762 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.11278\n",
      "INFO:tensorflow:train_accuracy = 0.53333336, train_loss = 23.876102 (0.900 sec)\n",
      "INFO:tensorflow:loss = 23.876102, step = 200 (0.901 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.929969\n",
      "INFO:tensorflow:train_accuracy = 0.53717947, train_loss = 24.544762 (1.074 sec)\n",
      "INFO:tensorflow:loss = 24.544762, step = 201 (1.073 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.939644\n",
      "INFO:tensorflow:train_accuracy = 0.56216216, train_loss = 20.266867 (1.064 sec)\n",
      "INFO:tensorflow:loss = 20.266867, step = 202 (1.064 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.909439\n",
      "INFO:tensorflow:train_accuracy = 0.5471448, train_loss = 23.677902 (1.100 sec)\n",
      "INFO:tensorflow:loss = 23.677902, step = 203 (1.101 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.842141\n",
      "INFO:tensorflow:train_accuracy = 0.51724136, train_loss = 28.679585 (1.188 sec)\n",
      "INFO:tensorflow:loss = 28.679585, step = 204 (1.188 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.987608\n",
      "INFO:tensorflow:train_accuracy = 0.54755783, train_loss = 25.351957 (1.013 sec)\n",
      "INFO:tensorflow:loss = 25.351957, step = 205 (1.013 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.89741\n",
      "INFO:tensorflow:train_accuracy = 0.54927725, train_loss = 21.59359 (1.114 sec)\n",
      "INFO:tensorflow:loss = 21.59359, step = 206 (1.114 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.993237\n",
      "INFO:tensorflow:train_accuracy = 0.5516778, train_loss = 21.519512 (1.007 sec)\n",
      "INFO:tensorflow:loss = 21.519512, step = 207 (1.007 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.04155\n",
      "INFO:tensorflow:train_accuracy = 0.5396619, train_loss = 23.304424 (0.960 sec)\n",
      "INFO:tensorflow:loss = 23.304424, step = 208 (0.960 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.05463\n",
      "INFO:tensorflow:train_accuracy = 0.5704607, train_loss = 21.165257 (0.948 sec)\n",
      "INFO:tensorflow:loss = 21.165257, step = 209 (0.948 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.727064\n",
      "INFO:tensorflow:train_accuracy = 0.5385604, train_loss = 23.569332 (1.375 sec)\n",
      "INFO:tensorflow:loss = 23.569332, step = 210 (1.375 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.711756\n",
      "INFO:tensorflow:train_accuracy = 0.5220126, train_loss = 25.96184 (1.405 sec)\n",
      "INFO:tensorflow:loss = 25.96184, step = 211 (1.405 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.04735\n",
      "INFO:tensorflow:train_accuracy = 0.53333336, train_loss = 24.770214 (0.955 sec)\n",
      "INFO:tensorflow:loss = 24.770214, step = 212 (0.955 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.13011\n",
      "INFO:tensorflow:train_accuracy = 0.51428574, train_loss = 26.389198 (0.885 sec)\n",
      "INFO:tensorflow:loss = 26.389198, step = 213 (0.884 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.819093\n",
      "INFO:tensorflow:train_accuracy = 0.5211443, train_loss = 27.796818 (1.221 sec)\n",
      "INFO:tensorflow:loss = 27.796818, step = 214 (1.221 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.983419\n",
      "INFO:tensorflow:train_accuracy = 0.564, train_loss = 21.915562 (1.017 sec)\n",
      "INFO:tensorflow:loss = 21.915562, step = 215 (1.017 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.886563\n",
      "INFO:tensorflow:train_accuracy = 0.5353925, train_loss = 24.837837 (1.128 sec)\n",
      "INFO:tensorflow:loss = 24.837837, step = 216 (1.127 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.900959\n",
      "INFO:tensorflow:train_accuracy = 0.52130324, train_loss = 26.90546 (1.110 sec)\n",
      "INFO:tensorflow:loss = 26.90546, step = 217 (1.111 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.98908\n",
      "INFO:tensorflow:train_accuracy = 0.53589743, train_loss = 23.254988 (1.011 sec)\n",
      "INFO:tensorflow:loss = 23.254988, step = 218 (1.011 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.893538\n",
      "INFO:tensorflow:train_accuracy = 0.5414508, train_loss = 22.873672 (1.119 sec)\n",
      "INFO:tensorflow:loss = 22.873672, step = 219 (1.119 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.903219\n",
      "INFO:tensorflow:train_accuracy = 0.5184275, train_loss = 27.66301 (1.107 sec)\n",
      "INFO:tensorflow:loss = 27.66301, step = 220 (1.107 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.78108\n",
      "INFO:tensorflow:train_accuracy = 0.53324807, train_loss = 25.40828 (1.280 sec)\n",
      "INFO:tensorflow:loss = 25.40828, step = 221 (1.281 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.795912\n",
      "INFO:tensorflow:train_accuracy = 0.5411311, train_loss = 21.761154 (1.256 sec)\n",
      "INFO:tensorflow:loss = 21.761154, step = 222 (1.256 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.986521\n",
      "INFO:tensorflow:train_accuracy = 0.5427461, train_loss = 25.046974 (1.014 sec)\n",
      "INFO:tensorflow:loss = 25.046974, step = 223 (1.014 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.846093\n",
      "INFO:tensorflow:train_accuracy = 0.53994846, train_loss = 23.486835 (1.181 sec)\n",
      "INFO:tensorflow:loss = 23.486835, step = 224 (1.181 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.913834\n",
      "INFO:tensorflow:train_accuracy = 0.538163, train_loss = 23.758455 (1.095 sec)\n",
      "INFO:tensorflow:loss = 23.758455, step = 225 (1.096 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.935669\n",
      "INFO:tensorflow:train_accuracy = 0.5291878, train_loss = 24.513123 (1.068 sec)\n",
      "INFO:tensorflow:loss = 24.513123, step = 226 (1.068 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.95769\n",
      "INFO:tensorflow:train_accuracy = 0.55452126, train_loss = 21.819103 (1.044 sec)\n",
      "INFO:tensorflow:loss = 21.819103, step = 227 (1.044 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.895082\n",
      "INFO:tensorflow:train_accuracy = 0.54461944, train_loss = 22.2184 (1.117 sec)\n",
      "INFO:tensorflow:loss = 22.2184, step = 228 (1.117 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.02425\n",
      "INFO:tensorflow:train_accuracy = 0.5598086, train_loss = 21.834127 (0.976 sec)\n",
      "INFO:tensorflow:loss = 21.834127, step = 229 (0.976 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.871358\n",
      "INFO:tensorflow:train_accuracy = 0.5565912, train_loss = 21.625349 (1.148 sec)\n",
      "INFO:tensorflow:loss = 21.625349, step = 230 (1.147 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.777169\n",
      "INFO:tensorflow:train_accuracy = 0.52261305, train_loss = 26.071514 (1.287 sec)\n",
      "INFO:tensorflow:loss = 26.071514, step = 231 (1.287 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.83129\n",
      "INFO:tensorflow:train_accuracy = 0.5134474, train_loss = 26.458986 (1.203 sec)\n",
      "INFO:tensorflow:loss = 26.458986, step = 232 (1.203 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.906247\n",
      "INFO:tensorflow:train_accuracy = 0.54155844, train_loss = 22.946304 (1.103 sec)\n",
      "INFO:tensorflow:loss = 22.946304, step = 233 (1.103 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.87614\n",
      "INFO:tensorflow:train_accuracy = 0.53786904, train_loss = 24.567186 (1.142 sec)\n",
      "INFO:tensorflow:loss = 24.567186, step = 234 (1.142 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.7711\n",
      "INFO:tensorflow:train_accuracy = 0.53248405, train_loss = 26.161385 (1.297 sec)\n",
      "INFO:tensorflow:loss = 26.161385, step = 235 (1.297 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.895355\n",
      "INFO:tensorflow:train_accuracy = 0.540856, train_loss = 22.163858 (1.117 sec)\n",
      "INFO:tensorflow:loss = 22.163858, step = 236 (1.117 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.755809\n",
      "INFO:tensorflow:train_accuracy = 0.54927725, train_loss = 22.335907 (1.323 sec)\n",
      "INFO:tensorflow:loss = 22.335907, step = 237 (1.323 sec)\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "INFO:tensorflow:global_step/sec: 0.83064\n",
      "INFO:tensorflow:train_accuracy = 0.5345268, train_loss = 25.115643 (1.204 sec)\n",
      "INFO:tensorflow:loss = 25.115643, step = 238 (1.204 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.731143\n",
      "INFO:tensorflow:train_accuracy = 0.5456919, train_loss = 22.243744 (1.368 sec)\n",
      "INFO:tensorflow:loss = 22.243744, step = 239 (1.368 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.08113\n",
      "INFO:tensorflow:train_accuracy = 0.5536424, train_loss = 23.466244 (0.925 sec)\n",
      "INFO:tensorflow:loss = 23.466244, step = 240 (0.925 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.06481\n",
      "INFO:tensorflow:train_accuracy = 0.5406452, train_loss = 23.510422 (0.939 sec)\n",
      "INFO:tensorflow:loss = 23.510422, step = 241 (0.939 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.895943\n",
      "INFO:tensorflow:train_accuracy = 0.5424837, train_loss = 22.242815 (1.116 sec)\n",
      "INFO:tensorflow:loss = 22.242815, step = 242 (1.116 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.00827\n",
      "INFO:tensorflow:train_accuracy = 0.55886334, train_loss = 21.015936 (0.992 sec)\n",
      "INFO:tensorflow:loss = 21.015936, step = 243 (0.992 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.993284\n",
      "INFO:tensorflow:train_accuracy = 0.55764073, train_loss = 19.391697 (1.007 sec)\n",
      "INFO:tensorflow:loss = 19.391697, step = 244 (1.007 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.987691\n",
      "INFO:tensorflow:train_accuracy = 0.52125, train_loss = 25.001596 (1.012 sec)\n",
      "INFO:tensorflow:loss = 25.001596, step = 245 (1.012 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.874275\n",
      "INFO:tensorflow:train_accuracy = 0.5554072, train_loss = 21.416588 (1.144 sec)\n",
      "INFO:tensorflow:loss = 21.416588, step = 246 (1.144 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.917101\n",
      "INFO:tensorflow:train_accuracy = 0.53324807, train_loss = 23.624432 (1.090 sec)\n",
      "INFO:tensorflow:loss = 23.624432, step = 247 (1.090 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.927488\n",
      "INFO:tensorflow:train_accuracy = 0.54461944, train_loss = 21.400581 (1.078 sec)\n",
      "INFO:tensorflow:loss = 21.400581, step = 248 (1.079 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.929081\n",
      "INFO:tensorflow:train_accuracy = 0.54652685, train_loss = 25.093117 (1.076 sec)\n",
      "INFO:tensorflow:loss = 25.093117, step = 249 (1.075 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.870236\n",
      "INFO:tensorflow:train_accuracy = 0.55, train_loss = 20.772312 (1.149 sec)\n",
      "INFO:tensorflow:loss = 20.772312, step = 250 (1.149 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.933782\n",
      "INFO:tensorflow:train_accuracy = 0.5376756, train_loss = 26.533318 (1.071 sec)\n",
      "INFO:tensorflow:loss = 26.533318, step = 251 (1.071 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.93288\n",
      "INFO:tensorflow:train_accuracy = 0.5562914, train_loss = 20.847446 (1.072 sec)\n",
      "INFO:tensorflow:loss = 20.847446, step = 252 (1.072 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.919299\n",
      "INFO:tensorflow:train_accuracy = 0.5546772, train_loss = 21.307793 (1.088 sec)\n",
      "INFO:tensorflow:loss = 21.307793, step = 253 (1.088 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.754079\n",
      "INFO:tensorflow:train_accuracy = 0.5419355, train_loss = 23.087126 (1.326 sec)\n",
      "INFO:tensorflow:loss = 23.087126, step = 254 (1.326 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.01562\n",
      "INFO:tensorflow:train_accuracy = 0.55149937, train_loss = 22.203543 (0.984 sec)\n",
      "INFO:tensorflow:loss = 22.203543, step = 255 (0.984 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.00118\n",
      "INFO:tensorflow:train_accuracy = 0.5531915, train_loss = 20.568817 (0.999 sec)\n",
      "INFO:tensorflow:loss = 20.568817, step = 256 (0.999 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.774734\n",
      "INFO:tensorflow:train_accuracy = 0.52434456, train_loss = 25.691349 (1.291 sec)\n",
      "INFO:tensorflow:loss = 25.691349, step = 257 (1.291 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.690387\n",
      "INFO:tensorflow:train_accuracy = 0.52380955, train_loss = 25.975723 (1.449 sec)\n",
      "INFO:tensorflow:loss = 25.975723, step = 258 (1.449 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.96543\n",
      "INFO:tensorflow:train_accuracy = 0.5437909, train_loss = 20.357689 (1.035 sec)\n",
      "INFO:tensorflow:loss = 20.357689, step = 259 (1.035 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.813881\n",
      "INFO:tensorflow:train_accuracy = 0.50791717, train_loss = 28.261576 (1.229 sec)\n",
      "INFO:tensorflow:loss = 28.261576, step = 260 (1.228 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.864978\n",
      "INFO:tensorflow:train_accuracy = 0.5491481, train_loss = 21.785662 (1.156 sec)\n",
      "INFO:tensorflow:loss = 21.785662, step = 261 (1.156 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.01108\n",
      "INFO:tensorflow:train_accuracy = 0.54581153, train_loss = 23.321796 (0.989 sec)\n",
      "INFO:tensorflow:loss = 23.321796, step = 262 (0.989 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.854264\n",
      "INFO:tensorflow:train_accuracy = 0.5197531, train_loss = 25.532532 (1.171 sec)\n",
      "INFO:tensorflow:loss = 25.532532, step = 263 (1.171 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.00776\n",
      "INFO:tensorflow:train_accuracy = 0.5312102, train_loss = 20.964083 (0.992 sec)\n",
      "INFO:tensorflow:loss = 20.964083, step = 264 (0.992 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.837024\n",
      "INFO:tensorflow:train_accuracy = 0.5258512, train_loss = 24.828869 (1.195 sec)\n",
      "INFO:tensorflow:loss = 24.828869, step = 265 (1.194 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.945135\n",
      "INFO:tensorflow:train_accuracy = 0.53786904, train_loss = 24.24141 (1.058 sec)\n",
      "INFO:tensorflow:loss = 24.24141, step = 266 (1.059 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.874653\n",
      "INFO:tensorflow:train_accuracy = 0.53786904, train_loss = 23.268566 (1.143 sec)\n",
      "INFO:tensorflow:loss = 23.268566, step = 267 (1.143 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.885204\n",
      "INFO:tensorflow:train_accuracy = 0.5209657, train_loss = 24.878101 (1.129 sec)\n",
      "INFO:tensorflow:loss = 24.878101, step = 268 (1.129 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.882989\n",
      "INFO:tensorflow:train_accuracy = 0.5204461, train_loss = 25.976526 (1.133 sec)\n",
      "INFO:tensorflow:loss = 25.976526, step = 269 (1.133 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.02537\n",
      "INFO:tensorflow:train_accuracy = 0.5484293, train_loss = 24.159473 (0.975 sec)\n",
      "INFO:tensorflow:loss = 24.159473, step = 270 (0.975 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.909947\n",
      "INFO:tensorflow:train_accuracy = 0.54545456, train_loss = 22.528734 (1.099 sec)\n",
      "INFO:tensorflow:loss = 22.528734, step = 271 (1.098 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.04747\n",
      "INFO:tensorflow:train_accuracy = 0.5374677, train_loss = 21.773949 (0.955 sec)\n",
      "INFO:tensorflow:loss = 21.773949, step = 272 (0.955 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.976588\n",
      "INFO:tensorflow:train_accuracy = 0.5353017, train_loss = 22.4968 (1.024 sec)\n",
      "INFO:tensorflow:loss = 22.4968, step = 273 (1.024 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.958252\n",
      "INFO:tensorflow:train_accuracy = 0.56216216, train_loss = 20.535599 (1.044 sec)\n",
      "INFO:tensorflow:loss = 20.535599, step = 274 (1.044 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.07479\n",
      "INFO:tensorflow:train_accuracy = 0.5518868, train_loss = 18.821018 (0.930 sec)\n",
      "INFO:tensorflow:loss = 18.821018, step = 275 (0.930 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.816705\n",
      "INFO:tensorflow:train_accuracy = 0.5608108, train_loss = 18.70034 (1.225 sec)\n",
      "INFO:tensorflow:loss = 18.70034, step = 276 (1.225 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.850114\n",
      "INFO:tensorflow:train_accuracy = 0.5148148, train_loss = 26.307375 (1.176 sec)\n",
      "INFO:tensorflow:loss = 26.307375, step = 277 (1.176 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.840124\n",
      "INFO:tensorflow:train_accuracy = 0.52351487, train_loss = 27.406532 (1.191 sec)\n",
      "INFO:tensorflow:loss = 27.406532, step = 278 (1.191 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.696146\n",
      "INFO:tensorflow:train_accuracy = 0.5173267, train_loss = 26.719124 (1.436 sec)\n",
      "INFO:tensorflow:loss = 26.719124, step = 279 (1.435 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.845967\n",
      "INFO:tensorflow:train_accuracy = 0.5305343, train_loss = 22.10289 (1.183 sec)\n",
      "INFO:tensorflow:loss = 22.10289, step = 280 (1.183 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.957419\n",
      "INFO:tensorflow:train_accuracy = 0.56241614, train_loss = 19.98122 (1.045 sec)\n",
      "INFO:tensorflow:loss = 19.98122, step = 281 (1.045 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.897683\n",
      "INFO:tensorflow:train_accuracy = 0.53089535, train_loss = 23.737396 (1.113 sec)\n",
      "INFO:tensorflow:loss = 23.737396, step = 282 (1.113 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.907009\n",
      "INFO:tensorflow:train_accuracy = 0.56621623, train_loss = 19.064672 (1.103 sec)\n",
      "INFO:tensorflow:loss = 19.064672, step = 283 (1.103 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.870905\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "INFO:tensorflow:train_accuracy = 0.5492228, train_loss = 24.731598 (1.148 sec)\n",
      "INFO:tensorflow:loss = 24.731598, step = 284 (1.148 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.777151\n",
      "INFO:tensorflow:train_accuracy = 0.5364917, train_loss = 24.582338 (1.287 sec)\n",
      "INFO:tensorflow:loss = 24.582338, step = 285 (1.287 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.757252\n",
      "INFO:tensorflow:train_accuracy = 0.54927725, train_loss = 21.011074 (1.320 sec)\n",
      "INFO:tensorflow:loss = 21.011074, step = 286 (1.320 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.809694\n",
      "INFO:tensorflow:train_accuracy = 0.5539474, train_loss = 20.869366 (1.235 sec)\n",
      "INFO:tensorflow:loss = 20.869366, step = 287 (1.235 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.971107\n",
      "INFO:tensorflow:train_accuracy = 0.5407503, train_loss = 23.190262 (1.030 sec)\n",
      "INFO:tensorflow:loss = 23.190262, step = 288 (1.029 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.05308\n",
      "INFO:tensorflow:train_accuracy = 0.57045144, train_loss = 18.368118 (0.950 sec)\n",
      "INFO:tensorflow:loss = 18.368118, step = 289 (0.950 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.02102\n",
      "INFO:tensorflow:train_accuracy = 0.5468956, train_loss = 22.473122 (0.980 sec)\n",
      "INFO:tensorflow:loss = 22.473122, step = 290 (0.980 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.908891\n",
      "INFO:tensorflow:train_accuracy = 0.5374677, train_loss = 21.216248 (1.100 sec)\n",
      "INFO:tensorflow:loss = 21.216248, step = 291 (1.100 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.928437\n",
      "INFO:tensorflow:train_accuracy = 0.5432258, train_loss = 23.91987 (1.077 sec)\n",
      "INFO:tensorflow:loss = 23.91987, step = 292 (1.078 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.12775\n",
      "INFO:tensorflow:train_accuracy = 0.5374677, train_loss = 21.020699 (0.887 sec)\n",
      "INFO:tensorflow:loss = 21.020699, step = 293 (0.887 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.904564\n",
      "INFO:tensorflow:train_accuracy = 0.54616386, train_loss = 22.311214 (1.106 sec)\n",
      "INFO:tensorflow:loss = 22.311214, step = 294 (1.106 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.958794\n",
      "INFO:tensorflow:train_accuracy = 0.5551129, train_loss = 22.65136 (1.043 sec)\n",
      "INFO:tensorflow:loss = 22.65136, step = 295 (1.043 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.912384\n",
      "INFO:tensorflow:train_accuracy = 0.54172015, train_loss = 21.73719 (1.096 sec)\n",
      "INFO:tensorflow:loss = 21.73719, step = 296 (1.096 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.96519\n",
      "INFO:tensorflow:train_accuracy = 0.54428756, train_loss = 22.347355 (1.036 sec)\n",
      "INFO:tensorflow:loss = 22.347355, step = 297 (1.036 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.988091\n",
      "INFO:tensorflow:train_accuracy = 0.55172414, train_loss = 19.880877 (1.012 sec)\n",
      "INFO:tensorflow:loss = 19.880877, step = 298 (1.012 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.970752\n",
      "INFO:tensorflow:train_accuracy = 0.54356307, train_loss = 20.888916 (1.030 sec)\n",
      "INFO:tensorflow:loss = 20.888916, step = 299 (1.030 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.875122\n",
      "INFO:tensorflow:train_accuracy = 0.5485123, train_loss = 23.915915 (1.144 sec)\n",
      "INFO:tensorflow:loss = 23.915915, step = 300 (1.144 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.06556\n",
      "INFO:tensorflow:train_accuracy = 0.5721997, train_loss = 19.412182 (0.938 sec)\n",
      "INFO:tensorflow:loss = 19.412182, step = 301 (0.938 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.02956\n",
      "INFO:tensorflow:train_accuracy = 0.55932206, train_loss = 21.970675 (0.971 sec)\n",
      "INFO:tensorflow:loss = 21.970675, step = 302 (0.971 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.808115\n",
      "INFO:tensorflow:train_accuracy = 0.5199005, train_loss = 23.608397 (1.238 sec)\n",
      "INFO:tensorflow:loss = 23.608397, step = 303 (1.238 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.972121\n",
      "INFO:tensorflow:train_accuracy = 0.5198511, train_loss = 26.704819 (1.029 sec)\n",
      "INFO:tensorflow:loss = 26.704819, step = 304 (1.029 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.841402\n",
      "INFO:tensorflow:train_accuracy = 0.5414508, train_loss = 23.675594 (1.188 sec)\n",
      "INFO:tensorflow:loss = 23.675594, step = 305 (1.188 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.01313\n",
      "INFO:tensorflow:train_accuracy = 0.55496687, train_loss = 20.335518 (0.987 sec)\n",
      "INFO:tensorflow:loss = 20.335518, step = 306 (0.988 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.804585\n",
      "INFO:tensorflow:train_accuracy = 0.54296875, train_loss = 21.447847 (1.243 sec)\n",
      "INFO:tensorflow:loss = 21.447847, step = 307 (1.243 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.920375\n",
      "INFO:tensorflow:train_accuracy = 0.52896726, train_loss = 25.439445 (1.087 sec)\n",
      "INFO:tensorflow:loss = 25.439445, step = 308 (1.086 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.798251\n",
      "INFO:tensorflow:train_accuracy = 0.5204461, train_loss = 26.096874 (1.253 sec)\n",
      "INFO:tensorflow:loss = 26.096874, step = 309 (1.254 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.864177\n",
      "INFO:tensorflow:train_accuracy = 0.54415584, train_loss = 21.439857 (1.157 sec)\n",
      "INFO:tensorflow:loss = 21.439857, step = 310 (1.156 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.86836\n",
      "INFO:tensorflow:train_accuracy = 0.5185185, train_loss = 24.47482 (1.152 sec)\n",
      "INFO:tensorflow:loss = 24.47482, step = 311 (1.152 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.85922\n",
      "INFO:tensorflow:train_accuracy = 0.52552927, train_loss = 23.87935 (1.164 sec)\n",
      "INFO:tensorflow:loss = 23.87935, step = 312 (1.164 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.781273\n",
      "INFO:tensorflow:train_accuracy = 0.53097343, train_loss = 26.359612 (1.280 sec)\n",
      "INFO:tensorflow:loss = 26.359612, step = 313 (1.280 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.11182\n",
      "INFO:tensorflow:train_accuracy = 0.54215306, train_loss = 21.87818 (0.899 sec)\n",
      "INFO:tensorflow:loss = 21.87818, step = 314 (0.900 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.02397\n",
      "INFO:tensorflow:train_accuracy = 0.5419355, train_loss = 24.899187 (0.976 sec)\n",
      "INFO:tensorflow:loss = 24.899187, step = 315 (0.976 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.844601\n",
      "INFO:tensorflow:train_accuracy = 0.51724136, train_loss = 25.36948 (1.184 sec)\n",
      "INFO:tensorflow:loss = 25.36948, step = 316 (1.184 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.984852\n",
      "INFO:tensorflow:train_accuracy = 0.53113085, train_loss = 22.494595 (1.015 sec)\n",
      "INFO:tensorflow:loss = 22.494595, step = 317 (1.015 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.971694\n",
      "INFO:tensorflow:train_accuracy = 0.5508587, train_loss = 20.02788 (1.029 sec)\n",
      "INFO:tensorflow:loss = 20.02788, step = 318 (1.030 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.984885\n",
      "INFO:tensorflow:train_accuracy = 0.56393003, train_loss = 20.509514 (1.015 sec)\n",
      "INFO:tensorflow:loss = 20.509514, step = 319 (1.015 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.981176\n",
      "INFO:tensorflow:train_accuracy = 0.55452126, train_loss = 20.133648 (1.020 sec)\n",
      "INFO:tensorflow:loss = 20.133648, step = 320 (1.020 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.29836\n",
      "INFO:tensorflow:train_accuracy = 0.5625, train_loss = 16.755127 (0.770 sec)\n",
      "INFO:tensorflow:loss = 16.755127, step = 321 (0.769 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.86725\n",
      "INFO:tensorflow:train_accuracy = 0.5406452, train_loss = 22.416672 (1.153 sec)\n",
      "INFO:tensorflow:loss = 22.416672, step = 322 (1.153 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.90615\n",
      "INFO:tensorflow:train_accuracy = 0.54415584, train_loss = 21.16405 (1.104 sec)\n",
      "INFO:tensorflow:loss = 21.16405, step = 323 (1.105 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.698655\n",
      "INFO:tensorflow:train_accuracy = 0.512285, train_loss = 27.863426 (1.431 sec)\n",
      "INFO:tensorflow:loss = 27.863426, step = 324 (1.431 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.912254\n",
      "INFO:tensorflow:train_accuracy = 0.531995, train_loss = 23.020237 (1.096 sec)\n",
      "INFO:tensorflow:loss = 23.020237, step = 325 (1.096 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.984517\n",
      "INFO:tensorflow:train_accuracy = 0.53896105, train_loss = 21.654783 (1.016 sec)\n",
      "INFO:tensorflow:loss = 21.654783, step = 326 (1.015 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.859529\n",
      "INFO:tensorflow:train_accuracy = 0.53589743, train_loss = 21.341476 (1.163 sec)\n",
      "INFO:tensorflow:loss = 21.341476, step = 327 (1.164 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.83189\n",
      "INFO:tensorflow:train_accuracy = 0.54616386, train_loss = 24.029766 (1.202 sec)\n",
      "INFO:tensorflow:loss = 24.029766, step = 328 (1.202 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.03848\n",
      "INFO:tensorflow:train_accuracy = 0.53925353, train_loss = 24.231295 (0.963 sec)\n",
      "INFO:tensorflow:loss = 24.231295, step = 329 (0.964 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.983254\n",
      "INFO:tensorflow:train_accuracy = 0.5542328, train_loss = 19.544952 (1.017 sec)\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "INFO:tensorflow:loss = 19.544952, step = 330 (1.017 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.827115\n",
      "INFO:tensorflow:train_accuracy = 0.5462842, train_loss = 21.631424 (1.209 sec)\n",
      "INFO:tensorflow:loss = 21.631424, step = 331 (1.209 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.701301\n",
      "INFO:tensorflow:train_accuracy = 0.5519054, train_loss = 21.540054 (1.426 sec)\n",
      "INFO:tensorflow:loss = 21.540054, step = 332 (1.427 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.914202\n",
      "INFO:tensorflow:train_accuracy = 0.56644297, train_loss = 21.053091 (1.094 sec)\n",
      "INFO:tensorflow:loss = 21.053091, step = 333 (1.094 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.959979\n",
      "INFO:tensorflow:train_accuracy = 0.54474705, train_loss = 21.983696 (1.042 sec)\n",
      "INFO:tensorflow:loss = 21.983696, step = 334 (1.041 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.953352\n",
      "INFO:tensorflow:train_accuracy = 0.53806454, train_loss = 21.906889 (1.049 sec)\n",
      "INFO:tensorflow:loss = 21.906889, step = 335 (1.049 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.03813\n",
      "INFO:tensorflow:train_accuracy = 0.556, train_loss = 20.408596 (0.963 sec)\n",
      "INFO:tensorflow:loss = 20.408596, step = 336 (0.962 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.953656\n",
      "INFO:tensorflow:train_accuracy = 0.542044, train_loss = 22.808681 (1.049 sec)\n",
      "INFO:tensorflow:loss = 22.808681, step = 337 (1.049 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.962706\n",
      "INFO:tensorflow:train_accuracy = 0.5479632, train_loss = 21.733128 (1.039 sec)\n",
      "INFO:tensorflow:loss = 21.733128, step = 338 (1.039 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.944219\n",
      "INFO:tensorflow:train_accuracy = 0.55439055, train_loss = 20.95793 (1.059 sec)\n",
      "INFO:tensorflow:loss = 20.95793, step = 339 (1.060 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.950477\n",
      "INFO:tensorflow:train_accuracy = 0.5329949, train_loss = 24.14161 (1.053 sec)\n",
      "INFO:tensorflow:loss = 24.14161, step = 355 (1.053 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.08682\n",
      "INFO:tensorflow:train_accuracy = 0.5250627, train_loss = 21.41807 (0.920 sec)\n",
      "INFO:tensorflow:loss = 21.41807, step = 356 (0.920 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.852202\n",
      "INFO:tensorflow:train_accuracy = 0.5223325, train_loss = 24.030201 (1.174 sec)\n",
      "INFO:tensorflow:loss = 24.030201, step = 357 (1.174 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.957494\n",
      "INFO:tensorflow:train_accuracy = 0.5704607, train_loss = 19.24339 (1.044 sec)\n",
      "INFO:tensorflow:loss = 19.24339, step = 358 (1.044 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.911932\n",
      "INFO:tensorflow:train_accuracy = 0.5292653, train_loss = 24.88637 (1.097 sec)\n",
      "INFO:tensorflow:loss = 24.88637, step = 359 (1.097 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.935612\n",
      "INFO:tensorflow:train_accuracy = 0.53137004, train_loss = 21.638784 (1.069 sec)\n",
      "INFO:tensorflow:loss = 21.638784, step = 360 (1.069 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.932102\n",
      "INFO:tensorflow:train_accuracy = 0.5280199, train_loss = 25.672186 (1.073 sec)\n",
      "INFO:tensorflow:loss = 25.672186, step = 361 (1.073 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.892927\n",
      "INFO:tensorflow:train_accuracy = 0.5349428, train_loss = 22.82752 (1.120 sec)\n",
      "INFO:tensorflow:loss = 22.82752, step = 362 (1.120 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.0317\n",
      "INFO:tensorflow:train_accuracy = 0.57123655, train_loss = 19.439735 (0.969 sec)\n",
      "INFO:tensorflow:loss = 19.439735, step = 363 (0.969 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.961885\n",
      "INFO:tensorflow:train_accuracy = 0.5261194, train_loss = 22.961334 (1.040 sec)\n",
      "INFO:tensorflow:loss = 22.961334, step = 364 (1.039 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.974095\n",
      "INFO:tensorflow:train_accuracy = 0.5478375, train_loss = 18.71825 (1.027 sec)\n",
      "INFO:tensorflow:loss = 18.71825, step = 365 (1.027 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.922235\n",
      "INFO:tensorflow:train_accuracy = 0.562249, train_loss = 20.889511 (1.084 sec)\n",
      "INFO:tensorflow:loss = 20.889511, step = 366 (1.085 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.18554\n",
      "INFO:tensorflow:train_accuracy = 0.5619048, train_loss = 19.578957 (0.844 sec)\n",
      "INFO:tensorflow:loss = 19.578957, step = 367 (0.843 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.787346\n",
      "INFO:tensorflow:train_accuracy = 0.55078125, train_loss = 21.092987 (1.270 sec)\n",
      "INFO:tensorflow:loss = 21.092987, step = 368 (1.269 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.917524\n",
      "INFO:tensorflow:train_accuracy = 0.53188777, train_loss = 22.894691 (1.090 sec)\n",
      "INFO:tensorflow:loss = 22.894691, step = 369 (1.091 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.816659\n",
      "INFO:tensorflow:train_accuracy = 0.5306633, train_loss = 24.521381 (1.224 sec)\n",
      "INFO:tensorflow:loss = 24.521381, step = 370 (1.224 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.749661\n",
      "INFO:tensorflow:train_accuracy = 0.52896726, train_loss = 23.181566 (1.334 sec)\n",
      "INFO:tensorflow:loss = 23.181566, step = 371 (1.335 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.943888\n",
      "INFO:tensorflow:train_accuracy = 0.552356, train_loss = 23.054447 (1.060 sec)\n",
      "INFO:tensorflow:loss = 23.054447, step = 372 (1.060 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.851017\n",
      "INFO:tensorflow:train_accuracy = 0.5276382, train_loss = 24.446827 (1.175 sec)\n",
      "INFO:tensorflow:loss = 24.446827, step = 373 (1.175 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.933595\n",
      "INFO:tensorflow:train_accuracy = 0.5519054, train_loss = 20.99448 (1.071 sec)\n",
      "INFO:tensorflow:loss = 20.99448, step = 374 (1.070 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.85525\n",
      "INFO:tensorflow:train_accuracy = 0.53786904, train_loss = 21.36005 (1.169 sec)\n",
      "INFO:tensorflow:loss = 21.36005, step = 375 (1.170 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.798487\n",
      "INFO:tensorflow:train_accuracy = 0.5422627, train_loss = 19.33556 (1.252 sec)\n",
      "INFO:tensorflow:loss = 19.33556, step = 376 (1.253 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.754966\n",
      "INFO:tensorflow:train_accuracy = 0.55866665, train_loss = 20.025423 (1.325 sec)\n",
      "INFO:tensorflow:loss = 20.025423, step = 377 (1.324 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.04588\n",
      "INFO:tensorflow:train_accuracy = 0.55213904, train_loss = 21.327057 (0.956 sec)\n",
      "INFO:tensorflow:loss = 21.327057, step = 378 (0.956 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.07306\n",
      "INFO:tensorflow:train_accuracy = 0.55, train_loss = 21.035528 (0.932 sec)\n",
      "INFO:tensorflow:loss = 21.035528, step = 379 (0.932 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.854951\n",
      "INFO:tensorflow:train_accuracy = 0.5412371, train_loss = 23.100548 (1.170 sec)\n",
      "INFO:tensorflow:loss = 23.100548, step = 380 (1.169 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.952713\n",
      "INFO:tensorflow:train_accuracy = 0.5374677, train_loss = 21.42028 (1.050 sec)\n",
      "INFO:tensorflow:loss = 21.42028, step = 381 (1.050 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.853135\n",
      "INFO:tensorflow:train_accuracy = 0.5692935, train_loss = 17.7831 (1.172 sec)\n",
      "INFO:tensorflow:loss = 17.7831, step = 382 (1.172 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.979394\n",
      "INFO:tensorflow:train_accuracy = 0.52644837, train_loss = 22.738295 (1.021 sec)\n",
      "INFO:tensorflow:loss = 22.738295, step = 383 (1.022 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.897812\n",
      "INFO:tensorflow:train_accuracy = 0.53717947, train_loss = 23.180088 (1.114 sec)\n",
      "INFO:tensorflow:loss = 23.180088, step = 384 (1.114 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.898576\n",
      "INFO:tensorflow:train_accuracy = 0.54043645, train_loss = 20.565115 (1.113 sec)\n",
      "INFO:tensorflow:loss = 20.565115, step = 385 (1.113 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.05281\n",
      "INFO:tensorflow:train_accuracy = 0.56317204, train_loss = 18.020952 (0.950 sec)\n",
      "INFO:tensorflow:loss = 18.020952, step = 386 (0.950 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.927217\n",
      "INFO:tensorflow:train_accuracy = 0.56778526, train_loss = 20.233612 (1.078 sec)\n",
      "INFO:tensorflow:loss = 20.233612, step = 387 (1.078 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.807264\n",
      "INFO:tensorflow:train_accuracy = 0.5309406, train_loss = 23.20339 (1.239 sec)\n",
      "INFO:tensorflow:loss = 23.20339, step = 388 (1.239 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.956213\n",
      "INFO:tensorflow:train_accuracy = 0.55252916, train_loss = 23.531433 (1.046 sec)\n",
      "INFO:tensorflow:loss = 23.531433, step = 389 (1.046 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.886825\n",
      "INFO:tensorflow:train_accuracy = 0.5432258, train_loss = 20.151676 (1.128 sec)\n",
      "INFO:tensorflow:loss = 20.151676, step = 390 (1.127 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.94147\n",
      "INFO:tensorflow:train_accuracy = 0.56058586, train_loss = 18.960337 (1.062 sec)\n",
      "INFO:tensorflow:loss = 18.960337, step = 391 (1.062 sec)\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "INFO:tensorflow:global_step/sec: 0.949331\n",
      "INFO:tensorflow:train_accuracy = 0.56417114, train_loss = 19.343979 (1.053 sec)\n",
      "INFO:tensorflow:loss = 19.343979, step = 392 (1.054 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.04238\n",
      "INFO:tensorflow:train_accuracy = 0.54580647, train_loss = 19.592028 (0.959 sec)\n",
      "INFO:tensorflow:loss = 19.592028, step = 393 (0.959 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.979258\n",
      "INFO:tensorflow:train_accuracy = 0.55350065, train_loss = 19.196392 (1.021 sec)\n",
      "INFO:tensorflow:loss = 19.196392, step = 394 (1.021 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.848562\n",
      "INFO:tensorflow:train_accuracy = 0.53223765, train_loss = 23.171535 (1.178 sec)\n",
      "INFO:tensorflow:loss = 23.171535, step = 395 (1.178 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.05008\n",
      "INFO:tensorflow:train_accuracy = 0.5280899, train_loss = 24.217087 (0.953 sec)\n",
      "INFO:tensorflow:loss = 24.217087, step = 396 (0.953 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.970771\n",
      "INFO:tensorflow:train_accuracy = 0.54960835, train_loss = 20.545538 (1.030 sec)\n",
      "INFO:tensorflow:loss = 20.545538, step = 397 (1.030 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.788344\n",
      "INFO:tensorflow:train_accuracy = 0.52286774, train_loss = 24.91972 (1.268 sec)\n",
      "INFO:tensorflow:loss = 24.91972, step = 398 (1.268 sec)\n",
      "INFO:tensorflow:Saving checkpoints for 400 into asr-cnn-rnn/model.ckpt.\n",
      "INFO:tensorflow:Calling model_fn.\n",
      "INFO:tensorflow:Done calling model_fn.\n",
      "INFO:tensorflow:Starting evaluation at 2020-10-25T19:01:40Z\n",
      "INFO:tensorflow:Graph was finalized.\n",
      "INFO:tensorflow:Restoring parameters from asr-cnn-rnn/model.ckpt-400\n",
      "INFO:tensorflow:Running local_init_op.\n",
      "INFO:tensorflow:Done running local_init_op.\n",
      "INFO:tensorflow:Evaluation [1/10]\n",
      "INFO:tensorflow:Evaluation [2/10]\n",
      "INFO:tensorflow:Evaluation [3/10]\n",
      "INFO:tensorflow:Evaluation [4/10]\n",
      "INFO:tensorflow:Evaluation [5/10]\n",
      "INFO:tensorflow:Evaluation [6/10]\n",
      "INFO:tensorflow:Evaluation [7/10]\n",
      "INFO:tensorflow:Evaluation [8/10]\n",
      "INFO:tensorflow:Evaluation [9/10]\n",
      "INFO:tensorflow:Evaluation [10/10]\n",
      "INFO:tensorflow:Finished evaluation at 2020-10-25-19:01:46\n",
      "INFO:tensorflow:Saving dict for global step 400: WER = 0.67441857, accuracy = 0.57975465, global_step = 400, loss = 21.707127\n",
      "INFO:tensorflow:Saving 'checkpoint_path' summary for global step 400: asr-cnn-rnn/model.ckpt-400\n",
      "INFO:tensorflow:global_step/sec: 0.110909\n",
      "INFO:tensorflow:train_accuracy = 0.5446313, train_loss = 20.85844 (9.016 sec)\n",
      "INFO:tensorflow:loss = 20.85844, step = 399 (9.016 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.799802\n",
      "INFO:tensorflow:train_accuracy = 0.55321944, train_loss = 20.346497 (1.251 sec)\n",
      "INFO:tensorflow:loss = 20.346497, step = 400 (1.251 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.945197\n",
      "INFO:tensorflow:train_accuracy = 0.5374841, train_loss = 21.907822 (1.057 sec)\n",
      "INFO:tensorflow:loss = 21.907822, step = 401 (1.057 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.911395\n",
      "INFO:tensorflow:train_accuracy = 0.53074026, train_loss = 24.162552 (1.097 sec)\n",
      "INFO:tensorflow:loss = 24.162552, step = 402 (1.097 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.922875\n",
      "INFO:tensorflow:train_accuracy = 0.5134146, train_loss = 23.177826 (1.084 sec)\n",
      "INFO:tensorflow:loss = 23.177826, step = 403 (1.084 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.797262\n",
      "INFO:tensorflow:train_accuracy = 0.5437018, train_loss = 21.980309 (1.254 sec)\n",
      "INFO:tensorflow:loss = 21.980309, step = 404 (1.254 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.844255\n",
      "INFO:tensorflow:train_accuracy = 0.53717947, train_loss = 22.001204 (1.184 sec)\n",
      "INFO:tensorflow:loss = 22.001204, step = 405 (1.183 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.97677\n",
      "INFO:tensorflow:train_accuracy = 0.5653333, train_loss = 18.033657 (1.024 sec)\n",
      "INFO:tensorflow:loss = 18.033657, step = 406 (1.025 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.07935\n",
      "INFO:tensorflow:train_accuracy = 0.5456919, train_loss = 21.271156 (0.926 sec)\n",
      "INFO:tensorflow:loss = 21.271156, step = 407 (0.926 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.941835\n",
      "INFO:tensorflow:train_accuracy = 0.5584416, train_loss = 22.183327 (1.062 sec)\n",
      "INFO:tensorflow:loss = 22.183327, step = 408 (1.062 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.994499\n",
      "INFO:tensorflow:train_accuracy = 0.52184767, train_loss = 24.514826 (1.005 sec)\n",
      "INFO:tensorflow:loss = 24.514826, step = 409 (1.005 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.915519\n",
      "INFO:tensorflow:train_accuracy = 0.53846157, train_loss = 21.15416 (1.092 sec)\n",
      "INFO:tensorflow:loss = 21.15416, step = 410 (1.092 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.915117\n",
      "INFO:tensorflow:train_accuracy = 0.54592496, train_loss = 19.098572 (1.093 sec)\n",
      "INFO:tensorflow:loss = 19.098572, step = 411 (1.094 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.916286\n",
      "INFO:tensorflow:train_accuracy = 0.56568366, train_loss = 18.428642 (1.092 sec)\n",
      "INFO:tensorflow:loss = 18.428642, step = 412 (1.092 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.02874\n",
      "INFO:tensorflow:train_accuracy = 0.56666666, train_loss = 17.352728 (0.971 sec)\n",
      "INFO:tensorflow:loss = 17.352728, step = 413 (0.971 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.87487\n",
      "INFO:tensorflow:train_accuracy = 0.55878466, train_loss = 20.354605 (1.143 sec)\n",
      "INFO:tensorflow:loss = 20.354605, step = 414 (1.142 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.88883\n",
      "INFO:tensorflow:train_accuracy = 0.53670883, train_loss = 21.316994 (1.125 sec)\n",
      "INFO:tensorflow:loss = 21.316994, step = 415 (1.126 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.854695\n",
      "INFO:tensorflow:train_accuracy = 0.52552927, train_loss = 22.457378 (1.170 sec)\n",
      "INFO:tensorflow:loss = 22.457378, step = 416 (1.169 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.735018\n",
      "INFO:tensorflow:train_accuracy = 0.52281135, train_loss = 24.748507 (1.361 sec)\n",
      "INFO:tensorflow:loss = 24.748507, step = 417 (1.361 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.818576\n",
      "INFO:tensorflow:train_accuracy = 0.53562343, train_loss = 22.451126 (1.222 sec)\n",
      "INFO:tensorflow:loss = 22.451126, step = 418 (1.222 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.811375\n",
      "INFO:tensorflow:train_accuracy = 0.5542484, train_loss = 18.847067 (1.232 sec)\n",
      "INFO:tensorflow:loss = 18.847067, step = 419 (1.233 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.955492\n",
      "INFO:tensorflow:train_accuracy = 0.56233424, train_loss = 22.320648 (1.046 sec)\n",
      "INFO:tensorflow:loss = 22.320648, step = 420 (1.046 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.863412\n",
      "INFO:tensorflow:train_accuracy = 0.5426357, train_loss = 19.753225 (1.158 sec)\n",
      "INFO:tensorflow:loss = 19.753225, step = 421 (1.158 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.958626\n",
      "INFO:tensorflow:train_accuracy = 0.5605263, train_loss = 20.442593 (1.043 sec)\n",
      "INFO:tensorflow:loss = 20.442593, step = 422 (1.043 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.75108\n",
      "INFO:tensorflow:train_accuracy = 0.5679677, train_loss = 19.181158 (1.331 sec)\n",
      "INFO:tensorflow:loss = 19.181158, step = 423 (1.331 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.816781\n",
      "INFO:tensorflow:train_accuracy = 0.5472186, train_loss = 23.166363 (1.224 sec)\n",
      "INFO:tensorflow:loss = 23.166363, step = 424 (1.224 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.985862\n",
      "INFO:tensorflow:train_accuracy = 0.54993516, train_loss = 21.44196 (1.014 sec)\n",
      "INFO:tensorflow:loss = 21.44196, step = 425 (1.014 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.01308\n",
      "INFO:tensorflow:train_accuracy = 0.5478375, train_loss = 19.866888 (0.988 sec)\n",
      "INFO:tensorflow:loss = 19.866888, step = 426 (0.988 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.933134\n",
      "INFO:tensorflow:train_accuracy = 0.53016686, train_loss = 23.295128 (1.072 sec)\n",
      "INFO:tensorflow:loss = 23.295128, step = 427 (1.072 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.01264\n",
      "INFO:tensorflow:train_accuracy = 0.56948227, train_loss = 17.077673 (0.987 sec)\n",
      "INFO:tensorflow:loss = 17.077673, step = 428 (0.987 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.970195\n",
      "INFO:tensorflow:train_accuracy = 0.54640526, train_loss = 20.035572 (1.031 sec)\n",
      "INFO:tensorflow:loss = 20.035572, step = 429 (1.031 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.03781\n",
      "INFO:tensorflow:train_accuracy = 0.5411311, train_loss = 20.868244 (0.963 sec)\n",
      "INFO:tensorflow:loss = 20.868244, step = 430 (0.963 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.950091\n",
      "INFO:tensorflow:train_accuracy = 0.53580564, train_loss = 22.528671 (1.053 sec)\n",
      "INFO:tensorflow:loss = 22.528671, step = 431 (1.053 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.806015\n",
      "INFO:tensorflow:train_accuracy = 0.55439055, train_loss = 20.934052 (1.241 sec)\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "INFO:tensorflow:loss = 20.934052, step = 432 (1.242 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.90211\n",
      "INFO:tensorflow:train_accuracy = 0.5511811, train_loss = 19.777222 (1.108 sec)\n",
      "INFO:tensorflow:loss = 19.777222, step = 433 (1.107 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.832068\n",
      "INFO:tensorflow:train_accuracy = 0.55786735, train_loss = 21.749249 (1.202 sec)\n",
      "INFO:tensorflow:loss = 21.749249, step = 434 (1.202 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.939935\n",
      "INFO:tensorflow:train_accuracy = 0.5382685, train_loss = 23.928913 (1.064 sec)\n",
      "INFO:tensorflow:loss = 23.928913, step = 435 (1.064 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.10439\n",
      "INFO:tensorflow:train_accuracy = 0.55437666, train_loss = 19.564682 (0.906 sec)\n",
      "INFO:tensorflow:loss = 19.564682, step = 436 (0.906 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.912254\n",
      "INFO:tensorflow:train_accuracy = 0.5571808, train_loss = 18.112522 (1.096 sec)\n",
      "INFO:tensorflow:loss = 18.112522, step = 437 (1.096 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.900937\n",
      "INFO:tensorflow:train_accuracy = 0.5513158, train_loss = 19.543322 (1.110 sec)\n",
      "INFO:tensorflow:loss = 19.543322, step = 438 (1.109 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.946978\n",
      "INFO:tensorflow:train_accuracy = 0.55096775, train_loss = 21.199282 (1.057 sec)\n",
      "INFO:tensorflow:loss = 21.199282, step = 439 (1.057 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.819292\n",
      "INFO:tensorflow:train_accuracy = 0.55835545, train_loss = 19.838068 (1.220 sec)\n",
      "INFO:tensorflow:loss = 19.838068, step = 440 (1.219 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.784537\n",
      "INFO:tensorflow:train_accuracy = 0.5223325, train_loss = 24.3835 (1.275 sec)\n",
      "INFO:tensorflow:loss = 24.3835, step = 441 (1.276 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.06814\n",
      "INFO:tensorflow:train_accuracy = 0.52955973, train_loss = 22.832413 (0.936 sec)\n",
      "INFO:tensorflow:loss = 22.832413, step = 442 (0.936 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.11905\n",
      "INFO:tensorflow:train_accuracy = 0.546875, train_loss = 20.425705 (0.894 sec)\n",
      "INFO:tensorflow:loss = 20.425705, step = 443 (0.894 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.886233\n",
      "INFO:tensorflow:train_accuracy = 0.5492228, train_loss = 22.231886 (1.128 sec)\n",
      "INFO:tensorflow:loss = 22.231886, step = 444 (1.128 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.763356\n",
      "INFO:tensorflow:train_accuracy = 0.51970446, train_loss = 24.850727 (1.310 sec)\n",
      "INFO:tensorflow:loss = 24.850727, step = 445 (1.310 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.903973\n",
      "INFO:tensorflow:train_accuracy = 0.5369898, train_loss = 21.78059 (1.106 sec)\n",
      "INFO:tensorflow:loss = 21.78059, step = 446 (1.106 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.881296\n",
      "INFO:tensorflow:train_accuracy = 0.54592496, train_loss = 21.444735 (1.135 sec)\n",
      "INFO:tensorflow:loss = 21.444735, step = 447 (1.135 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.963393\n",
      "INFO:tensorflow:train_accuracy = 0.547588, train_loss = 19.045872 (1.038 sec)\n",
      "INFO:tensorflow:loss = 19.045872, step = 448 (1.038 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.750799\n",
      "INFO:tensorflow:train_accuracy = 0.51518834, train_loss = 24.695961 (1.332 sec)\n",
      "INFO:tensorflow:loss = 24.695961, step = 449 (1.331 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.02026\n",
      "INFO:tensorflow:train_accuracy = 0.54805195, train_loss = 20.22885 (0.980 sec)\n",
      "INFO:tensorflow:loss = 20.22885, step = 450 (0.980 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.886375\n",
      "INFO:tensorflow:train_accuracy = 0.5197531, train_loss = 22.785084 (1.129 sec)\n",
      "INFO:tensorflow:loss = 22.785084, step = 451 (1.129 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.970803\n",
      "INFO:tensorflow:train_accuracy = 0.54428756, train_loss = 21.90212 (1.030 sec)\n",
      "INFO:tensorflow:loss = 21.90212, step = 452 (1.030 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.906843\n",
      "INFO:tensorflow:train_accuracy = 0.5494223, train_loss = 21.834425 (1.103 sec)\n",
      "INFO:tensorflow:loss = 21.834425, step = 453 (1.103 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.0282\n",
      "INFO:tensorflow:train_accuracy = 0.5504587, train_loss = 21.639528 (0.973 sec)\n",
      "INFO:tensorflow:loss = 21.639528, step = 454 (0.973 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.865658\n",
      "INFO:tensorflow:train_accuracy = 0.52375, train_loss = 21.873764 (1.155 sec)\n",
      "INFO:tensorflow:loss = 21.873764, step = 455 (1.155 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.01947\n",
      "INFO:tensorflow:train_accuracy = 0.54278415, train_loss = 22.302555 (0.981 sec)\n",
      "INFO:tensorflow:loss = 22.302555, step = 456 (0.981 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.08154\n",
      "INFO:tensorflow:train_accuracy = 0.5649264, train_loss = 18.42836 (0.925 sec)\n",
      "INFO:tensorflow:loss = 18.42836, step = 457 (0.924 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.997068\n",
      "INFO:tensorflow:train_accuracy = 0.5683646, train_loss = 18.61939 (1.003 sec)\n",
      "INFO:tensorflow:loss = 18.61939, step = 458 (1.004 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.32034\n",
      "INFO:tensorflow:train_accuracy = 0.57281554, train_loss = 12.814457 (0.757 sec)\n",
      "INFO:tensorflow:loss = 12.814457, step = 459 (0.757 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.891619\n",
      "INFO:tensorflow:train_accuracy = 0.5542484, train_loss = 20.51696 (1.122 sec)\n",
      "INFO:tensorflow:loss = 20.51696, step = 460 (1.122 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.852949\n",
      "INFO:tensorflow:train_accuracy = 0.54129606, train_loss = 20.990128 (1.172 sec)\n",
      "INFO:tensorflow:loss = 20.990128, step = 461 (1.172 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.784681\n",
      "INFO:tensorflow:train_accuracy = 0.5121359, train_loss = 24.133522 (1.274 sec)\n",
      "INFO:tensorflow:loss = 24.133522, step = 462 (1.274 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.920858\n",
      "INFO:tensorflow:train_accuracy = 0.53467846, train_loss = 23.425325 (1.086 sec)\n",
      "INFO:tensorflow:loss = 23.425325, step = 463 (1.086 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.948365\n",
      "INFO:tensorflow:train_accuracy = 0.54311454, train_loss = 21.367403 (1.055 sec)\n",
      "INFO:tensorflow:loss = 21.367403, step = 464 (1.055 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.871245\n",
      "INFO:tensorflow:train_accuracy = 0.54557127, train_loss = 20.331112 (1.148 sec)\n",
      "INFO:tensorflow:loss = 20.331112, step = 465 (1.147 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.01365\n",
      "INFO:tensorflow:train_accuracy = 0.5595238, train_loss = 17.65337 (0.987 sec)\n",
      "INFO:tensorflow:loss = 17.65337, step = 466 (0.987 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.875745\n",
      "INFO:tensorflow:train_accuracy = 0.5616798, train_loss = 20.600542 (1.142 sec)\n",
      "INFO:tensorflow:loss = 20.600542, step = 467 (1.142 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.875387\n",
      "INFO:tensorflow:train_accuracy = 0.53670883, train_loss = 20.98552 (1.143 sec)\n",
      "INFO:tensorflow:loss = 20.98552, step = 468 (1.143 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.753642\n",
      "INFO:tensorflow:train_accuracy = 0.5702703, train_loss = 18.775341 (1.327 sec)\n",
      "INFO:tensorflow:loss = 18.775341, step = 469 (1.327 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.03673\n",
      "INFO:tensorflow:train_accuracy = 0.5776567, train_loss = 17.973082 (0.965 sec)\n",
      "INFO:tensorflow:loss = 17.973082, step = 470 (0.965 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.975477\n",
      "INFO:tensorflow:train_accuracy = 0.5460441, train_loss = 21.1862 (1.025 sec)\n",
      "INFO:tensorflow:loss = 21.1862, step = 471 (1.025 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.00166\n",
      "INFO:tensorflow:train_accuracy = 0.53148615, train_loss = 22.388926 (0.998 sec)\n",
      "INFO:tensorflow:loss = 22.388926, step = 472 (0.998 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.00913\n",
      "INFO:tensorflow:train_accuracy = 0.55851066, train_loss = 18.218706 (0.991 sec)\n",
      "INFO:tensorflow:loss = 18.218706, step = 473 (0.991 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.00042\n",
      "INFO:tensorflow:train_accuracy = 0.55947715, train_loss = 21.438293 (1.000 sec)\n",
      "INFO:tensorflow:loss = 21.438293, step = 474 (1.000 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.89783\n",
      "INFO:tensorflow:train_accuracy = 0.5708447, train_loss = 16.2818 (1.114 sec)\n",
      "INFO:tensorflow:loss = 16.2818, step = 475 (1.115 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.709475\n",
      "INFO:tensorflow:train_accuracy = 0.535533, train_loss = 23.776289 (1.409 sec)\n",
      "INFO:tensorflow:loss = 23.776289, step = 476 (1.410 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.860417\n",
      "INFO:tensorflow:train_accuracy = 0.5648148, train_loss = 18.88753 (1.162 sec)\n",
      "INFO:tensorflow:loss = 18.88753, step = 477 (1.162 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.01928\n",
      "INFO:tensorflow:train_accuracy = 0.530303, train_loss = 20.834866 (0.981 sec)\n",
      "INFO:tensorflow:loss = 20.834866, step = 478 (0.981 sec)\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "INFO:tensorflow:global_step/sec: 1.08596\n",
      "INFO:tensorflow:train_accuracy = 0.5670241, train_loss = 18.580866 (0.921 sec)\n",
      "INFO:tensorflow:loss = 18.580866, step = 479 (0.920 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.867496\n",
      "INFO:tensorflow:train_accuracy = 0.5303593, train_loss = 24.581755 (1.153 sec)\n",
      "INFO:tensorflow:loss = 24.581755, step = 480 (1.152 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.982355\n",
      "INFO:tensorflow:train_accuracy = 0.54805195, train_loss = 20.31567 (1.018 sec)\n",
      "INFO:tensorflow:loss = 20.31567, step = 481 (1.018 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.07284\n",
      "INFO:tensorflow:train_accuracy = 0.5492228, train_loss = 18.865433 (0.932 sec)\n",
      "INFO:tensorflow:loss = 18.865433, step = 482 (0.933 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.96108\n",
      "INFO:tensorflow:train_accuracy = 0.563081, train_loss = 18.612343 (1.040 sec)\n",
      "INFO:tensorflow:loss = 18.612343, step = 483 (1.040 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.965941\n",
      "INFO:tensorflow:train_accuracy = 0.5582011, train_loss = 18.702301 (1.035 sec)\n",
      "INFO:tensorflow:loss = 18.702301, step = 484 (1.035 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.969507\n",
      "INFO:tensorflow:train_accuracy = 0.56914896, train_loss = 18.630627 (1.032 sec)\n",
      "INFO:tensorflow:loss = 18.630627, step = 485 (1.032 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.879992\n",
      "INFO:tensorflow:train_accuracy = 0.5372005, train_loss = 22.213392 (1.136 sec)\n",
      "INFO:tensorflow:loss = 22.213392, step = 486 (1.136 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.965858\n",
      "INFO:tensorflow:train_accuracy = 0.56233424, train_loss = 18.95282 (1.035 sec)\n",
      "INFO:tensorflow:loss = 18.95282, step = 487 (1.036 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.801082\n",
      "INFO:tensorflow:train_accuracy = 0.535533, train_loss = 23.310337 (1.248 sec)\n",
      "INFO:tensorflow:loss = 23.310337, step = 488 (1.248 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.01015\n",
      "INFO:tensorflow:train_accuracy = 0.52428395, train_loss = 21.117958 (0.990 sec)\n",
      "INFO:tensorflow:loss = 21.117958, step = 489 (0.990 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.06824\n",
      "INFO:tensorflow:train_accuracy = 0.5316456, train_loss = 22.495945 (0.936 sec)\n",
      "INFO:tensorflow:loss = 22.495945, step = 490 (0.935 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.82372\n",
      "INFO:tensorflow:train_accuracy = 0.56084657, train_loss = 19.251696 (1.214 sec)\n",
      "INFO:tensorflow:loss = 19.251696, step = 491 (1.214 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.74702\n",
      "INFO:tensorflow:train_accuracy = 0.52428395, train_loss = 22.67177 (1.338 sec)\n",
      "INFO:tensorflow:loss = 22.67177, step = 492 (1.338 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.915885\n",
      "INFO:tensorflow:train_accuracy = 0.5438144, train_loss = 19.99894 (1.092 sec)\n",
      "INFO:tensorflow:loss = 19.99894, step = 493 (1.092 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.949287\n",
      "INFO:tensorflow:train_accuracy = 0.5382653, train_loss = 22.994938 (1.054 sec)\n",
      "INFO:tensorflow:loss = 22.994938, step = 494 (1.054 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.786849\n",
      "INFO:tensorflow:train_accuracy = 0.5090253, train_loss = 23.447744 (1.271 sec)\n",
      "INFO:tensorflow:loss = 23.447744, step = 495 (1.270 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.985822\n",
      "INFO:tensorflow:train_accuracy = 0.5554107, train_loss = 19.079811 (1.015 sec)\n",
      "INFO:tensorflow:loss = 19.079811, step = 496 (1.015 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.804669\n",
      "INFO:tensorflow:train_accuracy = 0.53589743, train_loss = 21.696869 (1.243 sec)\n",
      "INFO:tensorflow:loss = 21.696869, step = 497 (1.243 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.844467\n",
      "INFO:tensorflow:train_accuracy = 0.55291003, train_loss = 20.667015 (1.185 sec)\n",
      "INFO:tensorflow:loss = 20.667015, step = 498 (1.185 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.900251\n",
      "INFO:tensorflow:train_accuracy = 0.5186104, train_loss = 21.768147 (1.110 sec)\n",
      "INFO:tensorflow:loss = 21.768147, step = 499 (1.110 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.01228\n",
      "INFO:tensorflow:train_accuracy = 0.5359897, train_loss = 20.176956 (0.989 sec)\n",
      "INFO:tensorflow:loss = 20.176956, step = 500 (0.989 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.890244\n",
      "INFO:tensorflow:train_accuracy = 0.5536649, train_loss = 18.957321 (1.122 sec)\n",
      "INFO:tensorflow:loss = 18.957321, step = 501 (1.122 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.912777\n",
      "INFO:tensorflow:train_accuracy = 0.527027, train_loss = 21.236942 (1.096 sec)\n",
      "INFO:tensorflow:loss = 21.236942, step = 502 (1.096 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.00146\n",
      "INFO:tensorflow:train_accuracy = 0.56417114, train_loss = 19.66152 (0.999 sec)\n",
      "INFO:tensorflow:loss = 19.66152, step = 503 (0.999 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.956548\n",
      "INFO:tensorflow:train_accuracy = 0.57277626, train_loss = 16.377853 (1.045 sec)\n",
      "INFO:tensorflow:loss = 16.377853, step = 504 (1.045 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.17101\n",
      "INFO:tensorflow:train_accuracy = 0.5645933, train_loss = 16.917395 (0.854 sec)\n",
      "INFO:tensorflow:loss = 16.917395, step = 505 (0.853 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.862436\n",
      "INFO:tensorflow:train_accuracy = 0.54697555, train_loss = 20.218601 (1.160 sec)\n",
      "INFO:tensorflow:loss = 20.218601, step = 506 (1.160 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.807782\n",
      "INFO:tensorflow:train_accuracy = 0.510665, train_loss = 24.252985 (1.239 sec)\n",
      "INFO:tensorflow:loss = 24.252985, step = 507 (1.238 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.915465\n",
      "INFO:tensorflow:train_accuracy = 0.52351487, train_loss = 22.414537 (1.092 sec)\n",
      "INFO:tensorflow:loss = 22.414537, step = 508 (1.092 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.853703\n",
      "INFO:tensorflow:train_accuracy = 0.52131546, train_loss = 23.82044 (1.172 sec)\n",
      "INFO:tensorflow:loss = 23.82044, step = 509 (1.172 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.954746\n",
      "INFO:tensorflow:train_accuracy = 0.5531915, train_loss = 17.542488 (1.047 sec)\n",
      "INFO:tensorflow:loss = 17.542488, step = 510 (1.047 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.85389\n",
      "INFO:tensorflow:train_accuracy = 0.5674967, train_loss = 21.073446 (1.171 sec)\n",
      "INFO:tensorflow:loss = 21.073446, step = 511 (1.171 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.869487\n",
      "INFO:tensorflow:train_accuracy = 0.56648934, train_loss = 19.059612 (1.150 sec)\n",
      "INFO:tensorflow:loss = 19.059612, step = 512 (1.150 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.986509\n",
      "INFO:tensorflow:train_accuracy = 0.5558441, train_loss = 19.461136 (1.014 sec)\n",
      "INFO:tensorflow:loss = 19.461136, step = 513 (1.014 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.722448\n",
      "INFO:tensorflow:train_accuracy = 0.55307996, train_loss = 20.440964 (1.384 sec)\n",
      "INFO:tensorflow:loss = 20.440964, step = 514 (1.384 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.953372\n",
      "INFO:tensorflow:train_accuracy = 0.5653897, train_loss = 18.780025 (1.049 sec)\n",
      "INFO:tensorflow:loss = 18.780025, step = 515 (1.050 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.948241\n",
      "INFO:tensorflow:train_accuracy = 0.5584757, train_loss = 18.94537 (1.054 sec)\n",
      "INFO:tensorflow:loss = 18.94537, step = 516 (1.054 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.777201\n",
      "INFO:tensorflow:train_accuracy = 0.54592496, train_loss = 20.292606 (1.287 sec)\n",
      "INFO:tensorflow:loss = 20.292606, step = 517 (1.287 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.99921\n",
      "INFO:tensorflow:train_accuracy = 0.54664916, train_loss = 18.988884 (1.001 sec)\n",
      "INFO:tensorflow:loss = 18.988884, step = 518 (1.000 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.925525\n",
      "INFO:tensorflow:train_accuracy = 0.5557029, train_loss = 18.519539 (1.080 sec)\n",
      "INFO:tensorflow:loss = 18.519539, step = 519 (1.081 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.987688\n",
      "INFO:tensorflow:train_accuracy = 0.55835545, train_loss = 18.6232 (1.013 sec)\n",
      "INFO:tensorflow:loss = 18.6232, step = 520 (1.013 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.92437\n",
      "INFO:tensorflow:train_accuracy = 0.52955973, train_loss = 21.901657 (1.082 sec)\n",
      "INFO:tensorflow:loss = 21.901657, step = 521 (1.082 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.963713\n",
      "INFO:tensorflow:train_accuracy = 0.54967743, train_loss = 20.26936 (1.038 sec)\n",
      "INFO:tensorflow:loss = 20.26936, step = 522 (1.038 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.10472\n",
      "INFO:tensorflow:train_accuracy = 0.56094366, train_loss = 18.12309 (0.905 sec)\n",
      "INFO:tensorflow:loss = 18.12309, step = 523 (0.905 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.735218\n",
      "INFO:tensorflow:train_accuracy = 0.5720054, train_loss = 16.657827 (1.361 sec)\n",
      "INFO:tensorflow:loss = 16.657827, step = 524 (1.361 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.01228\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "INFO:tensorflow:train_accuracy = 0.5400788, train_loss = 20.940693 (0.988 sec)\n",
      "INFO:tensorflow:loss = 20.940693, step = 525 (0.987 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.870935\n",
      "INFO:tensorflow:train_accuracy = 0.5335019, train_loss = 20.142082 (1.148 sec)\n",
      "INFO:tensorflow:loss = 20.142082, step = 526 (1.147 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.916974\n",
      "INFO:tensorflow:train_accuracy = 0.55921054, train_loss = 18.16558 (1.091 sec)\n",
      "INFO:tensorflow:loss = 18.16558, step = 527 (1.091 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.05128\n",
      "INFO:tensorflow:train_accuracy = 0.5329114, train_loss = 22.61922 (0.951 sec)\n",
      "INFO:tensorflow:loss = 22.61922, step = 528 (0.951 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.945248\n",
      "INFO:tensorflow:train_accuracy = 0.5597898, train_loss = 18.572323 (1.058 sec)\n",
      "INFO:tensorflow:loss = 18.572323, step = 529 (1.058 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.979782\n",
      "INFO:tensorflow:train_accuracy = 0.55947715, train_loss = 18.434399 (1.020 sec)\n",
      "INFO:tensorflow:loss = 18.434399, step = 530 (1.020 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.862121\n",
      "INFO:tensorflow:train_accuracy = 0.56692916, train_loss = 17.931408 (1.160 sec)\n",
      "INFO:tensorflow:loss = 17.931408, step = 531 (1.160 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.882514\n",
      "INFO:tensorflow:train_accuracy = 0.52911395, train_loss = 20.769756 (1.133 sec)\n",
      "INFO:tensorflow:loss = 20.769756, step = 532 (1.133 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.859322\n",
      "INFO:tensorflow:train_accuracy = 0.5674603, train_loss = 19.377232 (1.164 sec)\n",
      "INFO:tensorflow:loss = 19.377232, step = 533 (1.165 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.03951\n",
      "INFO:tensorflow:train_accuracy = 0.54909563, train_loss = 18.292898 (0.962 sec)\n",
      "INFO:tensorflow:loss = 18.292898, step = 534 (0.962 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.05241\n",
      "INFO:tensorflow:train_accuracy = 0.53643215, train_loss = 21.760502 (0.950 sec)\n",
      "INFO:tensorflow:loss = 21.760502, step = 535 (0.950 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.789227\n",
      "INFO:tensorflow:train_accuracy = 0.54215306, train_loss = 20.89975 (1.267 sec)\n",
      "INFO:tensorflow:loss = 20.89975, step = 536 (1.267 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.812774\n",
      "INFO:tensorflow:train_accuracy = 0.5473411, train_loss = 20.03762 (1.230 sec)\n",
      "INFO:tensorflow:loss = 20.03762, step = 537 (1.229 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.81696\n",
      "INFO:tensorflow:train_accuracy = 0.535, train_loss = 22.60314 (1.225 sec)\n",
      "INFO:tensorflow:loss = 22.60314, step = 538 (1.225 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.86579\n",
      "INFO:tensorflow:train_accuracy = 0.5202454, train_loss = 23.36895 (1.155 sec)\n",
      "INFO:tensorflow:loss = 23.36895, step = 539 (1.155 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.913919\n",
      "INFO:tensorflow:train_accuracy = 0.54993516, train_loss = 17.489515 (1.094 sec)\n",
      "INFO:tensorflow:loss = 17.489515, step = 540 (1.095 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.01247\n",
      "INFO:tensorflow:train_accuracy = 0.54417413, train_loss = 21.09507 (0.987 sec)\n",
      "INFO:tensorflow:loss = 21.09507, step = 541 (0.987 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.799746\n",
      "INFO:tensorflow:train_accuracy = 0.51325303, train_loss = 23.604588 (1.251 sec)\n",
      "INFO:tensorflow:loss = 23.604588, step = 542 (1.251 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.876001\n",
      "INFO:tensorflow:train_accuracy = 0.53836477, train_loss = 21.500107 (1.141 sec)\n",
      "INFO:tensorflow:loss = 21.500107, step = 543 (1.142 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.03096\n",
      "INFO:tensorflow:train_accuracy = 0.5740988, train_loss = 18.128094 (0.970 sec)\n",
      "INFO:tensorflow:loss = 18.128094, step = 544 (0.969 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.964678\n",
      "INFO:tensorflow:train_accuracy = 0.5721925, train_loss = 18.02713 (1.037 sec)\n",
      "INFO:tensorflow:loss = 18.02713, step = 545 (1.037 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.869685\n",
      "INFO:tensorflow:train_accuracy = 0.5329949, train_loss = 20.509037 (1.150 sec)\n",
      "INFO:tensorflow:loss = 20.509037, step = 546 (1.150 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.977285\n",
      "INFO:tensorflow:train_accuracy = 0.54311454, train_loss = 21.756752 (1.023 sec)\n",
      "INFO:tensorflow:loss = 21.756752, step = 547 (1.023 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.02615\n",
      "INFO:tensorflow:train_accuracy = 0.5440613, train_loss = 18.115208 (0.974 sec)\n",
      "INFO:tensorflow:loss = 18.115208, step = 548 (0.974 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.990072\n",
      "INFO:tensorflow:train_accuracy = 0.5672043, train_loss = 15.866932 (1.010 sec)\n",
      "INFO:tensorflow:loss = 15.866932, step = 549 (1.011 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.974821\n",
      "INFO:tensorflow:train_accuracy = 0.5683356, train_loss = 18.56115 (1.026 sec)\n",
      "INFO:tensorflow:loss = 18.56115, step = 550 (1.026 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.832564\n",
      "INFO:tensorflow:train_accuracy = 0.476, train_loss = 24.505604 (1.201 sec)\n",
      "INFO:tensorflow:loss = 24.505604, step = 551 (1.200 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.870745\n",
      "INFO:tensorflow:train_accuracy = 0.5462725, train_loss = 18.977558 (1.149 sec)\n",
      "INFO:tensorflow:loss = 18.977558, step = 552 (1.149 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.735954\n",
      "INFO:tensorflow:train_accuracy = 0.53148615, train_loss = 23.100214 (1.359 sec)\n",
      "INFO:tensorflow:loss = 23.100214, step = 553 (1.358 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.918817\n",
      "INFO:tensorflow:train_accuracy = 0.53207546, train_loss = 20.80006 (1.088 sec)\n",
      "INFO:tensorflow:loss = 20.80006, step = 554 (1.088 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.00642\n",
      "INFO:tensorflow:train_accuracy = 0.52546585, train_loss = 21.987797 (0.994 sec)\n",
      "INFO:tensorflow:loss = 21.987797, step = 555 (0.995 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.896156\n",
      "INFO:tensorflow:train_accuracy = 0.54209185, train_loss = 18.51304 (1.116 sec)\n",
      "INFO:tensorflow:loss = 18.51304, step = 556 (1.116 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.856057\n",
      "INFO:tensorflow:train_accuracy = 0.55741936, train_loss = 20.961971 (1.168 sec)\n",
      "INFO:tensorflow:loss = 20.961971, step = 557 (1.169 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.856107\n",
      "INFO:tensorflow:train_accuracy = 0.5561358, train_loss = 18.791094 (1.168 sec)\n",
      "INFO:tensorflow:loss = 18.791094, step = 558 (1.168 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.959265\n",
      "INFO:tensorflow:train_accuracy = 0.56241786, train_loss = 17.74561 (1.042 sec)\n",
      "INFO:tensorflow:loss = 17.74561, step = 559 (1.042 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.863828\n",
      "INFO:tensorflow:train_accuracy = 0.57293034, train_loss = 19.84116 (1.157 sec)\n",
      "INFO:tensorflow:loss = 19.84116, step = 560 (1.157 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.758336\n",
      "INFO:tensorflow:train_accuracy = 0.55733335, train_loss = 17.962208 (1.319 sec)\n",
      "INFO:tensorflow:loss = 17.962208, step = 561 (1.319 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.905801\n",
      "INFO:tensorflow:train_accuracy = 0.5642384, train_loss = 18.395733 (1.104 sec)\n",
      "INFO:tensorflow:loss = 18.395733, step = 562 (1.104 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.00289\n",
      "INFO:tensorflow:train_accuracy = 0.5539474, train_loss = 17.805832 (0.997 sec)\n",
      "INFO:tensorflow:loss = 17.805832, step = 563 (0.997 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.820362\n",
      "INFO:tensorflow:train_accuracy = 0.53796655, train_loss = 17.88184 (1.219 sec)\n",
      "INFO:tensorflow:loss = 17.88184, step = 564 (1.219 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.934073\n",
      "INFO:tensorflow:train_accuracy = 0.5607477, train_loss = 16.651539 (1.070 sec)\n",
      "INFO:tensorflow:loss = 16.651539, step = 565 (1.070 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.950625\n",
      "INFO:tensorflow:train_accuracy = 0.564409, train_loss = 17.761063 (1.052 sec)\n",
      "INFO:tensorflow:loss = 17.761063, step = 566 (1.052 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.911532\n",
      "INFO:tensorflow:train_accuracy = 0.53485423, train_loss = 22.040173 (1.097 sec)\n",
      "INFO:tensorflow:loss = 22.040173, step = 567 (1.097 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.07958\n",
      "INFO:tensorflow:train_accuracy = 0.53205127, train_loss = 19.335882 (0.927 sec)\n",
      "INFO:tensorflow:loss = 19.335882, step = 568 (0.927 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.02187\n",
      "INFO:tensorflow:train_accuracy = 0.5407125, train_loss = 18.921654 (0.978 sec)\n",
      "INFO:tensorflow:loss = 18.921654, step = 569 (0.978 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.889058\n",
      "INFO:tensorflow:train_accuracy = 0.5723861, train_loss = 16.684002 (1.125 sec)\n",
      "INFO:tensorflow:loss = 16.684002, step = 570 (1.125 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.974356\n",
      "INFO:tensorflow:train_accuracy = 0.55526656, train_loss = 19.415407 (1.026 sec)\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "INFO:tensorflow:loss = 19.415407, step = 571 (1.027 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.986269\n",
      "INFO:tensorflow:train_accuracy = 0.5590551, train_loss = 19.896778 (1.014 sec)\n",
      "INFO:tensorflow:loss = 19.896778, step = 572 (1.014 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.788707\n",
      "INFO:tensorflow:train_accuracy = 0.55266577, train_loss = 19.099798 (1.268 sec)\n",
      "INFO:tensorflow:loss = 19.099798, step = 573 (1.268 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.883411\n",
      "INFO:tensorflow:train_accuracy = 0.55083656, train_loss = 17.99989 (1.132 sec)\n",
      "INFO:tensorflow:loss = 17.99989, step = 574 (1.132 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.860167\n",
      "INFO:tensorflow:train_accuracy = 0.54792744, train_loss = 18.70187 (1.163 sec)\n",
      "INFO:tensorflow:loss = 18.70187, step = 575 (1.162 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.998844\n",
      "INFO:tensorflow:train_accuracy = 0.56989247, train_loss = 17.154205 (1.001 sec)\n",
      "INFO:tensorflow:loss = 17.154205, step = 576 (1.000 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.03792\n",
      "INFO:tensorflow:train_accuracy = 0.54545456, train_loss = 18.90321 (0.963 sec)\n",
      "INFO:tensorflow:loss = 18.90321, step = 577 (0.963 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.00569\n",
      "INFO:tensorflow:train_accuracy = 0.55239326, train_loss = 18.194157 (0.995 sec)\n",
      "INFO:tensorflow:loss = 18.194157, step = 578 (0.995 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.85954\n",
      "INFO:tensorflow:train_accuracy = 0.5693333, train_loss = 18.220495 (1.163 sec)\n",
      "INFO:tensorflow:loss = 18.220495, step = 579 (1.163 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.835083\n",
      "INFO:tensorflow:train_accuracy = 0.5220049, train_loss = 21.352924 (1.198 sec)\n",
      "INFO:tensorflow:loss = 21.352924, step = 580 (1.198 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.07803\n",
      "INFO:tensorflow:train_accuracy = 0.5529412, train_loss = 15.760127 (0.927 sec)\n",
      "INFO:tensorflow:loss = 15.760127, step = 581 (0.926 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.05027\n",
      "INFO:tensorflow:train_accuracy = 0.54428756, train_loss = 21.775803 (0.953 sec)\n",
      "INFO:tensorflow:loss = 21.775803, step = 582 (0.953 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.798062\n",
      "INFO:tensorflow:train_accuracy = 0.54383737, train_loss = 21.52792 (1.253 sec)\n",
      "INFO:tensorflow:loss = 21.52792, step = 583 (1.254 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.919704\n",
      "INFO:tensorflow:train_accuracy = 0.54592496, train_loss = 18.679642 (1.087 sec)\n",
      "INFO:tensorflow:loss = 18.679642, step = 584 (1.087 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.917808\n",
      "INFO:tensorflow:train_accuracy = 0.5303593, train_loss = 19.830658 (1.090 sec)\n",
      "INFO:tensorflow:loss = 19.830658, step = 585 (1.090 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.997176\n",
      "INFO:tensorflow:train_accuracy = 0.55064934, train_loss = 18.6427 (1.003 sec)\n",
      "INFO:tensorflow:loss = 18.6427, step = 586 (1.003 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.919633\n",
      "INFO:tensorflow:train_accuracy = 0.5290482, train_loss = 22.291515 (1.087 sec)\n",
      "INFO:tensorflow:loss = 22.291515, step = 587 (1.087 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.802492\n",
      "INFO:tensorflow:train_accuracy = 0.5420326, train_loss = 20.177296 (1.246 sec)\n",
      "INFO:tensorflow:loss = 20.177296, step = 588 (1.247 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.871572\n",
      "INFO:tensorflow:train_accuracy = 0.55859375, train_loss = 17.559814 (1.147 sec)\n",
      "INFO:tensorflow:loss = 17.559814, step = 589 (1.147 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.992886\n",
      "INFO:tensorflow:train_accuracy = 0.5518135, train_loss = 17.914375 (1.007 sec)\n",
      "INFO:tensorflow:loss = 17.914375, step = 590 (1.007 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.08041\n",
      "INFO:tensorflow:train_accuracy = 0.5582011, train_loss = 18.008514 (0.926 sec)\n",
      "INFO:tensorflow:loss = 18.008514, step = 591 (0.926 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.935254\n",
      "INFO:tensorflow:train_accuracy = 0.52747256, train_loss = 23.936634 (1.069 sec)\n",
      "INFO:tensorflow:loss = 23.936634, step = 592 (1.069 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.917044\n",
      "INFO:tensorflow:train_accuracy = 0.54533845, train_loss = 20.937185 (1.090 sec)\n",
      "INFO:tensorflow:loss = 20.937185, step = 593 (1.091 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.951661\n",
      "INFO:tensorflow:train_accuracy = 0.5375796, train_loss = 18.176205 (1.051 sec)\n",
      "INFO:tensorflow:loss = 18.176205, step = 594 (1.051 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.03992\n",
      "INFO:tensorflow:train_accuracy = 0.5775401, train_loss = 18.547943 (0.962 sec)\n",
      "INFO:tensorflow:loss = 18.547943, step = 595 (0.962 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.0231\n",
      "INFO:tensorflow:train_accuracy = 0.56133336, train_loss = 15.725307 (0.977 sec)\n",
      "INFO:tensorflow:loss = 15.725307, step = 596 (0.977 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.12625\n",
      "INFO:tensorflow:train_accuracy = 0.5857143, train_loss = 14.219656 (0.888 sec)\n",
      "INFO:tensorflow:loss = 14.219656, step = 597 (0.888 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.928872\n",
      "INFO:tensorflow:train_accuracy = 0.53223765, train_loss = 19.626621 (1.077 sec)\n",
      "INFO:tensorflow:loss = 19.626621, step = 598 (1.076 sec)\n",
      "INFO:tensorflow:Saving checkpoints for 600 into asr-cnn-rnn/model.ckpt.\n",
      "INFO:tensorflow:Calling model_fn.\n",
      "INFO:tensorflow:Done calling model_fn.\n",
      "INFO:tensorflow:Starting evaluation at 2020-10-25T19:05:26Z\n",
      "INFO:tensorflow:Graph was finalized.\n",
      "INFO:tensorflow:Restoring parameters from asr-cnn-rnn/model.ckpt-600\n",
      "INFO:tensorflow:Running local_init_op.\n",
      "INFO:tensorflow:Done running local_init_op.\n",
      "INFO:tensorflow:Evaluation [1/10]\n",
      "INFO:tensorflow:Evaluation [2/10]\n",
      "INFO:tensorflow:Evaluation [3/10]\n",
      "INFO:tensorflow:Evaluation [4/10]\n",
      "INFO:tensorflow:Evaluation [5/10]\n",
      "INFO:tensorflow:Evaluation [6/10]\n",
      "INFO:tensorflow:Evaluation [7/10]\n",
      "INFO:tensorflow:Evaluation [8/10]\n",
      "INFO:tensorflow:Evaluation [9/10]\n",
      "INFO:tensorflow:Evaluation [10/10]\n",
      "INFO:tensorflow:Finished evaluation at 2020-10-25-19:05:31\n",
      "INFO:tensorflow:Saving dict for global step 600: WER = 0.69767433, accuracy = 0.56134975, global_step = 600, loss = 20.17979\n",
      "INFO:tensorflow:Saving 'checkpoint_path' summary for global step 600: asr-cnn-rnn/model.ckpt-600\n",
      "INFO:tensorflow:global_step/sec: 0.116211\n",
      "INFO:tensorflow:train_accuracy = 0.5542484, train_loss = 19.051353 (8.604 sec)\n",
      "INFO:tensorflow:loss = 19.051353, step = 599 (8.604 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.786534\n",
      "INFO:tensorflow:train_accuracy = 0.50714284, train_loss = 24.661234 (1.273 sec)\n",
      "INFO:tensorflow:loss = 24.661234, step = 600 (1.273 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.998164\n",
      "INFO:tensorflow:train_accuracy = 0.5494792, train_loss = 18.747707 (1.001 sec)\n",
      "INFO:tensorflow:loss = 18.747707, step = 601 (1.001 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.926466\n",
      "INFO:tensorflow:train_accuracy = 0.5546976, train_loss = 17.69517 (1.079 sec)\n",
      "INFO:tensorflow:loss = 17.69517, step = 602 (1.079 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.923959\n",
      "INFO:tensorflow:train_accuracy = 0.5667107, train_loss = 15.93301 (1.083 sec)\n",
      "INFO:tensorflow:loss = 15.93301, step = 603 (1.083 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.867633\n",
      "INFO:tensorflow:train_accuracy = 0.5584757, train_loss = 18.323446 (1.153 sec)\n",
      "INFO:tensorflow:loss = 18.323446, step = 604 (1.153 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.867025\n",
      "INFO:tensorflow:train_accuracy = 0.5519481, train_loss = 18.47649 (1.153 sec)\n",
      "INFO:tensorflow:loss = 18.47649, step = 605 (1.153 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.857336\n",
      "INFO:tensorflow:train_accuracy = 0.5379826, train_loss = 22.393206 (1.166 sec)\n",
      "INFO:tensorflow:loss = 22.393206, step = 606 (1.166 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.02201\n",
      "INFO:tensorflow:train_accuracy = 0.57567567, train_loss = 15.158109 (0.978 sec)\n",
      "INFO:tensorflow:loss = 15.158109, step = 607 (0.978 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.77617\n",
      "INFO:tensorflow:train_accuracy = 0.5685752, train_loss = 16.99376 (1.288 sec)\n",
      "INFO:tensorflow:loss = 16.99376, step = 608 (1.288 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.98379\n",
      "INFO:tensorflow:train_accuracy = 0.5518135, train_loss = 17.506184 (1.017 sec)\n",
      "INFO:tensorflow:loss = 17.506184, step = 609 (1.017 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.00443\n",
      "INFO:tensorflow:train_accuracy = 0.55878466, train_loss = 17.61768 (0.996 sec)\n",
      "INFO:tensorflow:loss = 17.61768, step = 610 (0.996 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.04657\n",
      "INFO:tensorflow:train_accuracy = 0.522293, train_loss = 19.087181 (0.956 sec)\n",
      "INFO:tensorflow:loss = 19.087181, step = 611 (0.956 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.0796\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "INFO:tensorflow:train_accuracy = 0.5784447, train_loss = 15.565257 (0.926 sec)\n",
      "INFO:tensorflow:loss = 15.565257, step = 612 (0.926 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.0177\n",
      "INFO:tensorflow:train_accuracy = 0.5751979, train_loss = 16.090492 (0.983 sec)\n",
      "INFO:tensorflow:loss = 16.090492, step = 613 (0.983 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.989477\n",
      "INFO:tensorflow:train_accuracy = 0.52416354, train_loss = 22.155891 (1.010 sec)\n",
      "INFO:tensorflow:loss = 22.155891, step = 614 (1.010 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.98518\n",
      "INFO:tensorflow:train_accuracy = 0.5643045, train_loss = 17.064837 (1.015 sec)\n",
      "INFO:tensorflow:loss = 17.064837, step = 615 (1.015 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.981681\n",
      "INFO:tensorflow:train_accuracy = 0.5541237, train_loss = 17.267353 (1.019 sec)\n",
      "INFO:tensorflow:loss = 17.267353, step = 616 (1.019 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.11826\n",
      "INFO:tensorflow:train_accuracy = 0.5638298, train_loss = 17.171446 (0.894 sec)\n",
      "INFO:tensorflow:loss = 17.171446, step = 617 (0.895 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.886683\n",
      "INFO:tensorflow:train_accuracy = 0.5545335, train_loss = 19.619873 (1.128 sec)\n",
      "INFO:tensorflow:loss = 19.619873, step = 618 (1.128 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.01219\n",
      "INFO:tensorflow:train_accuracy = 0.54350567, train_loss = 17.903488 (0.988 sec)\n",
      "INFO:tensorflow:loss = 17.903488, step = 619 (0.988 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.00889\n",
      "INFO:tensorflow:train_accuracy = 0.5660131, train_loss = 18.931631 (0.991 sec)\n",
      "INFO:tensorflow:loss = 18.931631, step = 620 (0.991 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.955746\n",
      "INFO:tensorflow:train_accuracy = 0.55835545, train_loss = 16.426937 (1.046 sec)\n",
      "INFO:tensorflow:loss = 16.426937, step = 621 (1.046 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.12952\n",
      "INFO:tensorflow:train_accuracy = 0.5771812, train_loss = 16.539452 (0.885 sec)\n",
      "INFO:tensorflow:loss = 16.539452, step = 622 (0.885 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.00139\n",
      "INFO:tensorflow:train_accuracy = 0.5585586, train_loss = 18.196468 (0.998 sec)\n",
      "INFO:tensorflow:loss = 18.196468, step = 623 (0.998 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.06893\n",
      "INFO:tensorflow:train_accuracy = 0.55789477, train_loss = 15.804443 (0.936 sec)\n",
      "INFO:tensorflow:loss = 15.804443, step = 624 (0.936 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.861405\n",
      "INFO:tensorflow:train_accuracy = 0.54980594, train_loss = 19.213848 (1.161 sec)\n",
      "INFO:tensorflow:loss = 19.213848, step = 625 (1.161 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.830171\n",
      "INFO:tensorflow:train_accuracy = 0.52970296, train_loss = 23.106796 (1.204 sec)\n",
      "INFO:tensorflow:loss = 23.106796, step = 626 (1.204 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.01898\n",
      "INFO:tensorflow:train_accuracy = 0.56241786, train_loss = 15.275942 (0.981 sec)\n",
      "INFO:tensorflow:loss = 15.275942, step = 627 (0.981 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.837425\n",
      "INFO:tensorflow:train_accuracy = 0.5301508, train_loss = 22.809565 (1.194 sec)\n",
      "INFO:tensorflow:loss = 22.809565, step = 628 (1.194 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.997727\n",
      "INFO:tensorflow:train_accuracy = 0.53441805, train_loss = 20.005861 (1.003 sec)\n",
      "INFO:tensorflow:loss = 20.005861, step = 629 (1.003 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.983234\n",
      "INFO:tensorflow:train_accuracy = 0.5636605, train_loss = 17.19496 (1.017 sec)\n",
      "INFO:tensorflow:loss = 17.19496, step = 630 (1.017 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.899795\n",
      "INFO:tensorflow:train_accuracy = 0.527881, train_loss = 21.458336 (1.111 sec)\n",
      "INFO:tensorflow:loss = 21.458336, step = 631 (1.111 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.05086\n",
      "INFO:tensorflow:train_accuracy = 0.5481386, train_loss = 18.271181 (0.952 sec)\n",
      "INFO:tensorflow:loss = 18.271181, step = 632 (0.952 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.860889\n",
      "INFO:tensorflow:train_accuracy = 0.5191122, train_loss = 21.377445 (1.162 sec)\n",
      "INFO:tensorflow:loss = 21.377445, step = 633 (1.162 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.831597\n",
      "INFO:tensorflow:train_accuracy = 0.52416354, train_loss = 20.74259 (1.202 sec)\n",
      "INFO:tensorflow:loss = 20.74259, step = 634 (1.202 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.12876\n",
      "INFO:tensorflow:train_accuracy = 0.5627477, train_loss = 16.472052 (0.886 sec)\n",
      "INFO:tensorflow:loss = 16.472052, step = 635 (0.885 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.980861\n",
      "INFO:tensorflow:train_accuracy = 0.54846936, train_loss = 19.603912 (1.020 sec)\n",
      "INFO:tensorflow:loss = 19.603912, step = 636 (1.020 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.942693\n",
      "INFO:tensorflow:train_accuracy = 0.54801536, train_loss = 18.03062 (1.061 sec)\n",
      "INFO:tensorflow:loss = 18.03062, step = 637 (1.061 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.879577\n",
      "INFO:tensorflow:train_accuracy = 0.550706, train_loss = 19.157349 (1.137 sec)\n",
      "INFO:tensorflow:loss = 19.157349, step = 638 (1.137 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.04878\n",
      "INFO:tensorflow:train_accuracy = 0.5580475, train_loss = 16.453499 (0.953 sec)\n",
      "INFO:tensorflow:loss = 16.453499, step = 639 (0.953 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.903734\n",
      "INFO:tensorflow:train_accuracy = 0.53846157, train_loss = 18.944748 (1.107 sec)\n",
      "INFO:tensorflow:loss = 18.944748, step = 640 (1.107 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.874193\n",
      "INFO:tensorflow:train_accuracy = 0.5629139, train_loss = 15.09875 (1.144 sec)\n",
      "INFO:tensorflow:loss = 15.09875, step = 641 (1.143 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.01999\n",
      "INFO:tensorflow:train_accuracy = 0.56626505, train_loss = 16.171206 (0.981 sec)\n",
      "INFO:tensorflow:loss = 16.171206, step = 642 (0.981 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.22058\n",
      "INFO:tensorflow:train_accuracy = 0.5219298, train_loss = 21.600874 (0.819 sec)\n",
      "INFO:tensorflow:loss = 21.600874, step = 643 (0.819 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.942458\n",
      "INFO:tensorflow:train_accuracy = 0.54859334, train_loss = 18.93488 (1.061 sec)\n",
      "INFO:tensorflow:loss = 18.93488, step = 644 (1.061 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.78847\n",
      "INFO:tensorflow:train_accuracy = 0.5338346, train_loss = 19.76203 (1.268 sec)\n",
      "INFO:tensorflow:loss = 19.76203, step = 645 (1.268 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.936784\n",
      "INFO:tensorflow:train_accuracy = 0.5388535, train_loss = 19.382795 (1.067 sec)\n",
      "INFO:tensorflow:loss = 19.382795, step = 646 (1.067 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.906448\n",
      "INFO:tensorflow:train_accuracy = 0.54339623, train_loss = 18.264555 (1.103 sec)\n",
      "INFO:tensorflow:loss = 18.264555, step = 647 (1.103 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.05082\n",
      "INFO:tensorflow:train_accuracy = 0.54140127, train_loss = 18.371395 (0.952 sec)\n",
      "INFO:tensorflow:loss = 18.371395, step = 648 (0.952 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.954901\n",
      "INFO:tensorflow:train_accuracy = 0.56078434, train_loss = 16.034714 (1.047 sec)\n",
      "INFO:tensorflow:loss = 16.034714, step = 649 (1.048 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.804339\n",
      "INFO:tensorflow:train_accuracy = 0.56225425, train_loss = 18.385569 (1.243 sec)\n",
      "INFO:tensorflow:loss = 18.385569, step = 650 (1.243 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.934881\n",
      "INFO:tensorflow:train_accuracy = 0.5554107, train_loss = 17.608696 (1.070 sec)\n",
      "INFO:tensorflow:loss = 17.608696, step = 651 (1.070 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.870855\n",
      "INFO:tensorflow:train_accuracy = 0.5635649, train_loss = 15.977477 (1.148 sec)\n",
      "INFO:tensorflow:loss = 15.977477, step = 652 (1.148 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.03059\n",
      "INFO:tensorflow:train_accuracy = 0.5674603, train_loss = 16.51144 (0.970 sec)\n",
      "INFO:tensorflow:loss = 16.51144, step = 653 (0.970 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.757288\n",
      "INFO:tensorflow:train_accuracy = 0.55421686, train_loss = 16.779083 (1.321 sec)\n",
      "INFO:tensorflow:loss = 16.779083, step = 654 (1.321 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.920712\n",
      "INFO:tensorflow:train_accuracy = 0.5568476, train_loss = 18.090313 (1.086 sec)\n",
      "INFO:tensorflow:loss = 18.090313, step = 655 (1.086 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.986834\n",
      "INFO:tensorflow:train_accuracy = 0.54909563, train_loss = 17.90884 (1.013 sec)\n",
      "INFO:tensorflow:loss = 17.90884, step = 656 (1.013 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.02127\n",
      "INFO:tensorflow:train_accuracy = 0.5590551, train_loss = 16.325401 (0.980 sec)\n",
      "INFO:tensorflow:loss = 16.325401, step = 657 (0.980 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.998423\n",
      "INFO:tensorflow:train_accuracy = 0.5466156, train_loss = 18.165077 (1.002 sec)\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "INFO:tensorflow:loss = 18.165077, step = 658 (1.002 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.989012\n",
      "INFO:tensorflow:train_accuracy = 0.5577428, train_loss = 17.228857 (1.011 sec)\n",
      "INFO:tensorflow:loss = 17.228857, step = 659 (1.010 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.999036\n",
      "INFO:tensorflow:train_accuracy = 0.5540897, train_loss = 16.586388 (1.001 sec)\n",
      "INFO:tensorflow:loss = 16.586388, step = 660 (1.001 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.929341\n",
      "INFO:tensorflow:train_accuracy = 0.55569947, train_loss = 15.639916 (1.076 sec)\n",
      "INFO:tensorflow:loss = 15.639916, step = 661 (1.077 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.1003\n",
      "INFO:tensorflow:train_accuracy = 0.5878378, train_loss = 15.4501 (0.909 sec)\n",
      "INFO:tensorflow:loss = 15.4501, step = 662 (0.909 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.965947\n",
      "INFO:tensorflow:train_accuracy = 0.563249, train_loss = 16.739632 (1.035 sec)\n",
      "INFO:tensorflow:loss = 16.739632, step = 663 (1.035 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.867552\n",
      "INFO:tensorflow:train_accuracy = 0.54695433, train_loss = 19.896397 (1.153 sec)\n",
      "INFO:tensorflow:loss = 19.896397, step = 664 (1.153 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.03588\n",
      "INFO:tensorflow:train_accuracy = 0.5651613, train_loss = 17.953663 (0.965 sec)\n",
      "INFO:tensorflow:loss = 17.953663, step = 665 (0.966 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.05867\n",
      "INFO:tensorflow:train_accuracy = 0.5571616, train_loss = 17.870668 (0.944 sec)\n",
      "INFO:tensorflow:loss = 17.870668, step = 666 (0.944 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.97112\n",
      "INFO:tensorflow:train_accuracy = 0.5321782, train_loss = 21.73301 (1.030 sec)\n",
      "INFO:tensorflow:loss = 21.73301, step = 667 (1.029 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.946029\n",
      "INFO:tensorflow:train_accuracy = 0.5607477, train_loss = 14.850644 (1.058 sec)\n",
      "INFO:tensorflow:loss = 14.850644, step = 668 (1.058 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.02898\n",
      "INFO:tensorflow:train_accuracy = 0.56608814, train_loss = 15.956936 (0.972 sec)\n",
      "INFO:tensorflow:loss = 15.956936, step = 669 (0.972 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.872393\n",
      "INFO:tensorflow:train_accuracy = 0.5548303, train_loss = 17.261986 (1.146 sec)\n",
      "INFO:tensorflow:loss = 17.261986, step = 670 (1.146 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.87216\n",
      "INFO:tensorflow:train_accuracy = 0.5470738, train_loss = 18.123102 (1.147 sec)\n",
      "INFO:tensorflow:loss = 18.123102, step = 671 (1.147 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.07359\n",
      "INFO:tensorflow:train_accuracy = 0.5526992, train_loss = 19.665173 (0.931 sec)\n",
      "INFO:tensorflow:loss = 19.665173, step = 672 (0.931 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.833185\n",
      "INFO:tensorflow:train_accuracy = 0.5495495, train_loss = 18.209295 (1.200 sec)\n",
      "INFO:tensorflow:loss = 18.209295, step = 673 (1.200 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.11584\n",
      "INFO:tensorflow:train_accuracy = 0.5164434, train_loss = 20.086344 (0.896 sec)\n",
      "INFO:tensorflow:loss = 20.086344, step = 674 (0.896 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.85512\n",
      "INFO:tensorflow:train_accuracy = 0.5497449, train_loss = 20.00349 (1.169 sec)\n",
      "INFO:tensorflow:loss = 20.00349, step = 675 (1.169 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.03861\n",
      "INFO:tensorflow:train_accuracy = 0.5652742, train_loss = 17.953579 (0.963 sec)\n",
      "INFO:tensorflow:loss = 17.953579, step = 676 (0.963 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.8308\n",
      "INFO:tensorflow:train_accuracy = 0.5357591, train_loss = 18.893948 (1.204 sec)\n",
      "INFO:tensorflow:loss = 18.893948, step = 677 (1.204 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.00242\n",
      "INFO:tensorflow:train_accuracy = 0.56241786, train_loss = 16.561115 (0.997 sec)\n",
      "INFO:tensorflow:loss = 16.561115, step = 678 (0.997 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.825084\n",
      "INFO:tensorflow:train_accuracy = 0.53136533, train_loss = 20.699543 (1.212 sec)\n",
      "INFO:tensorflow:loss = 20.699543, step = 679 (1.212 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.968071\n",
      "INFO:tensorflow:train_accuracy = 0.5542636, train_loss = 17.337261 (1.033 sec)\n",
      "INFO:tensorflow:loss = 17.337261, step = 680 (1.033 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.905028\n",
      "INFO:tensorflow:train_accuracy = 0.5470738, train_loss = 17.974293 (1.105 sec)\n",
      "INFO:tensorflow:loss = 17.974293, step = 681 (1.105 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.965842\n",
      "INFO:tensorflow:train_accuracy = 0.56914896, train_loss = 16.506908 (1.035 sec)\n",
      "INFO:tensorflow:loss = 16.506908, step = 682 (1.035 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.05175\n",
      "INFO:tensorflow:train_accuracy = 0.5420326, train_loss = 19.250053 (0.951 sec)\n",
      "INFO:tensorflow:loss = 19.250053, step = 683 (0.951 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.91495\n",
      "INFO:tensorflow:train_accuracy = 0.53424656, train_loss = 19.522419 (1.093 sec)\n",
      "INFO:tensorflow:loss = 19.522419, step = 684 (1.093 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.05136\n",
      "INFO:tensorflow:train_accuracy = 0.54993516, train_loss = 17.671473 (0.951 sec)\n",
      "INFO:tensorflow:loss = 17.671473, step = 685 (0.951 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.904816\n",
      "INFO:tensorflow:train_accuracy = 0.54801536, train_loss = 15.933813 (1.106 sec)\n",
      "INFO:tensorflow:loss = 15.933813, step = 686 (1.107 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.873296\n",
      "INFO:tensorflow:train_accuracy = 0.5740988, train_loss = 14.745393 (1.145 sec)\n",
      "INFO:tensorflow:loss = 14.745393, step = 687 (1.144 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.883762\n",
      "INFO:tensorflow:train_accuracy = 0.55526316, train_loss = 15.429291 (1.131 sec)\n",
      "INFO:tensorflow:loss = 15.429291, step = 688 (1.131 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.921311\n",
      "INFO:tensorflow:train_accuracy = 0.54260087, train_loss = 17.302984 (1.085 sec)\n",
      "INFO:tensorflow:loss = 17.302984, step = 689 (1.085 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.928288\n",
      "INFO:tensorflow:train_accuracy = 0.5529412, train_loss = 16.273636 (1.077 sec)\n",
      "INFO:tensorflow:loss = 16.273636, step = 690 (1.077 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.77276\n",
      "INFO:tensorflow:train_accuracy = 0.5490446, train_loss = 18.760904 (1.294 sec)\n",
      "INFO:tensorflow:loss = 18.760904, step = 691 (1.294 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.782573\n",
      "INFO:tensorflow:train_accuracy = 0.5250918, train_loss = 21.422146 (1.278 sec)\n",
      "INFO:tensorflow:loss = 21.422146, step = 692 (1.278 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.852279\n",
      "INFO:tensorflow:train_accuracy = 0.53673726, train_loss = 19.29195 (1.173 sec)\n",
      "INFO:tensorflow:loss = 19.29195, step = 693 (1.174 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.01117\n",
      "INFO:tensorflow:train_accuracy = 0.5541237, train_loss = 15.989373 (0.989 sec)\n",
      "INFO:tensorflow:loss = 15.989373, step = 694 (0.989 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.8732\n",
      "INFO:tensorflow:train_accuracy = 0.5621693, train_loss = 16.734968 (1.145 sec)\n",
      "INFO:tensorflow:loss = 16.734968, step = 695 (1.145 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.930978\n",
      "INFO:tensorflow:train_accuracy = 0.54464287, train_loss = 18.206276 (1.074 sec)\n",
      "INFO:tensorflow:loss = 18.206276, step = 696 (1.074 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.08919\n",
      "INFO:tensorflow:train_accuracy = 0.5483029, train_loss = 16.431137 (0.918 sec)\n",
      "INFO:tensorflow:loss = 16.431137, step = 697 (0.918 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.932426\n",
      "INFO:tensorflow:train_accuracy = 0.5682119, train_loss = 16.990429 (1.073 sec)\n",
      "INFO:tensorflow:loss = 16.990429, step = 698 (1.072 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.758411\n",
      "INFO:tensorflow:train_accuracy = 0.5444015, train_loss = 19.593428 (1.319 sec)\n",
      "INFO:tensorflow:loss = 19.593428, step = 699 (1.319 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.882194\n",
      "INFO:tensorflow:train_accuracy = 0.57579786, train_loss = 14.583438 (1.134 sec)\n",
      "INFO:tensorflow:loss = 14.583438, step = 700 (1.135 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.889793\n",
      "INFO:tensorflow:train_accuracy = 0.56176853, train_loss = 17.101578 (1.123 sec)\n",
      "INFO:tensorflow:loss = 17.101578, step = 701 (1.123 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.08883\n",
      "INFO:tensorflow:train_accuracy = 0.5572917, train_loss = 15.312528 (0.919 sec)\n",
      "INFO:tensorflow:loss = 15.312528, step = 702 (0.919 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.01677\n",
      "INFO:tensorflow:train_accuracy = 0.5497382, train_loss = 17.317287 (0.983 sec)\n",
      "INFO:tensorflow:loss = 17.317287, step = 703 (0.983 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.953126\n",
      "INFO:tensorflow:train_accuracy = 0.5849315, train_loss = 15.533225 (1.049 sec)\n",
      "INFO:tensorflow:loss = 15.533225, step = 704 (1.050 sec)\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "INFO:tensorflow:global_step/sec: 0.946701\n",
      "INFO:tensorflow:train_accuracy = 0.55813956, train_loss = 16.338957 (1.056 sec)\n",
      "INFO:tensorflow:loss = 16.338957, step = 705 (1.056 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.12441\n",
      "INFO:tensorflow:train_accuracy = 0.55203044, train_loss = 18.37914 (0.890 sec)\n",
      "INFO:tensorflow:loss = 18.37914, step = 706 (0.890 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.06036\n",
      "INFO:tensorflow:train_accuracy = 0.5514139, train_loss = 16.290071 (0.943 sec)\n",
      "INFO:tensorflow:loss = 16.290071, step = 707 (0.942 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.999876\n",
      "INFO:tensorflow:train_accuracy = 0.5795756, train_loss = 15.046362 (1.000 sec)\n",
      "INFO:tensorflow:loss = 15.046362, step = 708 (1.001 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.920411\n",
      "INFO:tensorflow:train_accuracy = 0.5613577, train_loss = 16.126839 (1.086 sec)\n",
      "INFO:tensorflow:loss = 16.126839, step = 709 (1.086 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.870555\n",
      "INFO:tensorflow:train_accuracy = 0.56901044, train_loss = 17.72861 (1.148 sec)\n",
      "INFO:tensorflow:loss = 17.72861, step = 710 (1.148 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.03818\n",
      "INFO:tensorflow:train_accuracy = 0.55725193, train_loss = 18.234423 (0.964 sec)\n",
      "INFO:tensorflow:loss = 18.234423, step = 711 (0.965 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.976619\n",
      "INFO:tensorflow:train_accuracy = 0.5648755, train_loss = 16.12586 (1.023 sec)\n",
      "INFO:tensorflow:loss = 16.12586, step = 712 (1.023 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.943872\n",
      "INFO:tensorflow:train_accuracy = 0.5611038, train_loss = 17.187706 (1.060 sec)\n",
      "INFO:tensorflow:loss = 17.187706, step = 713 (1.060 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.03613\n",
      "INFO:tensorflow:train_accuracy = 0.56880736, train_loss = 16.9754 (0.965 sec)\n",
      "INFO:tensorflow:loss = 16.9754, step = 714 (0.964 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.957721\n",
      "INFO:tensorflow:train_accuracy = 0.54241645, train_loss = 15.980089 (1.045 sec)\n",
      "INFO:tensorflow:loss = 15.980089, step = 715 (1.045 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.900546\n",
      "INFO:tensorflow:train_accuracy = 0.58401084, train_loss = 15.660409 (1.110 sec)\n",
      "INFO:tensorflow:loss = 15.660409, step = 716 (1.110 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.800295\n",
      "INFO:tensorflow:train_accuracy = 0.54695433, train_loss = 18.76967 (1.250 sec)\n",
      "INFO:tensorflow:loss = 18.76967, step = 717 (1.250 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.07422\n",
      "INFO:tensorflow:train_accuracy = 0.54949236, train_loss = 16.16594 (0.931 sec)\n",
      "INFO:tensorflow:loss = 16.16594, step = 718 (0.931 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.0338\n",
      "INFO:tensorflow:train_accuracy = 0.5670103, train_loss = 17.5749 (0.967 sec)\n",
      "INFO:tensorflow:loss = 17.5749, step = 719 (0.967 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.887962\n",
      "INFO:tensorflow:train_accuracy = 0.5370138, train_loss = 18.922075 (1.126 sec)\n",
      "INFO:tensorflow:loss = 18.922075, step = 720 (1.126 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.833925\n",
      "INFO:tensorflow:train_accuracy = 0.55089056, train_loss = 18.021969 (1.199 sec)\n",
      "INFO:tensorflow:loss = 18.021969, step = 721 (1.199 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.94198\n",
      "INFO:tensorflow:train_accuracy = 0.56623375, train_loss = 15.994001 (1.062 sec)\n",
      "INFO:tensorflow:loss = 15.994001, step = 722 (1.062 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.916917\n",
      "INFO:tensorflow:train_accuracy = 0.55893534, train_loss = 18.553846 (1.091 sec)\n",
      "INFO:tensorflow:loss = 18.553846, step = 723 (1.091 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.07124\n",
      "INFO:tensorflow:train_accuracy = 0.53603035, train_loss = 20.08867 (0.934 sec)\n",
      "INFO:tensorflow:loss = 20.08867, step = 724 (0.934 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.815978\n",
      "INFO:tensorflow:train_accuracy = 0.55541235, train_loss = 17.017216 (1.225 sec)\n",
      "INFO:tensorflow:loss = 17.017216, step = 725 (1.225 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.778673\n",
      "INFO:tensorflow:train_accuracy = 0.5274314, train_loss = 18.24981 (1.285 sec)\n",
      "INFO:tensorflow:loss = 18.24981, step = 726 (1.285 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.84435\n",
      "INFO:tensorflow:train_accuracy = 0.53710693, train_loss = 17.369934 (1.184 sec)\n",
      "INFO:tensorflow:loss = 17.369934, step = 727 (1.184 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.03734\n",
      "INFO:tensorflow:train_accuracy = 0.55541235, train_loss = 17.683634 (0.964 sec)\n",
      "INFO:tensorflow:loss = 17.683634, step = 728 (0.964 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.973567\n",
      "INFO:tensorflow:train_accuracy = 0.55259824, train_loss = 18.925709 (1.027 sec)\n",
      "INFO:tensorflow:loss = 18.925709, step = 729 (1.027 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.96554\n",
      "INFO:tensorflow:train_accuracy = 0.5405063, train_loss = 16.603737 (1.036 sec)\n",
      "INFO:tensorflow:loss = 16.603737, step = 730 (1.036 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.0447\n",
      "INFO:tensorflow:train_accuracy = 0.55741936, train_loss = 16.242138 (0.957 sec)\n",
      "INFO:tensorflow:loss = 16.242138, step = 731 (0.957 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.01408\n",
      "INFO:tensorflow:train_accuracy = 0.56640625, train_loss = 15.581766 (0.986 sec)\n",
      "INFO:tensorflow:loss = 15.581766, step = 732 (0.985 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.00961\n",
      "INFO:tensorflow:train_accuracy = 0.5652174, train_loss = 15.219323 (0.991 sec)\n",
      "INFO:tensorflow:loss = 15.219323, step = 733 (0.991 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.01659\n",
      "INFO:tensorflow:train_accuracy = 0.57816714, train_loss = 13.170564 (0.984 sec)\n",
      "INFO:tensorflow:loss = 13.170564, step = 734 (0.985 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.12151\n",
      "INFO:tensorflow:train_accuracy = 0.5740741, train_loss = 15.149373 (0.891 sec)\n",
      "INFO:tensorflow:loss = 15.149373, step = 735 (0.891 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.892065\n",
      "INFO:tensorflow:train_accuracy = 0.55414015, train_loss = 18.323442 (1.121 sec)\n",
      "INFO:tensorflow:loss = 18.323442, step = 736 (1.121 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.77702\n",
      "INFO:tensorflow:train_accuracy = 0.5427136, train_loss = 18.017876 (1.287 sec)\n",
      "INFO:tensorflow:loss = 18.017876, step = 737 (1.287 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.871595\n",
      "INFO:tensorflow:train_accuracy = 0.5644955, train_loss = 16.529411 (1.147 sec)\n",
      "INFO:tensorflow:loss = 16.529411, step = 738 (1.147 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.832271\n",
      "INFO:tensorflow:train_accuracy = 0.5571066, train_loss = 16.428875 (1.201 sec)\n",
      "INFO:tensorflow:loss = 16.428875, step = 739 (1.201 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.864092\n",
      "INFO:tensorflow:train_accuracy = 0.5507614, train_loss = 18.483854 (1.157 sec)\n",
      "INFO:tensorflow:loss = 18.483854, step = 740 (1.157 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.844385\n",
      "INFO:tensorflow:train_accuracy = 0.5481386, train_loss = 16.379492 (1.184 sec)\n",
      "INFO:tensorflow:loss = 16.379492, step = 741 (1.184 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.989615\n",
      "INFO:tensorflow:train_accuracy = 0.5682119, train_loss = 15.292561 (1.010 sec)\n",
      "INFO:tensorflow:loss = 15.292561, step = 742 (1.011 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.783561\n",
      "INFO:tensorflow:train_accuracy = 0.55096775, train_loss = 15.833136 (1.276 sec)\n",
      "INFO:tensorflow:loss = 15.833136, step = 743 (1.276 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.89474\n",
      "INFO:tensorflow:train_accuracy = 0.55584085, train_loss = 16.256405 (1.118 sec)\n",
      "INFO:tensorflow:loss = 16.256405, step = 744 (1.118 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.773566\n",
      "INFO:tensorflow:train_accuracy = 0.5597898, train_loss = 15.17257 (1.292 sec)\n",
      "INFO:tensorflow:loss = 15.17257, step = 745 (1.292 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.902821\n",
      "INFO:tensorflow:train_accuracy = 0.56951874, train_loss = 13.058092 (1.108 sec)\n",
      "INFO:tensorflow:loss = 13.058092, step = 746 (1.108 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.10859\n",
      "INFO:tensorflow:train_accuracy = 0.5615894, train_loss = 16.209995 (0.902 sec)\n",
      "INFO:tensorflow:loss = 16.209995, step = 747 (0.902 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.0281\n",
      "INFO:tensorflow:train_accuracy = 0.564409, train_loss = 14.210758 (0.973 sec)\n",
      "INFO:tensorflow:loss = 14.210758, step = 748 (0.972 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.00636\n",
      "INFO:tensorflow:train_accuracy = 0.56020945, train_loss = 15.70928 (0.994 sec)\n",
      "INFO:tensorflow:loss = 15.70928, step = 749 (0.994 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.989837\n",
      "INFO:tensorflow:train_accuracy = 0.54394907, train_loss = 17.993526 (1.010 sec)\n",
      "INFO:tensorflow:loss = 17.993526, step = 750 (1.010 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.984992\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "INFO:tensorflow:train_accuracy = 0.5627426, train_loss = 16.478338 (1.015 sec)\n",
      "INFO:tensorflow:loss = 16.478338, step = 751 (1.015 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.91707\n",
      "INFO:tensorflow:train_accuracy = 0.57978725, train_loss = 16.067808 (1.090 sec)\n",
      "INFO:tensorflow:loss = 16.067808, step = 752 (1.090 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.10716\n",
      "INFO:tensorflow:train_accuracy = 0.5660131, train_loss = 14.926048 (0.904 sec)\n",
      "INFO:tensorflow:loss = 14.926048, step = 753 (0.904 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.03948\n",
      "INFO:tensorflow:train_accuracy = 0.58704454, train_loss = 12.669156 (0.962 sec)\n",
      "INFO:tensorflow:loss = 12.669156, step = 754 (0.962 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.971131\n",
      "INFO:tensorflow:train_accuracy = 0.56217617, train_loss = 16.351814 (1.029 sec)\n",
      "INFO:tensorflow:loss = 16.351814, step = 755 (1.029 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.954553\n",
      "INFO:tensorflow:train_accuracy = 0.54, train_loss = 17.268337 (1.048 sec)\n",
      "INFO:tensorflow:loss = 17.268337, step = 756 (1.048 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.844661\n",
      "INFO:tensorflow:train_accuracy = 0.55541235, train_loss = 17.49987 (1.184 sec)\n",
      "INFO:tensorflow:loss = 17.49987, step = 757 (1.183 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.03741\n",
      "INFO:tensorflow:train_accuracy = 0.5648755, train_loss = 15.457405 (0.964 sec)\n",
      "INFO:tensorflow:loss = 15.457405, step = 758 (0.964 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.915743\n",
      "INFO:tensorflow:train_accuracy = 0.5778364, train_loss = 15.539322 (1.092 sec)\n",
      "INFO:tensorflow:loss = 15.539322, step = 759 (1.092 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.871393\n",
      "INFO:tensorflow:train_accuracy = 0.57218546, train_loss = 13.860031 (1.147 sec)\n",
      "INFO:tensorflow:loss = 13.860031, step = 760 (1.147 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.979321\n",
      "INFO:tensorflow:train_accuracy = 0.56349206, train_loss = 14.993848 (1.022 sec)\n",
      "INFO:tensorflow:loss = 14.993848, step = 761 (1.022 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.855189\n",
      "INFO:tensorflow:train_accuracy = 0.56883115, train_loss = 15.652929 (1.169 sec)\n",
      "INFO:tensorflow:loss = 15.652929, step = 762 (1.169 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.772092\n",
      "INFO:tensorflow:train_accuracy = 0.5227552, train_loss = 17.973114 (1.295 sec)\n",
      "INFO:tensorflow:loss = 17.973114, step = 763 (1.294 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.819985\n",
      "INFO:tensorflow:train_accuracy = 0.5552699, train_loss = 16.961462 (1.220 sec)\n",
      "INFO:tensorflow:loss = 16.961462, step = 764 (1.220 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.0221\n",
      "INFO:tensorflow:train_accuracy = 0.56046814, train_loss = 17.407242 (0.978 sec)\n",
      "INFO:tensorflow:loss = 17.407242, step = 765 (0.978 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.783676\n",
      "INFO:tensorflow:train_accuracy = 0.53209877, train_loss = 18.95777 (1.276 sec)\n",
      "INFO:tensorflow:loss = 18.95777, step = 766 (1.276 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.833257\n",
      "INFO:tensorflow:train_accuracy = 0.55974025, train_loss = 15.743376 (1.200 sec)\n",
      "INFO:tensorflow:loss = 15.743376, step = 767 (1.200 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.877691\n",
      "INFO:tensorflow:train_accuracy = 0.55904526, train_loss = 16.29555 (1.140 sec)\n",
      "INFO:tensorflow:loss = 16.29555, step = 768 (1.140 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.893246\n",
      "INFO:tensorflow:train_accuracy = 0.553137, train_loss = 17.006126 (1.120 sec)\n",
      "INFO:tensorflow:loss = 17.006126, step = 769 (1.120 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.757846\n",
      "INFO:tensorflow:train_accuracy = 0.5693904, train_loss = 16.461994 (1.320 sec)\n",
      "INFO:tensorflow:loss = 16.461994, step = 770 (1.320 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.835563\n",
      "INFO:tensorflow:train_accuracy = 0.5386534, train_loss = 16.913336 (1.197 sec)\n",
      "INFO:tensorflow:loss = 16.913336, step = 771 (1.197 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.821974\n",
      "INFO:tensorflow:train_accuracy = 0.54892, train_loss = 18.744976 (1.217 sec)\n",
      "INFO:tensorflow:loss = 18.744976, step = 772 (1.216 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.978149\n",
      "INFO:tensorflow:train_accuracy = 0.57387865, train_loss = 14.521839 (1.022 sec)\n",
      "INFO:tensorflow:loss = 14.521839, step = 773 (1.021 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.06494\n",
      "INFO:tensorflow:train_accuracy = 0.5606641, train_loss = 18.234634 (0.939 sec)\n",
      "INFO:tensorflow:loss = 18.234634, step = 774 (0.940 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.883296\n",
      "INFO:tensorflow:train_accuracy = 0.53400505, train_loss = 16.088806 (1.132 sec)\n",
      "INFO:tensorflow:loss = 16.088806, step = 775 (1.132 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.00027\n",
      "INFO:tensorflow:train_accuracy = 0.5585242, train_loss = 16.529535 (1.000 sec)\n",
      "INFO:tensorflow:loss = 16.529535, step = 776 (1.000 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.926422\n",
      "INFO:tensorflow:train_accuracy = 0.54285717, train_loss = 17.077616 (1.079 sec)\n",
      "INFO:tensorflow:loss = 17.077616, step = 777 (1.079 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.993249\n",
      "INFO:tensorflow:train_accuracy = 0.57667106, train_loss = 15.153682 (1.007 sec)\n",
      "INFO:tensorflow:loss = 15.153682, step = 778 (1.007 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.952839\n",
      "INFO:tensorflow:train_accuracy = 0.57523304, train_loss = 12.885216 (1.049 sec)\n",
      "INFO:tensorflow:loss = 12.885216, step = 779 (1.050 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.940555\n",
      "INFO:tensorflow:train_accuracy = 0.57404983, train_loss = 12.949697 (1.064 sec)\n",
      "INFO:tensorflow:loss = 12.949697, step = 780 (1.064 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.98112\n",
      "INFO:tensorflow:train_accuracy = 0.6089109, train_loss = 11.589312 (1.019 sec)\n",
      "INFO:tensorflow:loss = 11.589312, step = 781 (1.019 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.821996\n",
      "INFO:tensorflow:train_accuracy = 0.56578946, train_loss = 15.339703 (1.216 sec)\n",
      "INFO:tensorflow:loss = 15.339703, step = 782 (1.216 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.790264\n",
      "INFO:tensorflow:train_accuracy = 0.5473146, train_loss = 16.575138 (1.265 sec)\n",
      "INFO:tensorflow:loss = 16.575138, step = 783 (1.265 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.765704\n",
      "INFO:tensorflow:train_accuracy = 0.54466504, train_loss = 17.871841 (1.306 sec)\n",
      "INFO:tensorflow:loss = 17.871841, step = 784 (1.307 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.84547\n",
      "INFO:tensorflow:train_accuracy = 0.53382534, train_loss = 19.009018 (1.182 sec)\n",
      "INFO:tensorflow:loss = 19.009018, step = 785 (1.182 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.959992\n",
      "INFO:tensorflow:train_accuracy = 0.5695709, train_loss = 13.300469 (1.042 sec)\n",
      "INFO:tensorflow:loss = 13.300469, step = 786 (1.042 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.886233\n",
      "INFO:tensorflow:train_accuracy = 0.57887703, train_loss = 12.534071 (1.128 sec)\n",
      "INFO:tensorflow:loss = 12.534071, step = 787 (1.128 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.810823\n",
      "INFO:tensorflow:train_accuracy = 0.57033247, train_loss = 14.262459 (1.233 sec)\n",
      "INFO:tensorflow:loss = 14.262459, step = 788 (1.234 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.814988\n",
      "INFO:tensorflow:train_accuracy = 0.56258065, train_loss = 16.724861 (1.226 sec)\n",
      "INFO:tensorflow:loss = 16.724861, step = 789 (1.226 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.836008\n",
      "INFO:tensorflow:train_accuracy = 0.55484694, train_loss = 16.707943 (1.197 sec)\n",
      "INFO:tensorflow:loss = 16.707943, step = 790 (1.197 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.72477\n",
      "INFO:tensorflow:train_accuracy = 0.5697523, train_loss = 16.994326 (1.380 sec)\n",
      "INFO:tensorflow:loss = 16.994326, step = 791 (1.379 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.03167\n",
      "INFO:tensorflow:train_accuracy = 0.5752688, train_loss = 12.6977625 (0.969 sec)\n",
      "INFO:tensorflow:loss = 12.6977625, step = 792 (0.969 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.862638\n",
      "INFO:tensorflow:train_accuracy = 0.55916774, train_loss = 14.340212 (1.160 sec)\n",
      "INFO:tensorflow:loss = 14.340212, step = 793 (1.160 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.91642\n",
      "INFO:tensorflow:train_accuracy = 0.56806284, train_loss = 16.209126 (1.091 sec)\n",
      "INFO:tensorflow:loss = 16.209126, step = 794 (1.091 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.936446\n",
      "INFO:tensorflow:train_accuracy = 0.5676741, train_loss = 14.738188 (1.068 sec)\n",
      "INFO:tensorflow:loss = 14.738188, step = 795 (1.068 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.00192\n",
      "INFO:tensorflow:train_accuracy = 0.5877551, train_loss = 12.872229 (0.998 sec)\n",
      "INFO:tensorflow:loss = 12.872229, step = 796 (0.998 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.915643\n",
      "INFO:tensorflow:train_accuracy = 0.53628534, train_loss = 17.13417 (1.092 sec)\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "INFO:tensorflow:loss = 17.13417, step = 797 (1.093 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.03788\n",
      "INFO:tensorflow:train_accuracy = 0.57676905, train_loss = 13.978708 (0.963 sec)\n",
      "INFO:tensorflow:loss = 13.978708, step = 798 (0.962 sec)\n",
      "INFO:tensorflow:Saving checkpoints for 800 into asr-cnn-rnn/model.ckpt.\n",
      "INFO:tensorflow:Calling model_fn.\n",
      "INFO:tensorflow:Done calling model_fn.\n",
      "INFO:tensorflow:Starting evaluation at 2020-10-25T19:09:09Z\n",
      "INFO:tensorflow:Graph was finalized.\n",
      "INFO:tensorflow:Restoring parameters from asr-cnn-rnn/model.ckpt-800\n",
      "INFO:tensorflow:Running local_init_op.\n",
      "INFO:tensorflow:Done running local_init_op.\n",
      "INFO:tensorflow:Evaluation [1/10]\n",
      "INFO:tensorflow:Evaluation [2/10]\n",
      "INFO:tensorflow:Evaluation [3/10]\n",
      "INFO:tensorflow:Evaluation [4/10]\n",
      "INFO:tensorflow:Evaluation [5/10]\n",
      "INFO:tensorflow:Evaluation [6/10]\n",
      "INFO:tensorflow:Evaluation [7/10]\n",
      "INFO:tensorflow:Evaluation [8/10]\n",
      "INFO:tensorflow:Evaluation [9/10]\n",
      "INFO:tensorflow:Evaluation [10/10]\n",
      "INFO:tensorflow:Finished evaluation at 2020-10-25-19:09:14\n",
      "INFO:tensorflow:Saving dict for global step 800: WER = 0.67441857, accuracy = 0.57668704, global_step = 800, loss = 20.322254\n",
      "INFO:tensorflow:Saving 'checkpoint_path' summary for global step 800: asr-cnn-rnn/model.ckpt-800\n",
      "INFO:tensorflow:global_step/sec: 0.119231\n",
      "INFO:tensorflow:train_accuracy = 0.5589744, train_loss = 15.427313 (8.387 sec)\n",
      "INFO:tensorflow:loss = 15.427313, step = 799 (8.387 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.092\n",
      "INFO:tensorflow:train_accuracy = 0.5903614, train_loss = 13.996228 (0.916 sec)\n",
      "INFO:tensorflow:loss = 13.996228, step = 800 (0.916 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.903589\n",
      "INFO:tensorflow:train_accuracy = 0.57104915, train_loss = 12.678862 (1.106 sec)\n",
      "INFO:tensorflow:loss = 12.678862, step = 801 (1.106 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.853739\n",
      "INFO:tensorflow:train_accuracy = 0.5446541, train_loss = 16.465954 (1.172 sec)\n",
      "INFO:tensorflow:loss = 16.465954, step = 802 (1.172 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.941398\n",
      "INFO:tensorflow:train_accuracy = 0.5597484, train_loss = 16.737118 (1.062 sec)\n",
      "INFO:tensorflow:loss = 16.737118, step = 803 (1.062 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.981998\n",
      "INFO:tensorflow:train_accuracy = 0.5883134, train_loss = 14.312642 (1.018 sec)\n",
      "INFO:tensorflow:loss = 14.312642, step = 804 (1.019 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.743042\n",
      "INFO:tensorflow:train_accuracy = 0.56363636, train_loss = 16.42993 (1.346 sec)\n",
      "INFO:tensorflow:loss = 16.42993, step = 805 (1.346 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.01992\n",
      "INFO:tensorflow:train_accuracy = 0.5718085, train_loss = 13.732815 (0.981 sec)\n",
      "INFO:tensorflow:loss = 13.732815, step = 806 (0.981 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.954711\n",
      "INFO:tensorflow:train_accuracy = 0.58288044, train_loss = 11.57469 (1.047 sec)\n",
      "INFO:tensorflow:loss = 11.57469, step = 807 (1.047 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.01902\n",
      "INFO:tensorflow:train_accuracy = 0.54499364, train_loss = 17.126694 (0.981 sec)\n",
      "INFO:tensorflow:loss = 17.126694, step = 808 (0.981 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.00446\n",
      "INFO:tensorflow:train_accuracy = 0.553137, train_loss = 17.588326 (0.995 sec)\n",
      "INFO:tensorflow:loss = 17.588326, step = 809 (0.995 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.752805\n",
      "INFO:tensorflow:train_accuracy = 0.54339623, train_loss = 19.238811 (1.328 sec)\n",
      "INFO:tensorflow:loss = 19.238811, step = 810 (1.328 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.920588\n",
      "INFO:tensorflow:train_accuracy = 0.54477614, train_loss = 16.678585 (1.086 sec)\n",
      "INFO:tensorflow:loss = 16.678585, step = 811 (1.086 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.08592\n",
      "INFO:tensorflow:train_accuracy = 0.5606258, train_loss = 15.791935 (0.921 sec)\n",
      "INFO:tensorflow:loss = 15.791935, step = 812 (0.922 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.870734\n",
      "INFO:tensorflow:train_accuracy = 0.5655629, train_loss = 13.934945 (1.148 sec)\n",
      "INFO:tensorflow:loss = 13.934945, step = 813 (1.149 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.838194\n",
      "INFO:tensorflow:train_accuracy = 0.55938697, train_loss = 13.82417 (1.193 sec)\n",
      "INFO:tensorflow:loss = 13.82417, step = 814 (1.193 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.75872\n",
      "INFO:tensorflow:train_accuracy = 0.52548546, train_loss = 19.238127 (1.318 sec)\n",
      "INFO:tensorflow:loss = 19.238127, step = 815 (1.318 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.970018\n",
      "INFO:tensorflow:train_accuracy = 0.5862069, train_loss = 14.477709 (1.031 sec)\n",
      "INFO:tensorflow:loss = 14.477709, step = 816 (1.032 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.840664\n",
      "INFO:tensorflow:train_accuracy = 0.54212457, train_loss = 18.743189 (1.190 sec)\n",
      "INFO:tensorflow:loss = 18.743189, step = 817 (1.189 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.773512\n",
      "INFO:tensorflow:train_accuracy = 0.5473146, train_loss = 16.77524 (1.293 sec)\n",
      "INFO:tensorflow:loss = 16.77524, step = 818 (1.292 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.909815\n",
      "INFO:tensorflow:train_accuracy = 0.5537295, train_loss = 16.560545 (1.099 sec)\n",
      "INFO:tensorflow:loss = 16.560545, step = 819 (1.099 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.975528\n",
      "INFO:tensorflow:train_accuracy = 0.5853018, train_loss = 15.310865 (1.025 sec)\n",
      "INFO:tensorflow:loss = 15.310865, step = 820 (1.025 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.980921\n",
      "INFO:tensorflow:train_accuracy = 0.56088084, train_loss = 15.07128 (1.019 sec)\n",
      "INFO:tensorflow:loss = 15.07128, step = 821 (1.020 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.8869\n",
      "INFO:tensorflow:train_accuracy = 0.54681647, train_loss = 15.842185 (1.127 sec)\n",
      "INFO:tensorflow:loss = 15.842185, step = 822 (1.128 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.887404\n",
      "INFO:tensorflow:train_accuracy = 0.5692109, train_loss = 15.28551 (1.127 sec)\n",
      "INFO:tensorflow:loss = 15.28551, step = 823 (1.127 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.943772\n",
      "INFO:tensorflow:train_accuracy = 0.56865287, train_loss = 14.120282 (1.060 sec)\n",
      "INFO:tensorflow:loss = 14.120282, step = 824 (1.061 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.969623\n",
      "INFO:tensorflow:train_accuracy = 0.58111703, train_loss = 11.573641 (1.030 sec)\n",
      "INFO:tensorflow:loss = 11.573641, step = 825 (1.030 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.957143\n",
      "INFO:tensorflow:train_accuracy = 0.57235986, train_loss = 12.938631 (1.045 sec)\n",
      "INFO:tensorflow:loss = 12.938631, step = 826 (1.045 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.31802\n",
      "INFO:tensorflow:train_accuracy = 0.5613208, train_loss = 15.767737 (0.759 sec)\n",
      "INFO:tensorflow:loss = 15.767737, step = 827 (0.759 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.866719\n",
      "INFO:tensorflow:train_accuracy = 0.57030225, train_loss = 13.8952875 (1.153 sec)\n",
      "INFO:tensorflow:loss = 13.8952875, step = 828 (1.154 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.851241\n",
      "INFO:tensorflow:train_accuracy = 0.55443037, train_loss = 15.721734 (1.175 sec)\n",
      "INFO:tensorflow:loss = 15.721734, step = 829 (1.175 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.734938\n",
      "INFO:tensorflow:train_accuracy = 0.5303398, train_loss = 17.55504 (1.361 sec)\n",
      "INFO:tensorflow:loss = 17.55504, step = 830 (1.360 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.817281\n",
      "INFO:tensorflow:train_accuracy = 0.5538847, train_loss = 17.903376 (1.223 sec)\n",
      "INFO:tensorflow:loss = 17.903376, step = 831 (1.224 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.902129\n",
      "INFO:tensorflow:train_accuracy = 0.5790173, train_loss = 12.476826 (1.109 sec)\n",
      "INFO:tensorflow:loss = 12.476826, step = 832 (1.109 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.842264\n",
      "INFO:tensorflow:train_accuracy = 0.5714286, train_loss = 15.659996 (1.187 sec)\n",
      "INFO:tensorflow:loss = 15.659996, step = 833 (1.186 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.07349\n",
      "INFO:tensorflow:train_accuracy = 0.5754339, train_loss = 13.551231 (0.932 sec)\n",
      "INFO:tensorflow:loss = 13.551231, step = 834 (0.933 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.813567\n",
      "INFO:tensorflow:train_accuracy = 0.57197946, train_loss = 15.249568 (1.229 sec)\n",
      "INFO:tensorflow:loss = 15.249568, step = 835 (1.229 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.706713\n",
      "INFO:tensorflow:train_accuracy = 0.5374065, train_loss = 16.710392 (1.415 sec)\n",
      "INFO:tensorflow:loss = 16.710392, step = 836 (1.415 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.918437\n",
      "INFO:tensorflow:train_accuracy = 0.56842107, train_loss = 13.859966 (1.089 sec)\n",
      "INFO:tensorflow:loss = 13.859966, step = 837 (1.089 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.871712\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "INFO:tensorflow:train_accuracy = 0.59485096, train_loss = 11.138513 (1.147 sec)\n",
      "INFO:tensorflow:loss = 11.138513, step = 838 (1.148 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.05258\n",
      "INFO:tensorflow:train_accuracy = 0.57310706, train_loss = 13.151548 (0.950 sec)\n",
      "INFO:tensorflow:loss = 13.151548, step = 839 (0.950 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.00084\n",
      "INFO:tensorflow:train_accuracy = 0.550447, train_loss = 17.080982 (0.999 sec)\n",
      "INFO:tensorflow:loss = 17.080982, step = 840 (0.999 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.993625\n",
      "INFO:tensorflow:train_accuracy = 0.5727637, train_loss = 13.957576 (1.006 sec)\n",
      "INFO:tensorflow:loss = 13.957576, step = 841 (1.006 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.00855\n",
      "INFO:tensorflow:train_accuracy = 0.5867209, train_loss = 12.522627 (0.992 sec)\n",
      "INFO:tensorflow:loss = 12.522627, step = 842 (0.992 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.960574\n",
      "INFO:tensorflow:train_accuracy = 0.5549872, train_loss = 14.006372 (1.041 sec)\n",
      "INFO:tensorflow:loss = 14.006372, step = 843 (1.041 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.0218\n",
      "INFO:tensorflow:train_accuracy = 0.5602564, train_loss = 17.180967 (0.979 sec)\n",
      "INFO:tensorflow:loss = 17.180967, step = 844 (0.979 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.0993\n",
      "INFO:tensorflow:train_accuracy = 0.5541069, train_loss = 12.177086 (0.910 sec)\n",
      "INFO:tensorflow:loss = 12.177086, step = 845 (0.910 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.01374\n",
      "INFO:tensorflow:train_accuracy = 0.56072354, train_loss = 11.709282 (0.986 sec)\n",
      "INFO:tensorflow:loss = 11.709282, step = 846 (0.985 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.739205\n",
      "INFO:tensorflow:train_accuracy = 0.57009345, train_loss = 13.133412 (1.354 sec)\n",
      "INFO:tensorflow:loss = 13.133412, step = 847 (1.354 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.826692\n",
      "INFO:tensorflow:train_accuracy = 0.53634083, train_loss = 16.289818 (1.209 sec)\n",
      "INFO:tensorflow:loss = 16.289818, step = 848 (1.209 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.03516\n",
      "INFO:tensorflow:train_accuracy = 0.58311343, train_loss = 13.734402 (0.966 sec)\n",
      "INFO:tensorflow:loss = 13.734402, step = 849 (0.966 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.953268\n",
      "INFO:tensorflow:train_accuracy = 0.5760309, train_loss = 15.268908 (1.049 sec)\n",
      "INFO:tensorflow:loss = 15.268908, step = 850 (1.049 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.18807\n",
      "INFO:tensorflow:train_accuracy = 0.5749674, train_loss = 14.867628 (0.842 sec)\n",
      "INFO:tensorflow:loss = 14.867628, step = 851 (0.842 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.922788\n",
      "INFO:tensorflow:train_accuracy = 0.5729167, train_loss = 13.633532 (1.084 sec)\n",
      "INFO:tensorflow:loss = 13.633532, step = 852 (1.083 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.01364\n",
      "INFO:tensorflow:train_accuracy = 0.5675676, train_loss = 14.469752 (0.986 sec)\n",
      "INFO:tensorflow:loss = 14.469752, step = 853 (0.986 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.07862\n",
      "INFO:tensorflow:train_accuracy = 0.564409, train_loss = 12.422001 (0.927 sec)\n",
      "INFO:tensorflow:loss = 12.422001, step = 854 (0.927 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.809199\n",
      "INFO:tensorflow:train_accuracy = 0.5676741, train_loss = 14.277401 (1.236 sec)\n",
      "INFO:tensorflow:loss = 14.277401, step = 855 (1.236 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.849334\n",
      "INFO:tensorflow:train_accuracy = 0.562341, train_loss = 17.956543 (1.177 sec)\n",
      "INFO:tensorflow:loss = 17.956543, step = 856 (1.177 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.975476\n",
      "INFO:tensorflow:train_accuracy = 0.54037267, train_loss = 15.626456 (1.025 sec)\n",
      "INFO:tensorflow:loss = 15.626456, step = 857 (1.025 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.792493\n",
      "INFO:tensorflow:train_accuracy = 0.5706806, train_loss = 15.174131 (1.262 sec)\n",
      "INFO:tensorflow:loss = 15.174131, step = 858 (1.262 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.04072\n",
      "INFO:tensorflow:train_accuracy = 0.56072354, train_loss = 15.494926 (0.961 sec)\n",
      "INFO:tensorflow:loss = 15.494926, step = 859 (0.960 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.843589\n",
      "INFO:tensorflow:train_accuracy = 0.57509625, train_loss = 14.865259 (1.185 sec)\n",
      "INFO:tensorflow:loss = 14.865259, step = 860 (1.185 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.887542\n",
      "INFO:tensorflow:train_accuracy = 0.5611867, train_loss = 15.883445 (1.127 sec)\n",
      "INFO:tensorflow:loss = 15.883445, step = 861 (1.128 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.942407\n",
      "INFO:tensorflow:train_accuracy = 0.57275134, train_loss = 12.315085 (1.061 sec)\n",
      "INFO:tensorflow:loss = 12.315085, step = 862 (1.060 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.779554\n",
      "INFO:tensorflow:train_accuracy = 0.5368421, train_loss = 18.607311 (1.283 sec)\n",
      "INFO:tensorflow:loss = 18.607311, step = 863 (1.283 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.02248\n",
      "INFO:tensorflow:train_accuracy = 0.5647668, train_loss = 16.34439 (0.978 sec)\n",
      "INFO:tensorflow:loss = 16.34439, step = 864 (0.978 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.873253\n",
      "INFO:tensorflow:train_accuracy = 0.5565438, train_loss = 15.314417 (1.145 sec)\n",
      "INFO:tensorflow:loss = 15.314417, step = 865 (1.145 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.03695\n",
      "INFO:tensorflow:train_accuracy = 0.5592357, train_loss = 14.891413 (0.966 sec)\n",
      "INFO:tensorflow:loss = 14.891413, step = 866 (0.966 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.936163\n",
      "INFO:tensorflow:train_accuracy = 0.57198954, train_loss = 14.371914 (1.067 sec)\n",
      "INFO:tensorflow:loss = 14.371914, step = 867 (1.066 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.89707\n",
      "INFO:tensorflow:train_accuracy = 0.5547074, train_loss = 14.282541 (1.115 sec)\n",
      "INFO:tensorflow:loss = 14.282541, step = 868 (1.115 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.907844\n",
      "INFO:tensorflow:train_accuracy = 0.56363636, train_loss = 13.74185 (1.102 sec)\n",
      "INFO:tensorflow:loss = 13.74185, step = 869 (1.102 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.933873\n",
      "INFO:tensorflow:train_accuracy = 0.54534006, train_loss = 15.017165 (1.071 sec)\n",
      "INFO:tensorflow:loss = 15.017165, step = 870 (1.070 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.00247\n",
      "INFO:tensorflow:train_accuracy = 0.5956873, train_loss = 11.963503 (0.998 sec)\n",
      "INFO:tensorflow:loss = 11.963503, step = 871 (0.998 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.945568\n",
      "INFO:tensorflow:train_accuracy = 0.58145696, train_loss = 9.716019 (1.057 sec)\n",
      "INFO:tensorflow:loss = 9.716019, step = 872 (1.057 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.02823\n",
      "INFO:tensorflow:train_accuracy = 0.5943396, train_loss = 13.010735 (0.973 sec)\n",
      "INFO:tensorflow:loss = 13.010735, step = 873 (0.973 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.884539\n",
      "INFO:tensorflow:train_accuracy = 0.5797101, train_loss = 13.780327 (1.130 sec)\n",
      "INFO:tensorflow:loss = 13.780327, step = 874 (1.130 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.747235\n",
      "INFO:tensorflow:train_accuracy = 0.5365854, train_loss = 17.764172 (1.338 sec)\n",
      "INFO:tensorflow:loss = 17.764172, step = 875 (1.338 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.844598\n",
      "INFO:tensorflow:train_accuracy = 0.5525, train_loss = 14.900069 (1.184 sec)\n",
      "INFO:tensorflow:loss = 14.900069, step = 876 (1.184 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.951345\n",
      "INFO:tensorflow:train_accuracy = 0.5505762, train_loss = 16.176914 (1.051 sec)\n",
      "INFO:tensorflow:loss = 16.176914, step = 877 (1.052 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.837389\n",
      "INFO:tensorflow:train_accuracy = 0.568299, train_loss = 14.694674 (1.194 sec)\n",
      "INFO:tensorflow:loss = 14.694674, step = 878 (1.193 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.903178\n",
      "INFO:tensorflow:train_accuracy = 0.57667106, train_loss = 13.850124 (1.107 sec)\n",
      "INFO:tensorflow:loss = 13.850124, step = 879 (1.107 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.888586\n",
      "INFO:tensorflow:train_accuracy = 0.56046814, train_loss = 13.673149 (1.126 sec)\n",
      "INFO:tensorflow:loss = 13.673149, step = 880 (1.126 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.861396\n",
      "INFO:tensorflow:train_accuracy = 0.575, train_loss = 13.143038 (1.161 sec)\n",
      "INFO:tensorflow:loss = 13.143038, step = 881 (1.160 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.757372\n",
      "INFO:tensorflow:train_accuracy = 0.54854983, train_loss = 15.15774 (1.321 sec)\n",
      "INFO:tensorflow:loss = 15.15774, step = 882 (1.321 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.862929\n",
      "INFO:tensorflow:train_accuracy = 0.59574467, train_loss = 14.092955 (1.159 sec)\n",
      "INFO:tensorflow:loss = 14.092955, step = 883 (1.159 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.726669\n",
      "INFO:tensorflow:train_accuracy = 0.59012014, train_loss = 12.156118 (1.378 sec)\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "INFO:tensorflow:loss = 12.156118, step = 884 (1.380 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.942727\n",
      "INFO:tensorflow:train_accuracy = 0.56178343, train_loss = 14.448498 (1.058 sec)\n",
      "INFO:tensorflow:loss = 14.448498, step = 885 (1.056 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.00715\n",
      "INFO:tensorflow:train_accuracy = 0.583668, train_loss = 12.270889 (0.993 sec)\n",
      "INFO:tensorflow:loss = 12.270889, step = 886 (0.993 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.00063\n",
      "INFO:tensorflow:train_accuracy = 0.5693904, train_loss = 14.100239 (0.999 sec)\n",
      "INFO:tensorflow:loss = 14.100239, step = 887 (1.000 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.04894\n",
      "INFO:tensorflow:train_accuracy = 0.57894737, train_loss = 14.501066 (0.953 sec)\n",
      "INFO:tensorflow:loss = 14.501066, step = 888 (0.953 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.872703\n",
      "INFO:tensorflow:train_accuracy = 0.55307996, train_loss = 14.033871 (1.146 sec)\n",
      "INFO:tensorflow:loss = 14.033871, step = 889 (1.147 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.970596\n",
      "INFO:tensorflow:train_accuracy = 0.55886155, train_loss = 14.993355 (1.030 sec)\n",
      "INFO:tensorflow:loss = 14.993355, step = 890 (1.030 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.04166\n",
      "INFO:tensorflow:train_accuracy = 0.5706737, train_loss = 12.4659815 (0.960 sec)\n",
      "INFO:tensorflow:loss = 12.4659815, step = 891 (0.960 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.906621\n",
      "INFO:tensorflow:train_accuracy = 0.58203125, train_loss = 12.012223 (1.103 sec)\n",
      "INFO:tensorflow:loss = 12.012223, step = 892 (1.103 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.906138\n",
      "INFO:tensorflow:train_accuracy = 0.5905405, train_loss = 12.008569 (1.104 sec)\n",
      "INFO:tensorflow:loss = 12.008569, step = 893 (1.104 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.968714\n",
      "INFO:tensorflow:train_accuracy = 0.5690537, train_loss = 13.603962 (1.032 sec)\n",
      "INFO:tensorflow:loss = 13.603962, step = 894 (1.032 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.00034\n",
      "INFO:tensorflow:train_accuracy = 0.5585242, train_loss = 13.466753 (1.000 sec)\n",
      "INFO:tensorflow:loss = 13.466753, step = 895 (0.999 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.955931\n",
      "INFO:tensorflow:train_accuracy = 0.57712084, train_loss = 14.899624 (1.046 sec)\n",
      "INFO:tensorflow:loss = 14.899624, step = 896 (1.045 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.819409\n",
      "INFO:tensorflow:train_accuracy = 0.56640625, train_loss = 13.935417 (1.221 sec)\n",
      "INFO:tensorflow:loss = 13.935417, step = 897 (1.221 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.01974\n",
      "INFO:tensorflow:train_accuracy = 0.60816324, train_loss = 11.923493 (0.980 sec)\n",
      "INFO:tensorflow:loss = 11.923493, step = 898 (0.980 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.04049\n",
      "INFO:tensorflow:train_accuracy = 0.58721703, train_loss = 12.818347 (0.961 sec)\n",
      "INFO:tensorflow:loss = 12.818347, step = 899 (0.961 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.990194\n",
      "INFO:tensorflow:train_accuracy = 0.5500634, train_loss = 13.778825 (1.010 sec)\n",
      "INFO:tensorflow:loss = 13.778825, step = 900 (1.010 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.886522\n",
      "INFO:tensorflow:train_accuracy = 0.57272726, train_loss = 15.0962715 (1.127 sec)\n",
      "INFO:tensorflow:loss = 15.0962715, step = 901 (1.127 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.835242\n",
      "INFO:tensorflow:train_accuracy = 0.55246526, train_loss = 14.527213 (1.197 sec)\n",
      "INFO:tensorflow:loss = 14.527213, step = 902 (1.197 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.986942\n",
      "INFO:tensorflow:train_accuracy = 0.5431472, train_loss = 14.261709 (1.014 sec)\n",
      "INFO:tensorflow:loss = 14.261709, step = 903 (1.014 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.950404\n",
      "INFO:tensorflow:train_accuracy = 0.5409836, train_loss = 16.748726 (1.052 sec)\n",
      "INFO:tensorflow:loss = 16.748726, step = 904 (1.052 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.785202\n",
      "INFO:tensorflow:train_accuracy = 0.54140913, train_loss = 15.907484 (1.274 sec)\n",
      "INFO:tensorflow:loss = 15.907484, step = 905 (1.274 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.06961\n",
      "INFO:tensorflow:train_accuracy = 0.5714286, train_loss = 15.28573 (0.935 sec)\n",
      "INFO:tensorflow:loss = 15.28573, step = 906 (0.935 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.911448\n",
      "INFO:tensorflow:train_accuracy = 0.5558376, train_loss = 14.610781 (1.097 sec)\n",
      "INFO:tensorflow:loss = 14.610781, step = 907 (1.097 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.860222\n",
      "INFO:tensorflow:train_accuracy = 0.5477387, train_loss = 13.681062 (1.162 sec)\n",
      "INFO:tensorflow:loss = 13.681062, step = 908 (1.162 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.923245\n",
      "INFO:tensorflow:train_accuracy = 0.5717916, train_loss = 15.50106 (1.083 sec)\n",
      "INFO:tensorflow:loss = 15.50106, step = 909 (1.084 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.80758\n",
      "INFO:tensorflow:train_accuracy = 0.55822784, train_loss = 13.924526 (1.238 sec)\n",
      "INFO:tensorflow:loss = 13.924526, step = 910 (1.239 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.944753\n",
      "INFO:tensorflow:train_accuracy = 0.5578145, train_loss = 13.495176 (1.058 sec)\n",
      "INFO:tensorflow:loss = 13.495176, step = 911 (1.057 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.945676\n",
      "INFO:tensorflow:train_accuracy = 0.5821475, train_loss = 15.044226 (1.057 sec)\n",
      "INFO:tensorflow:loss = 15.044226, step = 912 (1.057 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.89386\n",
      "INFO:tensorflow:train_accuracy = 0.56632656, train_loss = 15.749572 (1.119 sec)\n",
      "INFO:tensorflow:loss = 15.749572, step = 913 (1.119 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.03861\n",
      "INFO:tensorflow:train_accuracy = 0.54892, train_loss = 15.681002 (0.963 sec)\n",
      "INFO:tensorflow:loss = 15.681002, step = 914 (0.963 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.940451\n",
      "INFO:tensorflow:train_accuracy = 0.56666666, train_loss = 13.77493 (1.063 sec)\n",
      "INFO:tensorflow:loss = 13.77493, step = 915 (1.064 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.905123\n",
      "INFO:tensorflow:train_accuracy = 0.5466999, train_loss = 14.950259 (1.104 sec)\n",
      "INFO:tensorflow:loss = 14.950259, step = 916 (1.104 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.961402\n",
      "INFO:tensorflow:train_accuracy = 0.6024423, train_loss = 11.82999 (1.040 sec)\n",
      "INFO:tensorflow:loss = 11.82999, step = 917 (1.040 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.998423\n",
      "INFO:tensorflow:train_accuracy = 0.590604, train_loss = 10.930278 (1.001 sec)\n",
      "INFO:tensorflow:loss = 10.930278, step = 918 (1.002 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.01421\n",
      "INFO:tensorflow:train_accuracy = 0.6113744, train_loss = 10.78392 (0.986 sec)\n",
      "INFO:tensorflow:loss = 10.78392, step = 919 (0.985 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.883395\n",
      "INFO:tensorflow:train_accuracy = 0.5823452, train_loss = 13.12158 (1.132 sec)\n",
      "INFO:tensorflow:loss = 13.12158, step = 920 (1.132 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.820165\n",
      "INFO:tensorflow:train_accuracy = 0.5500618, train_loss = 16.53991 (1.220 sec)\n",
      "INFO:tensorflow:loss = 16.53991, step = 921 (1.220 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.923688\n",
      "INFO:tensorflow:train_accuracy = 0.57289004, train_loss = 13.066168 (1.083 sec)\n",
      "INFO:tensorflow:loss = 13.066168, step = 922 (1.082 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.73589\n",
      "INFO:tensorflow:train_accuracy = 0.55316454, train_loss = 16.55934 (1.359 sec)\n",
      "INFO:tensorflow:loss = 16.55934, step = 923 (1.359 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.948863\n",
      "INFO:tensorflow:train_accuracy = 0.55455714, train_loss = 13.28755 (1.054 sec)\n",
      "INFO:tensorflow:loss = 13.28755, step = 924 (1.054 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.829001\n",
      "INFO:tensorflow:train_accuracy = 0.58181816, train_loss = 13.24023 (1.206 sec)\n",
      "INFO:tensorflow:loss = 13.24023, step = 925 (1.206 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.948113\n",
      "INFO:tensorflow:train_accuracy = 0.54854983, train_loss = 16.424131 (1.055 sec)\n",
      "INFO:tensorflow:loss = 16.424131, step = 926 (1.054 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.83156\n",
      "INFO:tensorflow:train_accuracy = 0.57682294, train_loss = 14.975836 (1.203 sec)\n",
      "INFO:tensorflow:loss = 14.975836, step = 927 (1.203 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.92375\n",
      "INFO:tensorflow:train_accuracy = 0.5721716, train_loss = 12.695242 (1.082 sec)\n",
      "INFO:tensorflow:loss = 12.695242, step = 928 (1.082 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.966324\n",
      "INFO:tensorflow:train_accuracy = 0.56453717, train_loss = 14.540112 (1.035 sec)\n",
      "INFO:tensorflow:loss = 14.540112, step = 929 (1.034 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.733814\n",
      "INFO:tensorflow:train_accuracy = 0.5797101, train_loss = 11.951895 (1.364 sec)\n",
      "INFO:tensorflow:loss = 11.951895, step = 930 (1.364 sec)\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "INFO:tensorflow:global_step/sec: 0.799852\n",
      "INFO:tensorflow:train_accuracy = 0.59180975, train_loss = 12.666111 (1.250 sec)\n",
      "INFO:tensorflow:loss = 12.666111, step = 931 (1.251 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.77951\n",
      "INFO:tensorflow:train_accuracy = 0.55096775, train_loss = 12.442856 (1.282 sec)\n",
      "INFO:tensorflow:loss = 12.442856, step = 932 (1.281 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.993531\n",
      "INFO:tensorflow:train_accuracy = 0.5834464, train_loss = 11.181839 (1.007 sec)\n",
      "INFO:tensorflow:loss = 11.181839, step = 933 (1.007 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.1213\n",
      "INFO:tensorflow:train_accuracy = 0.5935397, train_loss = 11.373243 (0.892 sec)\n",
      "INFO:tensorflow:loss = 11.373243, step = 934 (0.891 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.00127\n",
      "INFO:tensorflow:train_accuracy = 0.5515464, train_loss = 13.628035 (0.999 sec)\n",
      "INFO:tensorflow:loss = 13.628035, step = 935 (0.999 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.968463\n",
      "INFO:tensorflow:train_accuracy = 0.54850745, train_loss = 16.532986 (1.033 sec)\n",
      "INFO:tensorflow:loss = 16.532986, step = 936 (1.033 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.01635\n",
      "INFO:tensorflow:train_accuracy = 0.56992084, train_loss = 11.492384 (0.984 sec)\n",
      "INFO:tensorflow:loss = 11.492384, step = 937 (0.983 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.955298\n",
      "INFO:tensorflow:train_accuracy = 0.579085, train_loss = 11.240776 (1.047 sec)\n",
      "INFO:tensorflow:loss = 11.240776, step = 938 (1.047 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.918278\n",
      "INFO:tensorflow:train_accuracy = 0.556701, train_loss = 12.968741 (1.089 sec)\n",
      "INFO:tensorflow:loss = 12.968741, step = 939 (1.089 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.01055\n",
      "INFO:tensorflow:train_accuracy = 0.5945578, train_loss = 11.311161 (0.990 sec)\n",
      "INFO:tensorflow:loss = 11.311161, step = 940 (0.990 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.93842\n",
      "INFO:tensorflow:train_accuracy = 0.5555556, train_loss = 13.623442 (1.065 sec)\n",
      "INFO:tensorflow:loss = 13.623442, step = 941 (1.065 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.823903\n",
      "INFO:tensorflow:train_accuracy = 0.56670904, train_loss = 14.851835 (1.213 sec)\n",
      "INFO:tensorflow:loss = 14.851835, step = 942 (1.213 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.854596\n",
      "INFO:tensorflow:train_accuracy = 0.57942706, train_loss = 13.067078 (1.171 sec)\n",
      "INFO:tensorflow:loss = 13.067078, step = 943 (1.171 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.982762\n",
      "INFO:tensorflow:train_accuracy = 0.5712401, train_loss = 12.513536 (1.018 sec)\n",
      "INFO:tensorflow:loss = 12.513536, step = 944 (1.018 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.990149\n",
      "INFO:tensorflow:train_accuracy = 0.5897772, train_loss = 12.225878 (1.010 sec)\n",
      "INFO:tensorflow:loss = 12.225878, step = 945 (1.010 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.905826\n",
      "INFO:tensorflow:train_accuracy = 0.5855263, train_loss = 11.334141 (1.104 sec)\n",
      "INFO:tensorflow:loss = 11.334141, step = 946 (1.104 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.824355\n",
      "INFO:tensorflow:train_accuracy = 0.58723956, train_loss = 14.204765 (1.213 sec)\n",
      "INFO:tensorflow:loss = 14.204765, step = 947 (1.213 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.84392\n",
      "INFO:tensorflow:train_accuracy = 0.56760204, train_loss = 12.591412 (1.185 sec)\n",
      "INFO:tensorflow:loss = 12.591412, step = 948 (1.185 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.08456\n",
      "INFO:tensorflow:train_accuracy = 0.5588235, train_loss = 14.702038 (0.922 sec)\n",
      "INFO:tensorflow:loss = 14.702038, step = 949 (0.922 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.877482\n",
      "INFO:tensorflow:train_accuracy = 0.56131476, train_loss = 15.699238 (1.140 sec)\n",
      "INFO:tensorflow:loss = 15.699238, step = 950 (1.139 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.819942\n",
      "INFO:tensorflow:train_accuracy = 0.5594493, train_loss = 15.593314 (1.220 sec)\n",
      "INFO:tensorflow:loss = 15.593314, step = 951 (1.220 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.917677\n",
      "INFO:tensorflow:train_accuracy = 0.55754477, train_loss = 13.824434 (1.090 sec)\n",
      "INFO:tensorflow:loss = 13.824434, step = 952 (1.090 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.865841\n",
      "INFO:tensorflow:train_accuracy = 0.5609453, train_loss = 14.838942 (1.155 sec)\n",
      "INFO:tensorflow:loss = 14.838942, step = 953 (1.155 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.917208\n",
      "INFO:tensorflow:train_accuracy = 0.5606258, train_loss = 12.514818 (1.090 sec)\n",
      "INFO:tensorflow:loss = 12.514818, step = 954 (1.089 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.818175\n",
      "INFO:tensorflow:train_accuracy = 0.5726817, train_loss = 15.698818 (1.223 sec)\n",
      "INFO:tensorflow:loss = 15.698818, step = 955 (1.223 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.908359\n",
      "INFO:tensorflow:train_accuracy = 0.5354523, train_loss = 14.089754 (1.101 sec)\n",
      "INFO:tensorflow:loss = 14.089754, step = 956 (1.101 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.922932\n",
      "INFO:tensorflow:train_accuracy = 0.57015306, train_loss = 12.509033 (1.083 sec)\n",
      "INFO:tensorflow:loss = 12.509033, step = 957 (1.083 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.869022\n",
      "INFO:tensorflow:train_accuracy = 0.5936255, train_loss = 12.90781 (1.151 sec)\n",
      "INFO:tensorflow:loss = 12.90781, step = 958 (1.150 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.04262\n",
      "INFO:tensorflow:train_accuracy = 0.5814863, train_loss = 13.863123 (0.959 sec)\n",
      "INFO:tensorflow:loss = 13.863123, step = 959 (0.959 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.906985\n",
      "INFO:tensorflow:train_accuracy = 0.5748731, train_loss = 14.458937 (1.103 sec)\n",
      "INFO:tensorflow:loss = 14.458937, step = 960 (1.103 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.932687\n",
      "INFO:tensorflow:train_accuracy = 0.56850195, train_loss = 12.699983 (1.072 sec)\n",
      "INFO:tensorflow:loss = 12.699983, step = 961 (1.072 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.906813\n",
      "INFO:tensorflow:train_accuracy = 0.57197946, train_loss = 15.0282135 (1.103 sec)\n",
      "INFO:tensorflow:loss = 15.0282135, step = 962 (1.103 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.04993\n",
      "INFO:tensorflow:train_accuracy = 0.5809906, train_loss = 12.124424 (0.953 sec)\n",
      "INFO:tensorflow:loss = 12.124424, step = 963 (0.953 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.93327\n",
      "INFO:tensorflow:train_accuracy = 0.5782665, train_loss = 12.843941 (1.071 sec)\n",
      "INFO:tensorflow:loss = 12.843941, step = 964 (1.071 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.11891\n",
      "INFO:tensorflow:train_accuracy = 0.5849057, train_loss = 9.730123 (0.894 sec)\n",
      "INFO:tensorflow:loss = 9.730123, step = 965 (0.893 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.843161\n",
      "INFO:tensorflow:train_accuracy = 0.5628272, train_loss = 12.430381 (1.186 sec)\n",
      "INFO:tensorflow:loss = 12.430381, step = 966 (1.186 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.873657\n",
      "INFO:tensorflow:train_accuracy = 0.55778897, train_loss = 13.891502 (1.144 sec)\n",
      "INFO:tensorflow:loss = 13.891502, step = 967 (1.144 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.807916\n",
      "INFO:tensorflow:train_accuracy = 0.5552732, train_loss = 14.597667 (1.238 sec)\n",
      "INFO:tensorflow:loss = 14.597667, step = 968 (1.238 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.70796\n",
      "INFO:tensorflow:train_accuracy = 0.5365854, train_loss = 17.033922 (1.412 sec)\n",
      "INFO:tensorflow:loss = 17.033922, step = 969 (1.412 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.831392\n",
      "INFO:tensorflow:train_accuracy = 0.584399, train_loss = 13.4417515 (1.203 sec)\n",
      "INFO:tensorflow:loss = 13.4417515, step = 970 (1.203 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.881766\n",
      "INFO:tensorflow:train_accuracy = 0.6026144, train_loss = 11.679662 (1.134 sec)\n",
      "INFO:tensorflow:loss = 11.679662, step = 971 (1.134 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.877037\n",
      "INFO:tensorflow:train_accuracy = 0.6016151, train_loss = 10.581368 (1.140 sec)\n",
      "INFO:tensorflow:loss = 10.581368, step = 972 (1.140 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.860029\n",
      "INFO:tensorflow:train_accuracy = 0.55359393, train_loss = 14.814686 (1.163 sec)\n",
      "INFO:tensorflow:loss = 14.814686, step = 973 (1.163 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.03232\n",
      "INFO:tensorflow:train_accuracy = 0.57894737, train_loss = 16.731169 (0.969 sec)\n",
      "INFO:tensorflow:loss = 16.731169, step = 974 (0.968 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.604915\n",
      "INFO:tensorflow:train_accuracy = 0.589404, train_loss = 12.913232 (1.653 sec)\n",
      "INFO:tensorflow:loss = 12.913232, step = 975 (1.654 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.831744\n",
      "INFO:tensorflow:train_accuracy = 0.597351, train_loss = 12.238621 (1.202 sec)\n",
      "INFO:tensorflow:loss = 12.238621, step = 976 (1.202 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.850776\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "INFO:tensorflow:train_accuracy = 0.56041133, train_loss = 13.191481 (1.176 sec)\n",
      "INFO:tensorflow:loss = 13.191481, step = 977 (1.176 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.992585\n",
      "INFO:tensorflow:train_accuracy = 0.5751634, train_loss = 12.413516 (1.007 sec)\n",
      "INFO:tensorflow:loss = 12.413516, step = 978 (1.007 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.02803\n",
      "INFO:tensorflow:train_accuracy = 0.56916994, train_loss = 11.784748 (0.973 sec)\n",
      "INFO:tensorflow:loss = 11.784748, step = 979 (0.973 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.01501\n",
      "INFO:tensorflow:train_accuracy = 0.59517425, train_loss = 11.690419 (0.985 sec)\n",
      "INFO:tensorflow:loss = 11.690419, step = 980 (0.985 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.953915\n",
      "INFO:tensorflow:train_accuracy = 0.58431375, train_loss = 12.425091 (1.048 sec)\n",
      "INFO:tensorflow:loss = 12.425091, step = 981 (1.048 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.914664\n",
      "INFO:tensorflow:train_accuracy = 0.55569464, train_loss = 13.486433 (1.093 sec)\n",
      "INFO:tensorflow:loss = 13.486433, step = 982 (1.092 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.04882\n",
      "INFO:tensorflow:train_accuracy = 0.56186867, train_loss = 11.830397 (0.954 sec)\n",
      "INFO:tensorflow:loss = 11.830397, step = 983 (0.954 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.910921\n",
      "INFO:tensorflow:train_accuracy = 0.58077437, train_loss = 12.427355 (1.098 sec)\n",
      "INFO:tensorflow:loss = 12.427355, step = 984 (1.098 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.927868\n",
      "INFO:tensorflow:train_accuracy = 0.5833333, train_loss = 10.351383 (1.077 sec)\n",
      "INFO:tensorflow:loss = 10.351383, step = 985 (1.077 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.871204\n",
      "INFO:tensorflow:train_accuracy = 0.57697284, train_loss = 13.665396 (1.148 sec)\n",
      "INFO:tensorflow:loss = 13.665396, step = 986 (1.148 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.96249\n",
      "INFO:tensorflow:train_accuracy = 0.56777495, train_loss = 12.562397 (1.039 sec)\n",
      "INFO:tensorflow:loss = 12.562397, step = 987 (1.039 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.03862\n",
      "INFO:tensorflow:train_accuracy = 0.57011795, train_loss = 10.877947 (0.963 sec)\n",
      "INFO:tensorflow:loss = 10.877947, step = 988 (0.963 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.886673\n",
      "INFO:tensorflow:train_accuracy = 0.56662357, train_loss = 11.572851 (1.128 sec)\n",
      "INFO:tensorflow:loss = 11.572851, step = 989 (1.128 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.06809\n",
      "INFO:tensorflow:train_accuracy = 0.5913272, train_loss = 12.487019 (0.936 sec)\n",
      "INFO:tensorflow:loss = 12.487019, step = 990 (0.936 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.99813\n",
      "INFO:tensorflow:train_accuracy = 0.5997358, train_loss = 11.723013 (1.002 sec)\n",
      "INFO:tensorflow:loss = 11.723013, step = 991 (1.002 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.796056\n",
      "INFO:tensorflow:train_accuracy = 0.5779221, train_loss = 12.4041195 (1.256 sec)\n",
      "INFO:tensorflow:loss = 12.4041195, step = 992 (1.256 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.776081\n",
      "INFO:tensorflow:train_accuracy = 0.5775536, train_loss = 14.086004 (1.288 sec)\n",
      "INFO:tensorflow:loss = 14.086004, step = 993 (1.288 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.00499\n",
      "INFO:tensorflow:train_accuracy = 0.5675, train_loss = 14.009188 (0.995 sec)\n",
      "INFO:tensorflow:loss = 14.009188, step = 994 (0.995 sec)\n",
      "INFO:tensorflow:global_step/sec: 1.06611\n",
      "INFO:tensorflow:train_accuracy = 0.55949366, train_loss = 12.964697 (0.938 sec)\n",
      "INFO:tensorflow:loss = 12.964697, step = 995 (0.938 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.836157\n",
      "INFO:tensorflow:train_accuracy = 0.57329845, train_loss = 14.418991 (1.196 sec)\n",
      "INFO:tensorflow:loss = 14.418991, step = 996 (1.196 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.793998\n",
      "INFO:tensorflow:train_accuracy = 0.57253885, train_loss = 12.799741 (1.260 sec)\n",
      "INFO:tensorflow:loss = 12.799741, step = 997 (1.260 sec)\n",
      "INFO:tensorflow:global_step/sec: 0.901503\n",
      "INFO:tensorflow:train_accuracy = 0.5771725, train_loss = 12.880998 (1.109 sec)\n",
      "INFO:tensorflow:loss = 12.880998, step = 998 (1.108 sec)\n",
      "INFO:tensorflow:Saving checkpoints for 1000 into asr-cnn-rnn/model.ckpt.\n",
      "WARNING:tensorflow:From /home/husein/.local/lib/python3.6/site-packages/tensorflow_core/python/training/saver.py:963: remove_checkpoint (from tensorflow.python.training.checkpoint_management) is deprecated and will be removed in a future version.\n",
      "Instructions for updating:\n",
      "Use standard file APIs to delete files with this prefix.\n",
      "INFO:tensorflow:Calling model_fn.\n",
      "INFO:tensorflow:Done calling model_fn.\n",
      "INFO:tensorflow:Starting evaluation at 2020-10-25T19:12:56Z\n",
      "INFO:tensorflow:Graph was finalized.\n",
      "INFO:tensorflow:Restoring parameters from asr-cnn-rnn/model.ckpt-1000\n",
      "INFO:tensorflow:Running local_init_op.\n",
      "INFO:tensorflow:Done running local_init_op.\n",
      "INFO:tensorflow:Evaluation [1/10]\n",
      "INFO:tensorflow:Evaluation [2/10]\n",
      "INFO:tensorflow:Evaluation [3/10]\n",
      "INFO:tensorflow:Evaluation [4/10]\n",
      "INFO:tensorflow:Evaluation [5/10]\n",
      "INFO:tensorflow:Evaluation [6/10]\n",
      "INFO:tensorflow:Evaluation [7/10]\n",
      "INFO:tensorflow:Evaluation [8/10]\n",
      "INFO:tensorflow:Evaluation [9/10]\n",
      "INFO:tensorflow:Evaluation [10/10]\n",
      "INFO:tensorflow:Finished evaluation at 2020-10-25-19:13:01\n",
      "INFO:tensorflow:Saving dict for global step 1000: WER = 0.67441857, accuracy = 0.57055223, global_step = 1000, loss = 19.949492\n",
      "INFO:tensorflow:Saving 'checkpoint_path' summary for global step 1000: asr-cnn-rnn/model.ckpt-1000\n",
      "INFO:tensorflow:global_step/sec: 0.1146\n",
      "INFO:tensorflow:train_accuracy = 0.5528662, train_loss = 12.737193 (8.726 sec)\n",
      "INFO:tensorflow:loss = 12.737193, step = 999 (8.727 sec)\n",
      "INFO:tensorflow:Loss for final step: 12.737193.\n"
     ]
    }
   ],
   "source": [
    "train.run_training(\n",
    "    train_fn = train_dataset,\n",
    "    model_fn = model_fn,\n",
    "    model_dir = 'asr-cnn-rnn',\n",
    "    num_gpus = 1,\n",
    "    log_step = 1,\n",
    "    save_checkpoint_step = 200,\n",
    "    max_steps = train_steps,\n",
    "    eval_fn = dev_dataset,\n",
    "    train_hooks = train_hooks,\n",
    ")"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Reference\n",
    "\n",
    "1. Tensorflow models, https://github.com/tensorflow/models/blob/master/research/deep_speech/deep_speech_model.py"
   ]
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.7.7"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 2
}