Facenet: OutOfRangeError Again

Created on 14 Mar 2017  路  5Comments  路  Source: davidsandberg/facenet

Hi, I try to train a little set of images , like 12 images in 8 classes with command below:
python src/facenet_train_classifier.py --logs_base_dir ~/logs/facenet/ --models_base_dir ~/models/ --data_dir ~/FaceRecogn/facenet/data/lfw --image_size 250 --model_def models.inception_resnet_v1 --optimizer RMSPROP --learning_rate -1 --max_nrof_epochs 2 --keep_probability 0.8 --random_crop --random_flip --learning_rate_schedule_file data/learning_rate_schedule_classifier_casia.txt --weight_decay 5e-5 --center_loss_factor 1e-4 --center_loss_alfa 0.9 --batch_size 4

and get the error information below:
`Total number of classes: 8
Total number of examples: 12
Building training graph
W tensorflow/core/platform/cpu_feature_guard.cc:45] The TensorFlow library wasn't compiled to use SSE3 instructions, but these are available on your machine and could speed up CPU computations.
W tensorflow/core/platform/cpu_feature_guard.cc:45] The TensorFlow library wasn't compiled to use SSE4.1 instructions, but these are available on your machine and could speed up CPU computations.
W tensorflow/core/platform/cpu_feature_guard.cc:45] The TensorFlow library wasn't compiled to use SSE4.2 instructions, but these are available on your machine and could speed up CPU computations.
W tensorflow/core/platform/cpu_feature_guard.cc:45] The TensorFlow library wasn't compiled to use AVX instructions, but these are available on your machine and could speed up CPU computations.
W tensorflow/core/platform/cpu_feature_guard.cc:45] The TensorFlow library wasn't compiled to use AVX2 instructions, but these are available on your machine and could speed up CPU computations.
W tensorflow/core/platform/cpu_feature_guard.cc:45] The TensorFlow library wasn't compiled to use FMA instructions, but these are available on your machine and could speed up CPU computations.
Running training
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
W tensorflow/core/framework/op_kernel.cc:993] Out of range: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]
Traceback (most recent call last):
File "src/facenet_train_classifier.py", line 467, in
main(parse_arguments(sys.argv[1:]))
File "src/facenet_train_classifier.py", line 235, in main
total_loss, train_op, summary_op, summary_writer, regularization_losses, args.learning_rate_schedule_file)
File "src/facenet_train_classifier.py", line 303, in train
err, _, step, reg_loss, summary_str = sess.run([loss, train_op, global_step, regularization_losses, summary_op], feed_dict=feed_dict)
File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/client/session.py", line 767, in run
run_metadata_ptr)
File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/client/session.py", line 965, in _run
feed_dict_string, options, run_metadata)
File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/client/session.py", line 1015, in _do_run
target_list, options, run_metadata)
File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/client/session.py", line 1035, in _do_call
raise type(e)(node_def, op, message)
tensorflow.python.framework.errors_impl.OutOfRangeError: FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2[component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"](batch_join/fifo_queue, _recv_batch_size_0)]]

Caused by op u'batch_join', defined at:
File "src/facenet_train_classifier.py", line 467, in
main(parse_arguments(sys.argv[1:]))
File "src/facenet_train_classifier.py", line 144, in main
allow_smaller_final_batch=True)
File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/training/input.py", line 1018, in batch_join
name=name)
File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/training/input.py", line 700, in _batch_join
dequeued = queue.dequeue_up_to(batch_size, name=name)
File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/ops/data_flow_ops.py", line 510, in dequeue_up_to
self._queue_ref, n=n, component_types=self._dtypes, name=name)
File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/ops/gen_data_flow_ops.py", line 1402, in _queue_dequeue_up_to_v2
timeout_ms=timeout_ms, name=name)
File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/framework/op_def_library.py", line 763, in apply_op
op_def=op_def)
File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/framework/ops.py", line 2395, in create_op
original_op=self._default_original_op, op_def=op_def)
File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/framework/ops.py", line 1264, in __init__
self._traceback = _extract_stack()

OutOfRangeError (see above for traceback): FIFOQueue '_1_batch_join/fifo_queue' is closed and has insufficient elements (requested 4, current size 0)
[[Node: batch_join = QueueDequeueUpToV2component_types=[DT_FLOAT, DT_INT64], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"]]`

I tried --max_nrof_epochs 1 to 3 ,--batch_size 3 to 5, same thing happened.

anyone can help me?
Thanks !

Most helpful comment

jpg is not supported by the original code
check line 115 of facenet_train_classifier.py
change
"image = tf.image.decode_png(file_contents)"
to
"image = tf.image.decode_image(file_contents)"

All 5 comments

Check your image data directory first , is "FaceRecogn" a typo?
If not, check if it has correct structure(images within subfolders) and image format(.png).

@ugtony thanks for your reply. The data structure should be correct because the code can tell 'Total number of classes: 8
Total number of examples: 12', and the image format is .jpg, which should be supported i think.
Actually, the dataset is just the first 8 subfolders of lfw aligned with deep funneling .image size is 250.
the dataset link is http://vis-www.cs.umass.edu/lfw/lfw-deepfunneled.tgz

Hi @freesunshine,
Did you set epoch_size to something small?
Maybe you have to set nrof_preprocess_threads to one as well.
There is a test case in test/train_test.py that runs facenet_train_classifier.py with just a few examples. You can have a look at that.

                '--epoch_size', '1',
                '--max_nrof_epochs', '1',
                '--batch_size', '1',
                '--nrof_preprocess_threads', '1',

jpg is not supported by the original code
check line 115 of facenet_train_classifier.py
change
"image = tf.image.decode_png(file_contents)"
to
"image = tf.image.decode_image(file_contents)"

@jinglingzhua That's it! Thanks a lot!!
@ugtony Thank you.You've given the right answer but i didn't read the code carefully enough.
@davidsandberg Sorry for wasting your time considering you should be busy :),. thank you for sharing all of this.

Was this page helpful?
0 / 5 - 0 ratings