Cvat: Could not upload annotation for the task. Error: Request failed with status code 500. "KeyError: 'coco_instances'\n".

Created on 1 Sep 2020  路  12Comments  路  Source: openvinotoolkit/cvat

I am not able to upload annotations for any dataset expect CVAT for images.

I have created a dummy task with one image in it. I did one dummy annotation and dumped the annotation in COCO format.
When I try to upload the same dump again in the same task, it's showing the above-mentioned error.
P.S: Dumping and uploading annotations is working fine for CVAT for images format.

Expected Behaviour

Annotations Uploaded successfully

Current Behaviour

Could not upload annotation for the task 6
Error: Request failed with status code 500. "KeyError: 'coco_instances'\n".
image

Steps to Reproduce (for bugs)

  1. create task and upload an image.
  2. annotate and dump those annotations.
  3. upload the same dumped annotation in the same task.

The dumped COCO Json file looks like this:
{
"licenses": [
{
"name": "",
"id": 0,
"url": ""
}
],
"info": {
"contributor": "",
"date_created": "",
"description": "",
"url": "",
"version": "",
"year": ""
},
"categories": [
{
"id": 1,
"name": "A",
"supercategory": ""
},
{
"id": 2,
"name": "Z",
"supercategory": ""
},
{
"id": 3,
"name": "S",
"supercategory": ""
},
{
"id": 4,
"name": "C",
"supercategory": ""
}
],
"images": [
{
"id": 0,
"width": 256,
"height": 256,
"file_name": "2020168243_1_001.png",
"license": 0,
"flickr_url": "",
"coco_url": "",
"date_captured": 0
}
],
"annotations": [
{
"id": 1,
"image_id": 0,
"category_id": 1,
"segmentation": [
[
79.14,
48.11,
191.24,
48.11,
191.24,
150.9,
79.14,
150.9
]
],
"area": 11522.759000000002,
"bbox": [
79.14,
48.11,
112.10000000000001,
102.79
],
"iscrowd": 0
},
{
"id": 2,
"image_id": 0,
"category_id": 1,
"segmentation": [
[
60.91,
78.12,
207.89,
78.12,
207.89,
178.76,
60.91,
178.76
]
],
"area": 14792.067199999998,
"bbox": [
60.91,
78.12,
146.98,
100.63999999999999
],
"iscrowd": 0
}
]
}

I found the following in the server_cvat.log file.
[2020-09-01 11:26:53,329] INFO django.server: "PUT /api/v1/tasks/6/annotations?format=COCO%201.0 HTTP/1.1" 202 0
[2020-09-01 11:26:56,391] ERROR django.request: Internal Server Error: /api/v1/tasks/6/annotations
[2020-09-01 11:26:56,392] ERROR django.server: "PUT /api/v1/tasks/6/annotations?format=COCO%201.0 HTTP/1.1" 500 30

I inspected the error in Chrome dev tools. It's coming from line no 192 in cvat-app.tsx file

Thanks in advance

Most helpful comment

All 12 comments

Which CVAT version do you use?

Which CVAT version do you use?

1.0.0

Please run docker exec -it cvat bash -c 'python3 datumaro/datum.py --loglevel=debug -h' and check if there any import errors in the output.

Please run docker exec -it cvat bash -c 'python3 datumaro/datum.py --loglevel=debug -h' and check if there any import errors in the output.

Hey, thanks for replying. Actually I am running the app in developer mode. i.e (I followed the steps mentioned in contributing.md file) and running backend by selection server:debug in VS Code

Ok, then just run the command without docker. It feels like there is an issue with installation.

Ok, then just run the command without docker. It feels like there is an issue with installation.

I ran the above command and here's the output of the same.

(.env) somilshah:~/Desktop/medanta/cvat$ docker exec -it cvat bash -c 'python3 datumaro/datum.py --loglevel=debug -h'
2020-09-02 15:43:29,880 DEBUG: Imported the following symbols from labelme_format.py: LabelMeConverter, LabelMeExtractor, LabelMeImporter
2020-09-02 15:43:29,881 DEBUG: Imported the following symbols from datumaro_format.format.py:
2020-09-02 15:43:29,881 DEBUG: Imported the following symbols from datumaro_format.extractor.py: DatumaroExtractor
2020-09-02 15:43:29,882 DEBUG: Imported the following symbols from datumaro_format.__init__.py:
2020-09-02 15:43:29,883 DEBUG: Imported the following symbols from datumaro_format.converter.py: DatumaroConverter, DatumaroProjectConverter
2020-09-02 15:43:29,883 DEBUG: Imported the following symbols from datumaro_format.importer.py: DatumaroImporter
2020-09-02 15:43:29,885 DEBUG: Imported the following symbols from mot_format.py: MotSeqExtractor, MotSeqGtConverter, MotSeqImporter
2020-09-02 15:43:29,885 DEBUG: Imported the following symbols from coco_format.format.py:
2020-09-02 15:43:29,939 DEBUG: $HOME=/home/django
2020-09-02 15:43:29,939 DEBUG: CONFIGDIR=/home/django/.config/matplotlib
2020-09-02 15:43:29,939 DEBUG: matplotlib data path: /usr/local/lib/python3.5/dist-packages/matplotlib/mpl-data
2020-09-02 15:43:29,943 DEBUG: loaded rc file /usr/local/lib/python3.5/dist-packages/matplotlib/mpl-data/matplotlibrc
2020-09-02 15:43:29,945 DEBUG: matplotlib version 3.0.3
2020-09-02 15:43:29,945 DEBUG: interactive is False
2020-09-02 15:43:29,946 DEBUG: platform is linux
2020-09-02 15:43:29,946 DEBUG: loaded modules: ['tensorboardX', 'xml.parsers.expat.errors', 'numpy.fft.fftpack', 'tensorboardX.onnx_graph', 'git.objects.commit', 'tensorboardX.proto.tensor_pb2', 'matplotlib.fontconfig_pattern', 'distutils', 'numpy.lib.type_check', 'numpy', 'git.index.typ', 'datumaro_format.format', 'numpy.core.function_base', '_posixsubprocess', 'datetime', 'pkg_resources.extern', 'tensorboardX.proto.resource_handle_pb2', 'datumaro.components.converter', 'pkg_resources.extern.packaging._compat', '_weakrefset', 'email.charset', 'git.refs.tag', 'git.index.base', 'tensorboardX.visdom_writer', 'yaml.tokens', 'site', 'numpy._globals', 'grp', 'gitdb.db', '_warnings', 'numpy.version', 'numpy.lib.histograms', 'numpy.testing', 'numpy.ma', 'pkg_resources.py2_warn', 'git.repo', 'numpy.core._type_aliases', '_sitebuiltins', 'collections', 'reprlib', 'numpy.fft.fftpack_lite', 'cv2.Error', 'xml.parsers.expat.model', 'numpy.core.shape_base', 'google.protobuf.message_factory', 'zlib', 'tensorboardX.summary', 'struct', 'tensorboardX.proto.node_def_pb2', 'csv', 'mmap', 'git.db', 'xml.etree.ElementTree', 'defusedxml.common', 'ast', 'git.objects.fun', 'copy', 'cython_runtime', 'locale', 'unittest.runner', 'gc', '_ssl', 'smmap.util', 'fnmatch', 'datumaro.cli.commands.export', 'numpy.random', 'subprocess', 'git.refs.reference', 'yaml.dumper', '_struct', '__main__', 'git.objects.base', 'datumaro.cli.contexts.item', 'numpy.linalg.info', '_opcode', 'genericpath', 'google.protobuf.message', 'numpy.polynomial.legendre', 'mtrand', 'importlib._bootstrap_external', 'numpy.polynomial.laguerre', 'urllib.response', 'google.protobuf.pyext', 'gitdb.fun', '_hashlib', 'gitdb.base', 'cv2.cv2', 'tensorboardX.proto.step_stats_pb2', 'git.config', 'datumaro.cli.commands', 'encodings.latin_1', 'numpy.core.einsumfunc', 'git.repo.fun', 'encodings.utf_8', 'tensorboardX.crc32c', 'yaml.parser', 'json.scanner', 'datumaro.cli.commands.explain', 'http.client', 'google.protobuf', 'pkg_resources._vendor.six.moves', 'importlib.util', 'tensorboardX.proto.types_pb2', 'numpy.lib._iotools', 'pkgutil', 'gitdb.typ', 'pkg_resources._vendor.six.moves.urllib', 'numpy.lib.format', 'datumaro.components.comparator', 'google.protobuf.internal.enum_type_wrapper', 'git.remote', 'tensorboardX.proto.versions_pb2', 'abc', 'yaml.representer', 'pkg_resources._vendor.appdirs', 'unittest.util', '_functools', 'inspect', 'lzma', 'cycler', 'numpy.lib.scimath', 'datumaro.cli.contexts.project.diff', 'pkg_resources', 'email.utils', 'xml.parsers.expat', 'numpy.polynomial', 'git', 'functools', 'http', 'builtins', 'opcode', 'tensorboardX.pytorch_graph', 'importlib', '_ctypes', 'sre_constants', 'gitdb.db.git', 'warnings', 'numpy.linalg.lapack_lite', 'collections.abc', 'numpy.ma.core', 'email._encoded_words', 'numpy.testing._private', 'ipaddress', 'importlib.machinery', 'enum', 'smmap.mman', 'encodings.aliases', 'google.protobuf.internal.well_known_types', 'tensorboardX.x2num', 'gzip', 'bisect', 'numpy.core.machar', 'email.parser', 'heapq', 'select', 'pkg_resources.extern.packaging.markers', 'git.objects.tree', 'numpy.lib.ufunclike', 'tensorboardX.proto.event_pb2', 'smmap.buf', 'ruamel', 'operator', 'email.message', 'weakref', 'datumaro.cli.contexts.source', 'pycocotools.mask', 'datumaro.cli.__main__', '_pickle', 'xml.parsers', '_signal', 'pkg_resources.extern.packaging.specifiers', 'git.index', 'numpy.core.records', 'importlib._bootstrap', 'glob', 'shutil', 'datumaro.components.config_model', 'cv2.fisheye', 'datumaro.components.cli_plugin', 'datumaro.cli.util.project', 'pkg_resources.extern.six.moves.urllib', 'gitdb.stream', 'datumaro.components.launcher', 'pkg_resources._vendor.packaging', 'cv2.ipp', '_codecs', 'git.objects.submodule.util', 'six', 'yaml.scanner', 'posixpath', '_ast', 'numpy.lib.stride_tricks', '_operator', 'email.errors', 'threading', 'lxml', 'logging', 'datumaro.util', 'tensorboardX.proto.summary_pb2', 'numpy.linalg.linalg', 'google.protobuf.reflection', 'pkg_resources._vendor', 'gitdb.db.base', 'email.header', 'numpy.core.arrayprint', 'numpy._distributor_init', 'cv2.samples', 'numpy.core.memmap', 'git.util', 'cv2.ocl', 'cv2.cuda', 'matplotlib', 'datumaro_format', 'decimal', 'yaml.resolver', 'smmap', 'datumaro.components.config', 'numpy.matrixlib.defmatrix', 'gitdb', 'google.protobuf.pyext._message', 'numpy.ma.extras', '_frozen_importlib_external', '_weakref', 'numpy.ctypeslib', '_bisect', 'datumaro.util.image', 'git.objects.tag', 'yaml', 'gitdb.const', 'google.protobuf.descriptor_database', 'email.iterators', 'gitdb.db.pack', 'pkg_resources.extern.six', 'unittest.case', 'numpy.core._internal', 'dateutil._version', 'token', 'textwrap', 'cv2.utils', 'pkg_resources.extern.pyparsing', 'types', 'google.protobuf.text_encoding', 'pyexpat.model', 'numpy.core.multiarray', 'numpy.linalg', 'yaml.composer', 'ssl', 'tensorboardX.proto.plugin_mesh_pb2', 'urllib', 'numpy.core._multiarray_umath', 'numpy.lib', 'pkg_resources._vendor.six', 'datumaro.util.mask_tools', 'tensorboardX.proto', 'xml.etree', '_datetime', 'datumaro.cli.commands.add', 'pathlib', 'json.decoder', 'uu', 'numpy.lib.shape_base', '__future__', 'numpy.lib.polynomial', 'urllib.parse', 'quopri', 'pkg_resources.extern.appdirs', 'coco_format', 'six.moves', 'datumaro.cli.contexts.model', 'numpy.core._dtype_ctypes', 'argparse', 'cv2.dnn', 'marshal', 'posix', 'json.encoder', 'numpy.lib.npyio', 'matplotlib.colors', 'matplotlib.cbook.deprecation', 'gitdb.util', 'string', 'atexit', 'git.exc', 'base64', 'yaml.error', '_thread', '_lzma', 'gettext', 'datumaro.components.project', '_collections_abc', 'ctypes', 'cv2.videoio_registry', '_csv', 'matplotlib.rcsetup', 'dateutil', 'numpy.core.info', 'numbers', '_locale', 'copyreg', 'tarfile', 'gitdb.utils.encoding', 'io', 'numpy.polynomial.hermite_e', 'numpy.compat', 'numpy.lib.utils', 'google.protobuf.descriptor_pool', 'urllib.request', '_socket', 'configparser', 'cv2.data', 'unittest', 'gitdb.exc', 'numpy.polynomial._polybase', '_heapq', 'tensorboardX.record_writer', 'numpy.linalg._umath_linalg', 'google', 'numpy.lib.financial', 'numpy.core.umath', 'random', 'gitdb.db.ref', '_sysconfigdata', 'sitecustomize', 'tensorboardX.embedding', 'git.refs.symbolic', 'cv2', 'socket', 'pyparsing', 'pkg_resources.extern.packaging', 'git.refs.log', 'time', 'google.protobuf.internal.containers', 'xml.etree.ElementPath', 'tensorboardX.proto.plugin_text_pb2', 'numpy.fft.helper', 'yaml.serializer', 'git.refs.remote', 'numpy.core', 'difflib', 'urllib.error', 'tensorboardX.utils', 'numpy.lib.twodim_base', 'numpy.core._dtype', 'email.encoders', 'datumaro.cli.util', '_bz2', '_cython_0_29_13', 'numpy.testing._private.decorators', 'pprint', 'unittest.suite', 'numpy.lib.info', 'uuid', 'email.feedparser', 'numpy.fft.info', 'gitdb.pack', 'datumaro.cli.contexts', 'pkg_resources.extern.packaging.version', 'unittest.main', 'git.objects', 'math', 'numpy.core.fromnumeric', 'pkg_resources.py31compat', 'git.objects.submodule.base', 'datumaro.components.extractor', '_compat_pickle', 'dis', '_compression', '_stat', 'datumaro.cli', 'errno', 'sre_compile', 'numpy.core.numerictypes', 'email._policybase', 'hashlib', 'tokenize', 'git.compat', 'selectors', 'mpl_toolkits', 'numpy.compat.py3k', 'gitdb.db.mem', 'pkg_resources.extern.packaging._structures', 'numpy.polynomial.polynomial', 'git.objects.blob', 'numpy.core.overrides', 'numpy.core._multiarray_tests', 'array', 'zipfile', 'email', 'tensorboardX.proto.graph_pb2', 'numpy.lib.index_tricks', 'numpy.lib.arraypad', 'linecache', 'tensorboardX.proto.attr_value_pb2', 'encodings', 'itertools', 'numpy.lib.nanfunctions', '_cython_0_29_18', 'tensorboardX.proto.layout_pb2', 'sysconfig', 'signal', 'tensorboardX.proto.plugin_pr_curve_pb2', 'yaml.reader', 'numpy.lib._datasource', 'mimetypes', 'codecs', 'defusedxml.ElementTree', '_sre', 'cv2.ml', '_string', 'tempfile', '_sysconfigdata_m', 'numpy.core.numeric', 'bz2', 're', 'lxml.etree', 'lxml._elementpath', 'git.diff', 'gitdb.utils', '_frozen_importlib', '_imp', 'yaml.loader', 'matplotlib.cbook', 'tensorboardX.writer', 'git.index.util', 'git.cmd', 'numpy.polynomial.polyutils', 'google.protobuf.descriptor', 'git.objects.submodule.root', 'git.objects.util', 'ctypes._endian', 'numpy.testing._private.nosetester', 'git.refs.head', 'yaml.emitter', 'pkg_resources.extern.six.moves', 'ctypes.util', 'numpy.testing._private.utils', 'calendar', 'pkg_resources._vendor.packaging.__about__', 'numpy.core._string_helpers', 'numpy.lib.mixins', 'numpy.matrixlib', 'yaml.constructor', 'importlib.abc', 'numpy._pytesttester', 'datumaro.cli.contexts.project', 'json', 'yaml.events', 'numpy.random.mtrand', 'cv2.detail', 'datumaro.util.image_cache', 'cv2.flann', 'yaml.nodes', 'datumaro.components.dataset_filter', 'tensorboardX.proto.tensor_shape_pb2', 'pycocotools._mask', 'datumaro.cli.commands.remove', 'contextlib', 'pwd', 'numpy.fft', 'google.protobuf.internal.api_implementation', 'termios', '_bootlocale', 'numpy.lib.arraysetops', 'pycocotools', 'git.objects.submodule', 'google.protobuf.internal._api_implementation', 'datumaro.util.command_targets', 'keyword', 'numpy.lib._version', '_collections', 'google.protobuf.pyext.cpp_message', 'numpy.core.defchararray', 'google.protobuf.internal', 'gitdb.db.loose', '_elementtree', 'git.index.fun', 'numpy.compat._inspect', 'unittest.loader', 'numpy.polynomial.hermite', 'cv2.ogl', 'pyexpat', 'xml', '_decimal', 'sys', 'numpy.polynomial.chebyshev', '_random', 'datumaro.version', 'coco_format.extractor', 'numpy.core._add_newdocs', 'numpy.lib.function_base', 'email.quoprimime', 'tensorboardX.torchvis', 'ntpath', 'sre_parse', 'datumaro', 'pycocotools.coco', 'platform', 'datumaro.cli.commands.create', 'numpy.core.getlimits', 'matplotlib._color_data', '_io', '_json', 'binascii', 'git.refs', 'git.repo.base', 'distutils.version', 'numpy.lib.arrayterator', 'email.base64mime', 'unittest.signals', 'defusedxml', 'plistlib', 'traceback', 'datumaro.components', 'numpy.core._methods', 'pkg_resources._vendor.pyparsing', 'pkg_resources.extern.packaging.requirements', 'zipimport', 'pyexpat.errors', 'getpass', 'unittest.result', 'tensorboardX.proto_graph', 'tensorboardX.event_file_writer', 'os', 'google.protobuf.symbol_database', 'pickle', 'stat', 'tensorboardX.openvino_graph', 'os.path', 'email._parseaddr', 'numpy.__config__', 'matplotlib._version']
2020-09-02 15:43:29,989 DEBUG: CACHEDIR=/home/django/.cache/matplotlib
2020-09-02 15:43:29,990 DEBUG: Using fontManager instance from /home/django/.cache/matplotlib/fontlist-v300.json
2020-09-02 15:43:30,112 DEBUG: Loaded backend qt5agg version unknown.
2020-09-02 15:43:30,140 DEBUG: Loaded backend agg version unknown.
2020-09-02 15:43:30,140 DEBUG: Loaded backend agg version unknown.
2020-09-02 15:43:30,145 DEBUG: Imported the following symbols from coco_format.extractor.py: CocoCaptionsExtractor, CocoImageInfoExtractor, CocoInstancesExtractor, CocoLabelsExtractor, CocoPersonKeypointsExtractor
2020-09-02 15:43:30,145 DEBUG: Imported the following symbols from coco_format.__init__.py:
2020-09-02 15:43:30,146 DEBUG: Imported the following symbols from coco_format.converter.py: CocoCaptionsConverter, CocoConverter, CocoImageInfoConverter, CocoInstancesConverter, CocoLabelsConverter, CocoPersonKeypointsConverter
2020-09-02 15:43:30,147 DEBUG: Imported the following symbols from coco_format.importer.py: CocoImporter
2020-09-02 15:43:30,147 DEBUG: Imported the following symbols from __init__.py:
2020-09-02 15:43:30,148 DEBUG: Failed to import module 'openvino_launcher.py': No module named 'openvino'
2020-09-02 15:43:30,149 DEBUG: Imported the following symbols from transforms.py: BoxesToMasks, CropCoveredSegments, IdFromImageName, MapSubsets, MasksToPolygons, MergeInstanceSegments, PolygonsToMasks, RandomSplit, Reindex, RemapLabels, ShapesToBoxes
2020-09-02 15:43:30,149 DEBUG: Imported the following symbols from tf_detection_api_format.format.py:
2020-09-02 15:43:33,034 DEBUG: Imported the following symbols from tf_detection_api_format.extractor.py: TfDetectionApiExtractor
2020-09-02 15:43:33,034 DEBUG: Imported the following symbols from tf_detection_api_format.__init__.py:
2020-09-02 15:43:33,035 DEBUG: Imported the following symbols from tf_detection_api_format.converter.py: TfDetectionApiConverter
2020-09-02 15:43:33,035 DEBUG: Imported the following symbols from tf_detection_api_format.importer.py: TfDetectionApiImporter
2020-09-02 15:43:33,044 DEBUG: Imported the following symbols from voc_format.format.py:
2020-09-02 15:43:33,053 DEBUG: Imported the following symbols from voc_format.extractor.py: VocActionExtractor, VocClassificationExtractor, VocDetectionExtractor, VocLayoutExtractor, VocSegmentationExtractor
2020-09-02 15:43:33,053 DEBUG: Imported the following symbols from voc_format.__init__.py:
2020-09-02 15:43:33,054 DEBUG: Imported the following symbols from voc_format.converter.py: VocActionConverter, VocClassificationConverter, VocConverter, VocDetectionConverter, VocLayoutConverter, VocSegmentationConverter
2020-09-02 15:43:33,054 DEBUG: Imported the following symbols from voc_format.importer.py: VocImporter
2020-09-02 15:43:33,055 DEBUG: Imported the following symbols from image_dir.py: ImageDirConverter, ImageDirExtractor, ImageDirImporter
2020-09-02 15:43:33,055 DEBUG: Imported the following symbols from yolo_format.format.py:
2020-09-02 15:43:33,056 DEBUG: Imported the following symbols from yolo_format.extractor.py: YoloExtractor
2020-09-02 15:43:33,056 DEBUG: Imported the following symbols from yolo_format.__init__.py:
2020-09-02 15:43:33,056 DEBUG: Imported the following symbols from yolo_format.converter.py: YoloConverter
2020-09-02 15:43:33,057 DEBUG: Imported the following symbols from yolo_format.importer.py: YoloImporter
2020-09-02 15:43:33,057 DEBUG: Imported the following symbols from cvat_format.format.py:
2020-09-02 15:43:33,058 DEBUG: Imported the following symbols from cvat_format.extractor.py: CvatExtractor
2020-09-02 15:43:33,058 DEBUG: Imported the following symbols from cvat_format.__init__.py:
2020-09-02 15:43:33,058 DEBUG: Imported the following symbols from cvat_format.converter.py: CvatConverter
2020-09-02 15:43:33,058 DEBUG: Imported the following symbols from cvat_format.importer.py: CvatImporter
usage: datumaro [-h] [--version] [--loglevel LOGLEVEL]

Dataset Framework

optional arguments:
-h, --help show this help message and exit
--version show program's version number and exit
--loglevel LOGLEVEL Logging level (options: error, warning, debug,
critical, info; default: info)

Contexts:
project Actions on projects (datasets)
source Actions on data sources
model Actions on models

Commands:
create Create project
add Add source to project
remove Remove source from project
export Export project
explain Run Explainable AI algorithm for model

Run 'datumaro COMMAND --help' for more information on a command.:

I tried running the same command without the word docker and it gave this Error:

(.env) somilshah:~/Desktop/medanta/cvat$ exec -it cvat bash -c 'python3 datumaro/datum.py --loglevel=debug -h'
bash: exec: -i: invalid option
exec: usage: exec [-cl] [-a name] [command [arguments ...]] [redirection ...]

Also, I forgot to mention, issue stills persists after this.

Ok, then just run the command without docker. It feels like there is an issue with installation.

I ran the above command and here's the output of the same.

(.env) somilshah:~/Desktop/medanta/cvat$ docker exec -it cvat bash -c 'python3 datumaro/datum.py --loglevel=debug -h'
2020-09-02 15:43:29,880 DEBUG: Imported the following symbols from labelme_format.py: LabelMeConverter, LabelMeExtractor, LabelMeImporter
2020-09-02 15:43:29,881 DEBUG: Imported the following symbols from datumaro_format.format.py:
2020-09-02 15:43:29,881 DEBUG: Imported the following symbols from datumaro_format.extractor.py: DatumaroExtractor
2020-09-02 15:43:29,882 DEBUG: Imported the following symbols from datumaro_format.init.py:
2020-09-02 15:43:29,883 DEBUG: Imported the following symbols from datumaro_format.converter.py: DatumaroConverter, DatumaroProjectConverter
2020-09-02 15:43:29,883 DEBUG: Imported the following symbols from datumaro_format.importer.py: DatumaroImporter
2020-09-02 15:43:29,885 DEBUG: Imported the following symbols from mot_format.py: MotSeqExtractor, MotSeqGtConverter, MotSeqImporter
2020-09-02 15:43:29,885 DEBUG: Imported the following symbols from coco_format.format.py:
2020-09-02 15:43:29,939 DEBUG: $HOME=/home/django
2020-09-02 15:43:29,939 DEBUG: CONFIGDIR=/home/django/.config/matplotlib
2020-09-02 15:43:29,939 DEBUG: matplotlib data path: /usr/local/lib/python3.5/dist-packages/matplotlib/mpl-data
2020-09-02 15:43:29,943 DEBUG: loaded rc file /usr/local/lib/python3.5/dist-packages/matplotlib/mpl-data/matplotlibrc
2020-09-02 15:43:29,945 DEBUG: matplotlib version 3.0.3
2020-09-02 15:43:29,945 DEBUG: interactive is False
2020-09-02 15:43:29,946 DEBUG: platform is linux
2020-09-02 15:43:29,946 DEBUG: loaded modules: ['tensorboardX', 'xml.parsers.expat.errors', 'numpy.fft.fftpack', 'tensorboardX.onnx_graph', 'git.objects.commit', 'tensorboardX.proto.tensor_pb2', 'matplotlib.fontconfig_pattern', 'distutils', 'numpy.lib.type_check', 'numpy', 'git.index.typ', 'datumaro_format.format', 'numpy.core.function_base', '_posixsubprocess', 'datetime', 'pkg_resources.extern', 'tensorboardX.proto.resource_handle_pb2', 'datumaro.components.converter', 'pkg_resources.extern.packaging._compat', '_weakrefset', 'email.charset', 'git.refs.tag', 'git.index.base', 'tensorboardX.visdom_writer', 'yaml.tokens', 'site', 'numpy._globals', 'grp', 'gitdb.db', '_warnings', 'numpy.version', 'numpy.lib.histograms', 'numpy.testing', 'numpy.ma', 'pkg_resources.py2_warn', 'git.repo', 'numpy.core._type_aliases', '_sitebuiltins', 'collections', 'reprlib', 'numpy.fft.fftpack_lite', 'cv2.Error', 'xml.parsers.expat.model', 'numpy.core.shape_base', 'google.protobuf.message_factory', 'zlib', 'tensorboardX.summary', 'struct', 'tensorboardX.proto.node_def_pb2', 'csv', 'mmap', 'git.db', 'xml.etree.ElementTree', 'defusedxml.common', 'ast', 'git.objects.fun', 'copy', 'cython_runtime', 'locale', 'unittest.runner', 'gc', '_ssl', 'smmap.util', 'fnmatch', 'datumaro.cli.commands.export', 'numpy.random', 'subprocess', 'git.refs.reference', 'yaml.dumper', '_struct', 'main', 'git.objects.base', 'datumaro.cli.contexts.item', 'numpy.linalg.info', '_opcode', 'genericpath', 'google.protobuf.message', 'numpy.polynomial.legendre', 'mtrand', 'importlib._bootstrap_external', 'numpy.polynomial.laguerre', 'urllib.response', 'google.protobuf.pyext', 'gitdb.fun', '_hashlib', 'gitdb.base', 'cv2.cv2', 'tensorboardX.proto.step_stats_pb2', 'git.config', 'datumaro.cli.commands', 'encodings.latin_1', 'numpy.core.einsumfunc', 'git.repo.fun', 'encodings.utf_8', 'tensorboardX.crc32c', 'yaml.parser', 'json.scanner', 'datumaro.cli.commands.explain', 'http.client', 'google.protobuf', 'pkg_resources._vendor.six.moves', 'importlib.util', 'tensorboardX.proto.types_pb2', 'numpy.lib._iotools', 'pkgutil', 'gitdb.typ', 'pkg_resources._vendor.six.moves.urllib', 'numpy.lib.format', 'datumaro.components.comparator', 'google.protobuf.internal.enum_type_wrapper', 'git.remote', 'tensorboardX.proto.versions_pb2', 'abc', 'yaml.representer', 'pkg_resources._vendor.appdirs', 'unittest.util', '_functools', 'inspect', 'lzma', 'cycler', 'numpy.lib.scimath', 'datumaro.cli.contexts.project.diff', 'pkg_resources', 'email.utils', 'xml.parsers.expat', 'numpy.polynomial', 'git', 'functools', 'http', 'builtins', 'opcode', 'tensorboardX.pytorch_graph', 'importlib', '_ctypes', 'sre_constants', 'gitdb.db.git', 'warnings', 'numpy.linalg.lapack_lite', 'collections.abc', 'numpy.ma.core', 'email._encoded_words', 'numpy.testing._private', 'ipaddress', 'importlib.machinery', 'enum', 'smmap.mman', 'encodings.aliases', 'google.protobuf.internal.well_known_types', 'tensorboardX.x2num', 'gzip', 'bisect', 'numpy.core.machar', 'email.parser', 'heapq', 'select', 'pkg_resources.extern.packaging.markers', 'git.objects.tree', 'numpy.lib.ufunclike', 'tensorboardX.proto.event_pb2', 'smmap.buf', 'ruamel', 'operator', 'email.message', 'weakref', 'datumaro.cli.contexts.source', 'pycocotools.mask', 'datumaro.cli.main', '_pickle', 'xml.parsers', '_signal', 'pkg_resources.extern.packaging.specifiers', 'git.index', 'numpy.core.records', 'importlib._bootstrap', 'glob', 'shutil', 'datumaro.components.config_model', 'cv2.fisheye', 'datumaro.components.cli_plugin', 'datumaro.cli.util.project', 'pkg_resources.extern.six.moves.urllib', 'gitdb.stream', 'datumaro.components.launcher', 'pkg_resources._vendor.packaging', 'cv2.ipp', '_codecs', 'git.objects.submodule.util', 'six', 'yaml.scanner', 'posixpath', '_ast', 'numpy.lib.stride_tricks', '_operator', 'email.errors', 'threading', 'lxml', 'logging', 'datumaro.util', 'tensorboardX.proto.summary_pb2', 'numpy.linalg.linalg', 'google.protobuf.reflection', 'pkg_resources._vendor', 'gitdb.db.base', 'email.header', 'numpy.core.arrayprint', 'numpy._distributor_init', 'cv2.samples', 'numpy.core.memmap', 'git.util', 'cv2.ocl', 'cv2.cuda', 'matplotlib', 'datumaro_format', 'decimal', 'yaml.resolver', 'smmap', 'datumaro.components.config', 'numpy.matrixlib.defmatrix', 'gitdb', 'google.protobuf.pyext._message', 'numpy.ma.extras', '_frozen_importlib_external', '_weakref', 'numpy.ctypeslib', '_bisect', 'datumaro.util.image', 'git.objects.tag', 'yaml', 'gitdb.const', 'google.protobuf.descriptor_database', 'email.iterators', 'gitdb.db.pack', 'pkg_resources.extern.six', 'unittest.case', 'numpy.core._internal', 'dateutil._version', 'token', 'textwrap', 'cv2.utils', 'pkg_resources.extern.pyparsing', 'types', 'google.protobuf.text_encoding', 'pyexpat.model', 'numpy.core.multiarray', 'numpy.linalg', 'yaml.composer', 'ssl', 'tensorboardX.proto.plugin_mesh_pb2', 'urllib', 'numpy.core._multiarray_umath', 'numpy.lib', 'pkg_resources._vendor.six', 'datumaro.util.mask_tools', 'tensorboardX.proto', 'xml.etree', '_datetime', 'datumaro.cli.commands.add', 'pathlib', 'json.decoder', 'uu', 'numpy.lib.shape_base', 'future', 'numpy.lib.polynomial', 'urllib.parse', 'quopri', 'pkg_resources.extern.appdirs', 'coco_format', 'six.moves', 'datumaro.cli.contexts.model', 'numpy.core._dtype_ctypes', 'argparse', 'cv2.dnn', 'marshal', 'posix', 'json.encoder', 'numpy.lib.npyio', 'matplotlib.colors', 'matplotlib.cbook.deprecation', 'gitdb.util', 'string', 'atexit', 'git.exc', 'base64', 'yaml.error', '_thread', '_lzma', 'gettext', 'datumaro.components.project', '_collections_abc', 'ctypes', 'cv2.videoio_registry', '_csv', 'matplotlib.rcsetup', 'dateutil', 'numpy.core.info', 'numbers', '_locale', 'copyreg', 'tarfile', 'gitdb.utils.encoding', 'io', 'numpy.polynomial.hermite_e', 'numpy.compat', 'numpy.lib.utils', 'google.protobuf.descriptor_pool', 'urllib.request', '_socket', 'configparser', 'cv2.data', 'unittest', 'gitdb.exc', 'numpy.polynomial._polybase', '_heapq', 'tensorboardX.record_writer', 'numpy.linalg._umath_linalg', 'google', 'numpy.lib.financial', 'numpy.core.umath', 'random', 'gitdb.db.ref', '_sysconfigdata', 'sitecustomize', 'tensorboardX.embedding', 'git.refs.symbolic', 'cv2', 'socket', 'pyparsing', 'pkg_resources.extern.packaging', 'git.refs.log', 'time', 'google.protobuf.internal.containers', 'xml.etree.ElementPath', 'tensorboardX.proto.plugin_text_pb2', 'numpy.fft.helper', 'yaml.serializer', 'git.refs.remote', 'numpy.core', 'difflib', 'urllib.error', 'tensorboardX.utils', 'numpy.lib.twodim_base', 'numpy.core._dtype', 'email.encoders', 'datumaro.cli.util', '_bz2', '_cython_0_29_13', 'numpy.testing._private.decorators', 'pprint', 'unittest.suite', 'numpy.lib.info', 'uuid', 'email.feedparser', 'numpy.fft.info', 'gitdb.pack', 'datumaro.cli.contexts', 'pkg_resources.extern.packaging.version', 'unittest.main', 'git.objects', 'math', 'numpy.core.fromnumeric', 'pkg_resources.py31compat', 'git.objects.submodule.base', 'datumaro.components.extractor', '_compat_pickle', 'dis', '_compression', '_stat', 'datumaro.cli', 'errno', 'sre_compile', 'numpy.core.numerictypes', 'email._policybase', 'hashlib', 'tokenize', 'git.compat', 'selectors', 'mpl_toolkits', 'numpy.compat.py3k', 'gitdb.db.mem', 'pkg_resources.extern.packaging._structures', 'numpy.polynomial.polynomial', 'git.objects.blob', 'numpy.core.overrides', 'numpy.core._multiarray_tests', 'array', 'zipfile', 'email', 'tensorboardX.proto.graph_pb2', 'numpy.lib.index_tricks', 'numpy.lib.arraypad', 'linecache', 'tensorboardX.proto.attr_value_pb2', 'encodings', 'itertools', 'numpy.lib.nanfunctions', '_cython_0_29_18', 'tensorboardX.proto.layout_pb2', 'sysconfig', 'signal', 'tensorboardX.proto.plugin_pr_curve_pb2', 'yaml.reader', 'numpy.lib._datasource', 'mimetypes', 'codecs', 'defusedxml.ElementTree', '_sre', 'cv2.ml', '_string', 'tempfile', '_sysconfigdata_m', 'numpy.core.numeric', 'bz2', 're', 'lxml.etree', 'lxml._elementpath', 'git.diff', 'gitdb.utils', '_frozen_importlib', '_imp', 'yaml.loader', 'matplotlib.cbook', 'tensorboardX.writer', 'git.index.util', 'git.cmd', 'numpy.polynomial.polyutils', 'google.protobuf.descriptor', 'git.objects.submodule.root', 'git.objects.util', 'ctypes._endian', 'numpy.testing._private.nosetester', 'git.refs.head', 'yaml.emitter', 'pkg_resources.extern.six.moves', 'ctypes.util', 'numpy.testing._private.utils', 'calendar', 'pkg_resources._vendor.packaging.about', 'numpy.core._string_helpers', 'numpy.lib.mixins', 'numpy.matrixlib', 'yaml.constructor', 'importlib.abc', 'numpy._pytesttester', 'datumaro.cli.contexts.project', 'json', 'yaml.events', 'numpy.random.mtrand', 'cv2.detail', 'datumaro.util.image_cache', 'cv2.flann', 'yaml.nodes', 'datumaro.components.dataset_filter', 'tensorboardX.proto.tensor_shape_pb2', 'pycocotools._mask', 'datumaro.cli.commands.remove', 'contextlib', 'pwd', 'numpy.fft', 'google.protobuf.internal.api_implementation', 'termios', '_bootlocale', 'numpy.lib.arraysetops', 'pycocotools', 'git.objects.submodule', 'google.protobuf.internal._api_implementation', 'datumaro.util.command_targets', 'keyword', 'numpy.lib._version', '_collections', 'google.protobuf.pyext.cpp_message', 'numpy.core.defchararray', 'google.protobuf.internal', 'gitdb.db.loose', '_elementtree', 'git.index.fun', 'numpy.compat._inspect', 'unittest.loader', 'numpy.polynomial.hermite', 'cv2.ogl', 'pyexpat', 'xml', '_decimal', 'sys', 'numpy.polynomial.chebyshev', '_random', 'datumaro.version', 'coco_format.extractor', 'numpy.core._add_newdocs', 'numpy.lib.function_base', 'email.quoprimime', 'tensorboardX.torchvis', 'ntpath', 'sre_parse', 'datumaro', 'pycocotools.coco', 'platform', 'datumaro.cli.commands.create', 'numpy.core.getlimits', 'matplotlib._color_data', '_io', '_json', 'binascii', 'git.refs', 'git.repo.base', 'distutils.version', 'numpy.lib.arrayterator', 'email.base64mime', 'unittest.signals', 'defusedxml', 'plistlib', 'traceback', 'datumaro.components', 'numpy.core._methods', 'pkg_resources._vendor.pyparsing', 'pkg_resources.extern.packaging.requirements', 'zipimport', 'pyexpat.errors', 'getpass', 'unittest.result', 'tensorboardX.proto_graph', 'tensorboardX.event_file_writer', 'os', 'google.protobuf.symbol_database', 'pickle', 'stat', 'tensorboardX.openvino_graph', 'os.path', 'email._parseaddr', 'numpy.config', 'matplotlib._version']
2020-09-02 15:43:29,989 DEBUG: CACHEDIR=/home/django/.cache/matplotlib
2020-09-02 15:43:29,990 DEBUG: Using fontManager instance from /home/django/.cache/matplotlib/fontlist-v300.json
2020-09-02 15:43:30,112 DEBUG: Loaded backend qt5agg version unknown.
2020-09-02 15:43:30,140 DEBUG: Loaded backend agg version unknown.
2020-09-02 15:43:30,140 DEBUG: Loaded backend agg version unknown.
2020-09-02 15:43:30,145 DEBUG: Imported the following symbols from coco_format.extractor.py: CocoCaptionsExtractor, CocoImageInfoExtractor, CocoInstancesExtractor, CocoLabelsExtractor, CocoPersonKeypointsExtractor
2020-09-02 15:43:30,145 DEBUG: Imported the following symbols from coco_format.init.py:
2020-09-02 15:43:30,146 DEBUG: Imported the following symbols from coco_format.converter.py: CocoCaptionsConverter, CocoConverter, CocoImageInfoConverter, CocoInstancesConverter, CocoLabelsConverter, CocoPersonKeypointsConverter
2020-09-02 15:43:30,147 DEBUG: Imported the following symbols from coco_format.importer.py: CocoImporter
2020-09-02 15:43:30,147 DEBUG: Imported the following symbols from init.py:
2020-09-02 15:43:30,148 DEBUG: Failed to import module 'openvino_launcher.py': No module named 'openvino'
2020-09-02 15:43:30,149 DEBUG: Imported the following symbols from transforms.py: BoxesToMasks, CropCoveredSegments, IdFromImageName, MapSubsets, MasksToPolygons, MergeInstanceSegments, PolygonsToMasks, RandomSplit, Reindex, RemapLabels, ShapesToBoxes
2020-09-02 15:43:30,149 DEBUG: Imported the following symbols from tf_detection_api_format.format.py:
2020-09-02 15:43:33,034 DEBUG: Imported the following symbols from tf_detection_api_format.extractor.py: TfDetectionApiExtractor
2020-09-02 15:43:33,034 DEBUG: Imported the following symbols from tf_detection_api_format.init.py:
2020-09-02 15:43:33,035 DEBUG: Imported the following symbols from tf_detection_api_format.converter.py: TfDetectionApiConverter
2020-09-02 15:43:33,035 DEBUG: Imported the following symbols from tf_detection_api_format.importer.py: TfDetectionApiImporter
2020-09-02 15:43:33,044 DEBUG: Imported the following symbols from voc_format.format.py:
2020-09-02 15:43:33,053 DEBUG: Imported the following symbols from voc_format.extractor.py: VocActionExtractor, VocClassificationExtractor, VocDetectionExtractor, VocLayoutExtractor, VocSegmentationExtractor
2020-09-02 15:43:33,053 DEBUG: Imported the following symbols from voc_format.init.py:
2020-09-02 15:43:33,054 DEBUG: Imported the following symbols from voc_format.converter.py: VocActionConverter, VocClassificationConverter, VocConverter, VocDetectionConverter, VocLayoutConverter, VocSegmentationConverter
2020-09-02 15:43:33,054 DEBUG: Imported the following symbols from voc_format.importer.py: VocImporter
2020-09-02 15:43:33,055 DEBUG: Imported the following symbols from image_dir.py: ImageDirConverter, ImageDirExtractor, ImageDirImporter
2020-09-02 15:43:33,055 DEBUG: Imported the following symbols from yolo_format.format.py:
2020-09-02 15:43:33,056 DEBUG: Imported the following symbols from yolo_format.extractor.py: YoloExtractor
2020-09-02 15:43:33,056 DEBUG: Imported the following symbols from yolo_format.init.py:
2020-09-02 15:43:33,056 DEBUG: Imported the following symbols from yolo_format.converter.py: YoloConverter
2020-09-02 15:43:33,057 DEBUG: Imported the following symbols from yolo_format.importer.py: YoloImporter
2020-09-02 15:43:33,057 DEBUG: Imported the following symbols from cvat_format.format.py:
2020-09-02 15:43:33,058 DEBUG: Imported the following symbols from cvat_format.extractor.py: CvatExtractor
2020-09-02 15:43:33,058 DEBUG: Imported the following symbols from cvat_format.init.py:
2020-09-02 15:43:33,058 DEBUG: Imported the following symbols from cvat_format.converter.py: CvatConverter
2020-09-02 15:43:33,058 DEBUG: Imported the following symbols from cvat_format.importer.py: CvatImporter
usage: datumaro [-h] [--version] [--loglevel LOGLEVEL]

Dataset Framework

optional arguments:
-h, --help show this help message and exit
--version show program's version number and exit
--loglevel LOGLEVEL Logging level (options: error, warning, debug,
critical, info; default: info)

Contexts:
project Actions on projects (datasets)
source Actions on data sources
model Actions on models

Commands:
create Create project
add Add source to project
remove Remove source from project
export Export project
explain Run Explainable AI algorithm for model

Run 'datumaro COMMAND --help' for more information on a command.:

I tried running the same command without the word docker and it gave this Error:

(.env) somilshah:~/Desktop/medanta/cvat$ exec -it cvat bash -c 'python3 datumaro/datum.py --loglevel=debug -h'
bash: exec: -i: invalid option
exec: usage: exec [-cl] [-a name] [command [arguments ...]] [redirection ...]

Looks normal. Could you try with newer version?

Works Well in the new version !! Thanks for replying!

Hi @zhiltsov-max and @somilshah-q , I am experiencing the same issue, just deployed CVAT master branch.

@zhiltsov-max confirm, this helped to me.

I built cvat container with updated requirements.txt from this commit: https://github.com/openvinotoolkit/cvat/blob/931cd2bb4525549748697d81fb14f7dae61b7407/cvat/requirements/base.txt

And now I can export dumps and datasets.

Was this page helpful?
0 / 5 - 0 ratings

Related issues

Miguelistan picture Miguelistan  路  5Comments

philippschw picture philippschw  路  5Comments

madhuleventm picture madhuleventm  路  4Comments

syonekura picture syonekura  路  4Comments

LinLidi picture LinLidi  路  6Comments