I am not able to upload annotations for any dataset expect CVAT for images.
I have created a dummy task with one image in it. I did one dummy annotation and dumped the annotation in COCO format.
When I try to upload the same dump again in the same task, it's showing the above-mentioned error.
P.S: Dumping and uploading annotations is working fine for CVAT for images format.
Annotations Uploaded successfully
Could not upload annotation for the task 6
Error: Request failed with status code 500. "KeyError: 'coco_instances'\n".

The dumped COCO Json file looks like this:
{
"licenses": [
{
"name": "",
"id": 0,
"url": ""
}
],
"info": {
"contributor": "",
"date_created": "",
"description": "",
"url": "",
"version": "",
"year": ""
},
"categories": [
{
"id": 1,
"name": "A",
"supercategory": ""
},
{
"id": 2,
"name": "Z",
"supercategory": ""
},
{
"id": 3,
"name": "S",
"supercategory": ""
},
{
"id": 4,
"name": "C",
"supercategory": ""
}
],
"images": [
{
"id": 0,
"width": 256,
"height": 256,
"file_name": "2020168243_1_001.png",
"license": 0,
"flickr_url": "",
"coco_url": "",
"date_captured": 0
}
],
"annotations": [
{
"id": 1,
"image_id": 0,
"category_id": 1,
"segmentation": [
[
79.14,
48.11,
191.24,
48.11,
191.24,
150.9,
79.14,
150.9
]
],
"area": 11522.759000000002,
"bbox": [
79.14,
48.11,
112.10000000000001,
102.79
],
"iscrowd": 0
},
{
"id": 2,
"image_id": 0,
"category_id": 1,
"segmentation": [
[
60.91,
78.12,
207.89,
78.12,
207.89,
178.76,
60.91,
178.76
]
],
"area": 14792.067199999998,
"bbox": [
60.91,
78.12,
146.98,
100.63999999999999
],
"iscrowd": 0
}
]
}
I found the following in the server_cvat.log file.
[2020-09-01 11:26:53,329] INFO django.server: "PUT /api/v1/tasks/6/annotations?format=COCO%201.0 HTTP/1.1" 202 0
[2020-09-01 11:26:56,391] ERROR django.request: Internal Server Error: /api/v1/tasks/6/annotations
[2020-09-01 11:26:56,392] ERROR django.server: "PUT /api/v1/tasks/6/annotations?format=COCO%201.0 HTTP/1.1" 500 30
I inspected the error in Chrome dev tools. It's coming from line no 192 in cvat-app.tsx file
Thanks in advance
Which CVAT version do you use?
Which CVAT version do you use?
1.0.0
Please run docker exec -it cvat bash -c 'python3 datumaro/datum.py --loglevel=debug -h' and check if there any import errors in the output.
Please run
docker exec -it cvat bash -c 'python3 datumaro/datum.py --loglevel=debug -h'and check if there any import errors in the output.
Hey, thanks for replying. Actually I am running the app in developer mode. i.e (I followed the steps mentioned in contributing.md file) and running backend by selection server:debug in VS Code
Ok, then just run the command without docker. It feels like there is an issue with installation.
Ok, then just run the command without docker. It feels like there is an issue with installation.
I ran the above command and here's the output of the same.
(.env) somilshah:~/Desktop/medanta/cvat$ docker exec -it cvat bash -c 'python3 datumaro/datum.py --loglevel=debug -h'
2020-09-02 15:43:29,880 DEBUG: Imported the following symbols from labelme_format.py: LabelMeConverter, LabelMeExtractor, LabelMeImporter
2020-09-02 15:43:29,881 DEBUG: Imported the following symbols from datumaro_format.format.py:
2020-09-02 15:43:29,881 DEBUG: Imported the following symbols from datumaro_format.extractor.py: DatumaroExtractor
2020-09-02 15:43:29,882 DEBUG: Imported the following symbols from datumaro_format.__init__.py:
2020-09-02 15:43:29,883 DEBUG: Imported the following symbols from datumaro_format.converter.py: DatumaroConverter, DatumaroProjectConverter
2020-09-02 15:43:29,883 DEBUG: Imported the following symbols from datumaro_format.importer.py: DatumaroImporter
2020-09-02 15:43:29,885 DEBUG: Imported the following symbols from mot_format.py: MotSeqExtractor, MotSeqGtConverter, MotSeqImporter
2020-09-02 15:43:29,885 DEBUG: Imported the following symbols from coco_format.format.py:
2020-09-02 15:43:29,939 DEBUG: $HOME=/home/django
2020-09-02 15:43:29,939 DEBUG: CONFIGDIR=/home/django/.config/matplotlib
2020-09-02 15:43:29,939 DEBUG: matplotlib data path: /usr/local/lib/python3.5/dist-packages/matplotlib/mpl-data
2020-09-02 15:43:29,943 DEBUG: loaded rc file /usr/local/lib/python3.5/dist-packages/matplotlib/mpl-data/matplotlibrc
2020-09-02 15:43:29,945 DEBUG: matplotlib version 3.0.3
2020-09-02 15:43:29,945 DEBUG: interactive is False
2020-09-02 15:43:29,946 DEBUG: platform is linux
2020-09-02 15:43:29,946 DEBUG: loaded modules: ['tensorboardX', 'xml.parsers.expat.errors', 'numpy.fft.fftpack', 'tensorboardX.onnx_graph', 'git.objects.commit', 'tensorboardX.proto.tensor_pb2', 'matplotlib.fontconfig_pattern', 'distutils', 'numpy.lib.type_check', 'numpy', 'git.index.typ', 'datumaro_format.format', 'numpy.core.function_base', '_posixsubprocess', 'datetime', 'pkg_resources.extern', 'tensorboardX.proto.resource_handle_pb2', 'datumaro.components.converter', 'pkg_resources.extern.packaging._compat', '_weakrefset', 'email.charset', 'git.refs.tag', 'git.index.base', 'tensorboardX.visdom_writer', 'yaml.tokens', 'site', 'numpy._globals', 'grp', 'gitdb.db', '_warnings', 'numpy.version', 'numpy.lib.histograms', 'numpy.testing', 'numpy.ma', 'pkg_resources.py2_warn', 'git.repo', 'numpy.core._type_aliases', '_sitebuiltins', 'collections', 'reprlib', 'numpy.fft.fftpack_lite', 'cv2.Error', 'xml.parsers.expat.model', 'numpy.core.shape_base', 'google.protobuf.message_factory', 'zlib', 'tensorboardX.summary', 'struct', 'tensorboardX.proto.node_def_pb2', 'csv', 'mmap', 'git.db', 'xml.etree.ElementTree', 'defusedxml.common', 'ast', 'git.objects.fun', 'copy', 'cython_runtime', 'locale', 'unittest.runner', 'gc', '_ssl', 'smmap.util', 'fnmatch', 'datumaro.cli.commands.export', 'numpy.random', 'subprocess', 'git.refs.reference', 'yaml.dumper', '_struct', '__main__', 'git.objects.base', 'datumaro.cli.contexts.item', 'numpy.linalg.info', '_opcode', 'genericpath', 'google.protobuf.message', 'numpy.polynomial.legendre', 'mtrand', 'importlib._bootstrap_external', 'numpy.polynomial.laguerre', 'urllib.response', 'google.protobuf.pyext', 'gitdb.fun', '_hashlib', 'gitdb.base', 'cv2.cv2', 'tensorboardX.proto.step_stats_pb2', 'git.config', 'datumaro.cli.commands', 'encodings.latin_1', 'numpy.core.einsumfunc', 'git.repo.fun', 'encodings.utf_8', 'tensorboardX.crc32c', 'yaml.parser', 'json.scanner', 'datumaro.cli.commands.explain', 'http.client', 'google.protobuf', 'pkg_resources._vendor.six.moves', 'importlib.util', 'tensorboardX.proto.types_pb2', 'numpy.lib._iotools', 'pkgutil', 'gitdb.typ', 'pkg_resources._vendor.six.moves.urllib', 'numpy.lib.format', 'datumaro.components.comparator', 'google.protobuf.internal.enum_type_wrapper', 'git.remote', 'tensorboardX.proto.versions_pb2', 'abc', 'yaml.representer', 'pkg_resources._vendor.appdirs', 'unittest.util', '_functools', 'inspect', 'lzma', 'cycler', 'numpy.lib.scimath', 'datumaro.cli.contexts.project.diff', 'pkg_resources', 'email.utils', 'xml.parsers.expat', 'numpy.polynomial', 'git', 'functools', 'http', 'builtins', 'opcode', 'tensorboardX.pytorch_graph', 'importlib', '_ctypes', 'sre_constants', 'gitdb.db.git', 'warnings', 'numpy.linalg.lapack_lite', 'collections.abc', 'numpy.ma.core', 'email._encoded_words', 'numpy.testing._private', 'ipaddress', 'importlib.machinery', 'enum', 'smmap.mman', 'encodings.aliases', 'google.protobuf.internal.well_known_types', 'tensorboardX.x2num', 'gzip', 'bisect', 'numpy.core.machar', 'email.parser', 'heapq', 'select', 'pkg_resources.extern.packaging.markers', 'git.objects.tree', 'numpy.lib.ufunclike', 'tensorboardX.proto.event_pb2', 'smmap.buf', 'ruamel', 'operator', 'email.message', 'weakref', 'datumaro.cli.contexts.source', 'pycocotools.mask', 'datumaro.cli.__main__', '_pickle', 'xml.parsers', '_signal', 'pkg_resources.extern.packaging.specifiers', 'git.index', 'numpy.core.records', 'importlib._bootstrap', 'glob', 'shutil', 'datumaro.components.config_model', 'cv2.fisheye', 'datumaro.components.cli_plugin', 'datumaro.cli.util.project', 'pkg_resources.extern.six.moves.urllib', 'gitdb.stream', 'datumaro.components.launcher', 'pkg_resources._vendor.packaging', 'cv2.ipp', '_codecs', 'git.objects.submodule.util', 'six', 'yaml.scanner', 'posixpath', '_ast', 'numpy.lib.stride_tricks', '_operator', 'email.errors', 'threading', 'lxml', 'logging', 'datumaro.util', 'tensorboardX.proto.summary_pb2', 'numpy.linalg.linalg', 'google.protobuf.reflection', 'pkg_resources._vendor', 'gitdb.db.base', 'email.header', 'numpy.core.arrayprint', 'numpy._distributor_init', 'cv2.samples', 'numpy.core.memmap', 'git.util', 'cv2.ocl', 'cv2.cuda', 'matplotlib', 'datumaro_format', 'decimal', 'yaml.resolver', 'smmap', 'datumaro.components.config', 'numpy.matrixlib.defmatrix', 'gitdb', 'google.protobuf.pyext._message', 'numpy.ma.extras', '_frozen_importlib_external', '_weakref', 'numpy.ctypeslib', '_bisect', 'datumaro.util.image', 'git.objects.tag', 'yaml', 'gitdb.const', 'google.protobuf.descriptor_database', 'email.iterators', 'gitdb.db.pack', 'pkg_resources.extern.six', 'unittest.case', 'numpy.core._internal', 'dateutil._version', 'token', 'textwrap', 'cv2.utils', 'pkg_resources.extern.pyparsing', 'types', 'google.protobuf.text_encoding', 'pyexpat.model', 'numpy.core.multiarray', 'numpy.linalg', 'yaml.composer', 'ssl', 'tensorboardX.proto.plugin_mesh_pb2', 'urllib', 'numpy.core._multiarray_umath', 'numpy.lib', 'pkg_resources._vendor.six', 'datumaro.util.mask_tools', 'tensorboardX.proto', 'xml.etree', '_datetime', 'datumaro.cli.commands.add', 'pathlib', 'json.decoder', 'uu', 'numpy.lib.shape_base', '__future__', 'numpy.lib.polynomial', 'urllib.parse', 'quopri', 'pkg_resources.extern.appdirs', 'coco_format', 'six.moves', 'datumaro.cli.contexts.model', 'numpy.core._dtype_ctypes', 'argparse', 'cv2.dnn', 'marshal', 'posix', 'json.encoder', 'numpy.lib.npyio', 'matplotlib.colors', 'matplotlib.cbook.deprecation', 'gitdb.util', 'string', 'atexit', 'git.exc', 'base64', 'yaml.error', '_thread', '_lzma', 'gettext', 'datumaro.components.project', '_collections_abc', 'ctypes', 'cv2.videoio_registry', '_csv', 'matplotlib.rcsetup', 'dateutil', 'numpy.core.info', 'numbers', '_locale', 'copyreg', 'tarfile', 'gitdb.utils.encoding', 'io', 'numpy.polynomial.hermite_e', 'numpy.compat', 'numpy.lib.utils', 'google.protobuf.descriptor_pool', 'urllib.request', '_socket', 'configparser', 'cv2.data', 'unittest', 'gitdb.exc', 'numpy.polynomial._polybase', '_heapq', 'tensorboardX.record_writer', 'numpy.linalg._umath_linalg', 'google', 'numpy.lib.financial', 'numpy.core.umath', 'random', 'gitdb.db.ref', '_sysconfigdata', 'sitecustomize', 'tensorboardX.embedding', 'git.refs.symbolic', 'cv2', 'socket', 'pyparsing', 'pkg_resources.extern.packaging', 'git.refs.log', 'time', 'google.protobuf.internal.containers', 'xml.etree.ElementPath', 'tensorboardX.proto.plugin_text_pb2', 'numpy.fft.helper', 'yaml.serializer', 'git.refs.remote', 'numpy.core', 'difflib', 'urllib.error', 'tensorboardX.utils', 'numpy.lib.twodim_base', 'numpy.core._dtype', 'email.encoders', 'datumaro.cli.util', '_bz2', '_cython_0_29_13', 'numpy.testing._private.decorators', 'pprint', 'unittest.suite', 'numpy.lib.info', 'uuid', 'email.feedparser', 'numpy.fft.info', 'gitdb.pack', 'datumaro.cli.contexts', 'pkg_resources.extern.packaging.version', 'unittest.main', 'git.objects', 'math', 'numpy.core.fromnumeric', 'pkg_resources.py31compat', 'git.objects.submodule.base', 'datumaro.components.extractor', '_compat_pickle', 'dis', '_compression', '_stat', 'datumaro.cli', 'errno', 'sre_compile', 'numpy.core.numerictypes', 'email._policybase', 'hashlib', 'tokenize', 'git.compat', 'selectors', 'mpl_toolkits', 'numpy.compat.py3k', 'gitdb.db.mem', 'pkg_resources.extern.packaging._structures', 'numpy.polynomial.polynomial', 'git.objects.blob', 'numpy.core.overrides', 'numpy.core._multiarray_tests', 'array', 'zipfile', 'email', 'tensorboardX.proto.graph_pb2', 'numpy.lib.index_tricks', 'numpy.lib.arraypad', 'linecache', 'tensorboardX.proto.attr_value_pb2', 'encodings', 'itertools', 'numpy.lib.nanfunctions', '_cython_0_29_18', 'tensorboardX.proto.layout_pb2', 'sysconfig', 'signal', 'tensorboardX.proto.plugin_pr_curve_pb2', 'yaml.reader', 'numpy.lib._datasource', 'mimetypes', 'codecs', 'defusedxml.ElementTree', '_sre', 'cv2.ml', '_string', 'tempfile', '_sysconfigdata_m', 'numpy.core.numeric', 'bz2', 're', 'lxml.etree', 'lxml._elementpath', 'git.diff', 'gitdb.utils', '_frozen_importlib', '_imp', 'yaml.loader', 'matplotlib.cbook', 'tensorboardX.writer', 'git.index.util', 'git.cmd', 'numpy.polynomial.polyutils', 'google.protobuf.descriptor', 'git.objects.submodule.root', 'git.objects.util', 'ctypes._endian', 'numpy.testing._private.nosetester', 'git.refs.head', 'yaml.emitter', 'pkg_resources.extern.six.moves', 'ctypes.util', 'numpy.testing._private.utils', 'calendar', 'pkg_resources._vendor.packaging.__about__', 'numpy.core._string_helpers', 'numpy.lib.mixins', 'numpy.matrixlib', 'yaml.constructor', 'importlib.abc', 'numpy._pytesttester', 'datumaro.cli.contexts.project', 'json', 'yaml.events', 'numpy.random.mtrand', 'cv2.detail', 'datumaro.util.image_cache', 'cv2.flann', 'yaml.nodes', 'datumaro.components.dataset_filter', 'tensorboardX.proto.tensor_shape_pb2', 'pycocotools._mask', 'datumaro.cli.commands.remove', 'contextlib', 'pwd', 'numpy.fft', 'google.protobuf.internal.api_implementation', 'termios', '_bootlocale', 'numpy.lib.arraysetops', 'pycocotools', 'git.objects.submodule', 'google.protobuf.internal._api_implementation', 'datumaro.util.command_targets', 'keyword', 'numpy.lib._version', '_collections', 'google.protobuf.pyext.cpp_message', 'numpy.core.defchararray', 'google.protobuf.internal', 'gitdb.db.loose', '_elementtree', 'git.index.fun', 'numpy.compat._inspect', 'unittest.loader', 'numpy.polynomial.hermite', 'cv2.ogl', 'pyexpat', 'xml', '_decimal', 'sys', 'numpy.polynomial.chebyshev', '_random', 'datumaro.version', 'coco_format.extractor', 'numpy.core._add_newdocs', 'numpy.lib.function_base', 'email.quoprimime', 'tensorboardX.torchvis', 'ntpath', 'sre_parse', 'datumaro', 'pycocotools.coco', 'platform', 'datumaro.cli.commands.create', 'numpy.core.getlimits', 'matplotlib._color_data', '_io', '_json', 'binascii', 'git.refs', 'git.repo.base', 'distutils.version', 'numpy.lib.arrayterator', 'email.base64mime', 'unittest.signals', 'defusedxml', 'plistlib', 'traceback', 'datumaro.components', 'numpy.core._methods', 'pkg_resources._vendor.pyparsing', 'pkg_resources.extern.packaging.requirements', 'zipimport', 'pyexpat.errors', 'getpass', 'unittest.result', 'tensorboardX.proto_graph', 'tensorboardX.event_file_writer', 'os', 'google.protobuf.symbol_database', 'pickle', 'stat', 'tensorboardX.openvino_graph', 'os.path', 'email._parseaddr', 'numpy.__config__', 'matplotlib._version']
2020-09-02 15:43:29,989 DEBUG: CACHEDIR=/home/django/.cache/matplotlib
2020-09-02 15:43:29,990 DEBUG: Using fontManager instance from /home/django/.cache/matplotlib/fontlist-v300.json
2020-09-02 15:43:30,112 DEBUG: Loaded backend qt5agg version unknown.
2020-09-02 15:43:30,140 DEBUG: Loaded backend agg version unknown.
2020-09-02 15:43:30,140 DEBUG: Loaded backend agg version unknown.
2020-09-02 15:43:30,145 DEBUG: Imported the following symbols from coco_format.extractor.py: CocoCaptionsExtractor, CocoImageInfoExtractor, CocoInstancesExtractor, CocoLabelsExtractor, CocoPersonKeypointsExtractor
2020-09-02 15:43:30,145 DEBUG: Imported the following symbols from coco_format.__init__.py:
2020-09-02 15:43:30,146 DEBUG: Imported the following symbols from coco_format.converter.py: CocoCaptionsConverter, CocoConverter, CocoImageInfoConverter, CocoInstancesConverter, CocoLabelsConverter, CocoPersonKeypointsConverter
2020-09-02 15:43:30,147 DEBUG: Imported the following symbols from coco_format.importer.py: CocoImporter
2020-09-02 15:43:30,147 DEBUG: Imported the following symbols from __init__.py:
2020-09-02 15:43:30,148 DEBUG: Failed to import module 'openvino_launcher.py': No module named 'openvino'
2020-09-02 15:43:30,149 DEBUG: Imported the following symbols from transforms.py: BoxesToMasks, CropCoveredSegments, IdFromImageName, MapSubsets, MasksToPolygons, MergeInstanceSegments, PolygonsToMasks, RandomSplit, Reindex, RemapLabels, ShapesToBoxes
2020-09-02 15:43:30,149 DEBUG: Imported the following symbols from tf_detection_api_format.format.py:
2020-09-02 15:43:33,034 DEBUG: Imported the following symbols from tf_detection_api_format.extractor.py: TfDetectionApiExtractor
2020-09-02 15:43:33,034 DEBUG: Imported the following symbols from tf_detection_api_format.__init__.py:
2020-09-02 15:43:33,035 DEBUG: Imported the following symbols from tf_detection_api_format.converter.py: TfDetectionApiConverter
2020-09-02 15:43:33,035 DEBUG: Imported the following symbols from tf_detection_api_format.importer.py: TfDetectionApiImporter
2020-09-02 15:43:33,044 DEBUG: Imported the following symbols from voc_format.format.py:
2020-09-02 15:43:33,053 DEBUG: Imported the following symbols from voc_format.extractor.py: VocActionExtractor, VocClassificationExtractor, VocDetectionExtractor, VocLayoutExtractor, VocSegmentationExtractor
2020-09-02 15:43:33,053 DEBUG: Imported the following symbols from voc_format.__init__.py:
2020-09-02 15:43:33,054 DEBUG: Imported the following symbols from voc_format.converter.py: VocActionConverter, VocClassificationConverter, VocConverter, VocDetectionConverter, VocLayoutConverter, VocSegmentationConverter
2020-09-02 15:43:33,054 DEBUG: Imported the following symbols from voc_format.importer.py: VocImporter
2020-09-02 15:43:33,055 DEBUG: Imported the following symbols from image_dir.py: ImageDirConverter, ImageDirExtractor, ImageDirImporter
2020-09-02 15:43:33,055 DEBUG: Imported the following symbols from yolo_format.format.py:
2020-09-02 15:43:33,056 DEBUG: Imported the following symbols from yolo_format.extractor.py: YoloExtractor
2020-09-02 15:43:33,056 DEBUG: Imported the following symbols from yolo_format.__init__.py:
2020-09-02 15:43:33,056 DEBUG: Imported the following symbols from yolo_format.converter.py: YoloConverter
2020-09-02 15:43:33,057 DEBUG: Imported the following symbols from yolo_format.importer.py: YoloImporter
2020-09-02 15:43:33,057 DEBUG: Imported the following symbols from cvat_format.format.py:
2020-09-02 15:43:33,058 DEBUG: Imported the following symbols from cvat_format.extractor.py: CvatExtractor
2020-09-02 15:43:33,058 DEBUG: Imported the following symbols from cvat_format.__init__.py:
2020-09-02 15:43:33,058 DEBUG: Imported the following symbols from cvat_format.converter.py: CvatConverter
2020-09-02 15:43:33,058 DEBUG: Imported the following symbols from cvat_format.importer.py: CvatImporter
usage: datumaro [-h] [--version] [--loglevel LOGLEVEL]
Dataset Framework
optional arguments:
-h, --help show this help message and exit
--version show program's version number and exit
--loglevel LOGLEVEL Logging level (options: error, warning, debug,
critical, info; default: info)
Contexts:
project Actions on projects (datasets)
source Actions on data sources
model Actions on models
Commands:
create Create project
add Add source to project
remove Remove source from project
export Export project
explain Run Explainable AI algorithm for model
Run 'datumaro COMMAND --help' for more information on a command.:
I tried running the same command without the word docker and it gave this Error:
(.env) somilshah:~/Desktop/medanta/cvat$ exec -it cvat bash -c 'python3 datumaro/datum.py --loglevel=debug -h'
bash: exec: -i: invalid option
exec: usage: exec [-cl] [-a name] [command [arguments ...]] [redirection ...]
Also, I forgot to mention, issue stills persists after this.
Ok, then just run the command without docker. It feels like there is an issue with installation.
I ran the above command and here's the output of the same.
(.env) somilshah:~/Desktop/medanta/cvat$ docker exec -it cvat bash -c 'python3 datumaro/datum.py --loglevel=debug -h'
2020-09-02 15:43:29,880 DEBUG: Imported the following symbols from labelme_format.py: LabelMeConverter, LabelMeExtractor, LabelMeImporter
2020-09-02 15:43:29,881 DEBUG: Imported the following symbols from datumaro_format.format.py:
2020-09-02 15:43:29,881 DEBUG: Imported the following symbols from datumaro_format.extractor.py: DatumaroExtractor
2020-09-02 15:43:29,882 DEBUG: Imported the following symbols from datumaro_format.init.py:
2020-09-02 15:43:29,883 DEBUG: Imported the following symbols from datumaro_format.converter.py: DatumaroConverter, DatumaroProjectConverter
2020-09-02 15:43:29,883 DEBUG: Imported the following symbols from datumaro_format.importer.py: DatumaroImporter
2020-09-02 15:43:29,885 DEBUG: Imported the following symbols from mot_format.py: MotSeqExtractor, MotSeqGtConverter, MotSeqImporter
2020-09-02 15:43:29,885 DEBUG: Imported the following symbols from coco_format.format.py:
2020-09-02 15:43:29,939 DEBUG: $HOME=/home/django
2020-09-02 15:43:29,939 DEBUG: CONFIGDIR=/home/django/.config/matplotlib
2020-09-02 15:43:29,939 DEBUG: matplotlib data path: /usr/local/lib/python3.5/dist-packages/matplotlib/mpl-data
2020-09-02 15:43:29,943 DEBUG: loaded rc file /usr/local/lib/python3.5/dist-packages/matplotlib/mpl-data/matplotlibrc
2020-09-02 15:43:29,945 DEBUG: matplotlib version 3.0.3
2020-09-02 15:43:29,945 DEBUG: interactive is False
2020-09-02 15:43:29,946 DEBUG: platform is linux
2020-09-02 15:43:29,946 DEBUG: loaded modules: ['tensorboardX', 'xml.parsers.expat.errors', 'numpy.fft.fftpack', 'tensorboardX.onnx_graph', 'git.objects.commit', 'tensorboardX.proto.tensor_pb2', 'matplotlib.fontconfig_pattern', 'distutils', 'numpy.lib.type_check', 'numpy', 'git.index.typ', 'datumaro_format.format', 'numpy.core.function_base', '_posixsubprocess', 'datetime', 'pkg_resources.extern', 'tensorboardX.proto.resource_handle_pb2', 'datumaro.components.converter', 'pkg_resources.extern.packaging._compat', '_weakrefset', 'email.charset', 'git.refs.tag', 'git.index.base', 'tensorboardX.visdom_writer', 'yaml.tokens', 'site', 'numpy._globals', 'grp', 'gitdb.db', '_warnings', 'numpy.version', 'numpy.lib.histograms', 'numpy.testing', 'numpy.ma', 'pkg_resources.py2_warn', 'git.repo', 'numpy.core._type_aliases', '_sitebuiltins', 'collections', 'reprlib', 'numpy.fft.fftpack_lite', 'cv2.Error', 'xml.parsers.expat.model', 'numpy.core.shape_base', 'google.protobuf.message_factory', 'zlib', 'tensorboardX.summary', 'struct', 'tensorboardX.proto.node_def_pb2', 'csv', 'mmap', 'git.db', 'xml.etree.ElementTree', 'defusedxml.common', 'ast', 'git.objects.fun', 'copy', 'cython_runtime', 'locale', 'unittest.runner', 'gc', '_ssl', 'smmap.util', 'fnmatch', 'datumaro.cli.commands.export', 'numpy.random', 'subprocess', 'git.refs.reference', 'yaml.dumper', '_struct', 'main', 'git.objects.base', 'datumaro.cli.contexts.item', 'numpy.linalg.info', '_opcode', 'genericpath', 'google.protobuf.message', 'numpy.polynomial.legendre', 'mtrand', 'importlib._bootstrap_external', 'numpy.polynomial.laguerre', 'urllib.response', 'google.protobuf.pyext', 'gitdb.fun', '_hashlib', 'gitdb.base', 'cv2.cv2', 'tensorboardX.proto.step_stats_pb2', 'git.config', 'datumaro.cli.commands', 'encodings.latin_1', 'numpy.core.einsumfunc', 'git.repo.fun', 'encodings.utf_8', 'tensorboardX.crc32c', 'yaml.parser', 'json.scanner', 'datumaro.cli.commands.explain', 'http.client', 'google.protobuf', 'pkg_resources._vendor.six.moves', 'importlib.util', 'tensorboardX.proto.types_pb2', 'numpy.lib._iotools', 'pkgutil', 'gitdb.typ', 'pkg_resources._vendor.six.moves.urllib', 'numpy.lib.format', 'datumaro.components.comparator', 'google.protobuf.internal.enum_type_wrapper', 'git.remote', 'tensorboardX.proto.versions_pb2', 'abc', 'yaml.representer', 'pkg_resources._vendor.appdirs', 'unittest.util', '_functools', 'inspect', 'lzma', 'cycler', 'numpy.lib.scimath', 'datumaro.cli.contexts.project.diff', 'pkg_resources', 'email.utils', 'xml.parsers.expat', 'numpy.polynomial', 'git', 'functools', 'http', 'builtins', 'opcode', 'tensorboardX.pytorch_graph', 'importlib', '_ctypes', 'sre_constants', 'gitdb.db.git', 'warnings', 'numpy.linalg.lapack_lite', 'collections.abc', 'numpy.ma.core', 'email._encoded_words', 'numpy.testing._private', 'ipaddress', 'importlib.machinery', 'enum', 'smmap.mman', 'encodings.aliases', 'google.protobuf.internal.well_known_types', 'tensorboardX.x2num', 'gzip', 'bisect', 'numpy.core.machar', 'email.parser', 'heapq', 'select', 'pkg_resources.extern.packaging.markers', 'git.objects.tree', 'numpy.lib.ufunclike', 'tensorboardX.proto.event_pb2', 'smmap.buf', 'ruamel', 'operator', 'email.message', 'weakref', 'datumaro.cli.contexts.source', 'pycocotools.mask', 'datumaro.cli.main', '_pickle', 'xml.parsers', '_signal', 'pkg_resources.extern.packaging.specifiers', 'git.index', 'numpy.core.records', 'importlib._bootstrap', 'glob', 'shutil', 'datumaro.components.config_model', 'cv2.fisheye', 'datumaro.components.cli_plugin', 'datumaro.cli.util.project', 'pkg_resources.extern.six.moves.urllib', 'gitdb.stream', 'datumaro.components.launcher', 'pkg_resources._vendor.packaging', 'cv2.ipp', '_codecs', 'git.objects.submodule.util', 'six', 'yaml.scanner', 'posixpath', '_ast', 'numpy.lib.stride_tricks', '_operator', 'email.errors', 'threading', 'lxml', 'logging', 'datumaro.util', 'tensorboardX.proto.summary_pb2', 'numpy.linalg.linalg', 'google.protobuf.reflection', 'pkg_resources._vendor', 'gitdb.db.base', 'email.header', 'numpy.core.arrayprint', 'numpy._distributor_init', 'cv2.samples', 'numpy.core.memmap', 'git.util', 'cv2.ocl', 'cv2.cuda', 'matplotlib', 'datumaro_format', 'decimal', 'yaml.resolver', 'smmap', 'datumaro.components.config', 'numpy.matrixlib.defmatrix', 'gitdb', 'google.protobuf.pyext._message', 'numpy.ma.extras', '_frozen_importlib_external', '_weakref', 'numpy.ctypeslib', '_bisect', 'datumaro.util.image', 'git.objects.tag', 'yaml', 'gitdb.const', 'google.protobuf.descriptor_database', 'email.iterators', 'gitdb.db.pack', 'pkg_resources.extern.six', 'unittest.case', 'numpy.core._internal', 'dateutil._version', 'token', 'textwrap', 'cv2.utils', 'pkg_resources.extern.pyparsing', 'types', 'google.protobuf.text_encoding', 'pyexpat.model', 'numpy.core.multiarray', 'numpy.linalg', 'yaml.composer', 'ssl', 'tensorboardX.proto.plugin_mesh_pb2', 'urllib', 'numpy.core._multiarray_umath', 'numpy.lib', 'pkg_resources._vendor.six', 'datumaro.util.mask_tools', 'tensorboardX.proto', 'xml.etree', '_datetime', 'datumaro.cli.commands.add', 'pathlib', 'json.decoder', 'uu', 'numpy.lib.shape_base', 'future', 'numpy.lib.polynomial', 'urllib.parse', 'quopri', 'pkg_resources.extern.appdirs', 'coco_format', 'six.moves', 'datumaro.cli.contexts.model', 'numpy.core._dtype_ctypes', 'argparse', 'cv2.dnn', 'marshal', 'posix', 'json.encoder', 'numpy.lib.npyio', 'matplotlib.colors', 'matplotlib.cbook.deprecation', 'gitdb.util', 'string', 'atexit', 'git.exc', 'base64', 'yaml.error', '_thread', '_lzma', 'gettext', 'datumaro.components.project', '_collections_abc', 'ctypes', 'cv2.videoio_registry', '_csv', 'matplotlib.rcsetup', 'dateutil', 'numpy.core.info', 'numbers', '_locale', 'copyreg', 'tarfile', 'gitdb.utils.encoding', 'io', 'numpy.polynomial.hermite_e', 'numpy.compat', 'numpy.lib.utils', 'google.protobuf.descriptor_pool', 'urllib.request', '_socket', 'configparser', 'cv2.data', 'unittest', 'gitdb.exc', 'numpy.polynomial._polybase', '_heapq', 'tensorboardX.record_writer', 'numpy.linalg._umath_linalg', 'google', 'numpy.lib.financial', 'numpy.core.umath', 'random', 'gitdb.db.ref', '_sysconfigdata', 'sitecustomize', 'tensorboardX.embedding', 'git.refs.symbolic', 'cv2', 'socket', 'pyparsing', 'pkg_resources.extern.packaging', 'git.refs.log', 'time', 'google.protobuf.internal.containers', 'xml.etree.ElementPath', 'tensorboardX.proto.plugin_text_pb2', 'numpy.fft.helper', 'yaml.serializer', 'git.refs.remote', 'numpy.core', 'difflib', 'urllib.error', 'tensorboardX.utils', 'numpy.lib.twodim_base', 'numpy.core._dtype', 'email.encoders', 'datumaro.cli.util', '_bz2', '_cython_0_29_13', 'numpy.testing._private.decorators', 'pprint', 'unittest.suite', 'numpy.lib.info', 'uuid', 'email.feedparser', 'numpy.fft.info', 'gitdb.pack', 'datumaro.cli.contexts', 'pkg_resources.extern.packaging.version', 'unittest.main', 'git.objects', 'math', 'numpy.core.fromnumeric', 'pkg_resources.py31compat', 'git.objects.submodule.base', 'datumaro.components.extractor', '_compat_pickle', 'dis', '_compression', '_stat', 'datumaro.cli', 'errno', 'sre_compile', 'numpy.core.numerictypes', 'email._policybase', 'hashlib', 'tokenize', 'git.compat', 'selectors', 'mpl_toolkits', 'numpy.compat.py3k', 'gitdb.db.mem', 'pkg_resources.extern.packaging._structures', 'numpy.polynomial.polynomial', 'git.objects.blob', 'numpy.core.overrides', 'numpy.core._multiarray_tests', 'array', 'zipfile', 'email', 'tensorboardX.proto.graph_pb2', 'numpy.lib.index_tricks', 'numpy.lib.arraypad', 'linecache', 'tensorboardX.proto.attr_value_pb2', 'encodings', 'itertools', 'numpy.lib.nanfunctions', '_cython_0_29_18', 'tensorboardX.proto.layout_pb2', 'sysconfig', 'signal', 'tensorboardX.proto.plugin_pr_curve_pb2', 'yaml.reader', 'numpy.lib._datasource', 'mimetypes', 'codecs', 'defusedxml.ElementTree', '_sre', 'cv2.ml', '_string', 'tempfile', '_sysconfigdata_m', 'numpy.core.numeric', 'bz2', 're', 'lxml.etree', 'lxml._elementpath', 'git.diff', 'gitdb.utils', '_frozen_importlib', '_imp', 'yaml.loader', 'matplotlib.cbook', 'tensorboardX.writer', 'git.index.util', 'git.cmd', 'numpy.polynomial.polyutils', 'google.protobuf.descriptor', 'git.objects.submodule.root', 'git.objects.util', 'ctypes._endian', 'numpy.testing._private.nosetester', 'git.refs.head', 'yaml.emitter', 'pkg_resources.extern.six.moves', 'ctypes.util', 'numpy.testing._private.utils', 'calendar', 'pkg_resources._vendor.packaging.about', 'numpy.core._string_helpers', 'numpy.lib.mixins', 'numpy.matrixlib', 'yaml.constructor', 'importlib.abc', 'numpy._pytesttester', 'datumaro.cli.contexts.project', 'json', 'yaml.events', 'numpy.random.mtrand', 'cv2.detail', 'datumaro.util.image_cache', 'cv2.flann', 'yaml.nodes', 'datumaro.components.dataset_filter', 'tensorboardX.proto.tensor_shape_pb2', 'pycocotools._mask', 'datumaro.cli.commands.remove', 'contextlib', 'pwd', 'numpy.fft', 'google.protobuf.internal.api_implementation', 'termios', '_bootlocale', 'numpy.lib.arraysetops', 'pycocotools', 'git.objects.submodule', 'google.protobuf.internal._api_implementation', 'datumaro.util.command_targets', 'keyword', 'numpy.lib._version', '_collections', 'google.protobuf.pyext.cpp_message', 'numpy.core.defchararray', 'google.protobuf.internal', 'gitdb.db.loose', '_elementtree', 'git.index.fun', 'numpy.compat._inspect', 'unittest.loader', 'numpy.polynomial.hermite', 'cv2.ogl', 'pyexpat', 'xml', '_decimal', 'sys', 'numpy.polynomial.chebyshev', '_random', 'datumaro.version', 'coco_format.extractor', 'numpy.core._add_newdocs', 'numpy.lib.function_base', 'email.quoprimime', 'tensorboardX.torchvis', 'ntpath', 'sre_parse', 'datumaro', 'pycocotools.coco', 'platform', 'datumaro.cli.commands.create', 'numpy.core.getlimits', 'matplotlib._color_data', '_io', '_json', 'binascii', 'git.refs', 'git.repo.base', 'distutils.version', 'numpy.lib.arrayterator', 'email.base64mime', 'unittest.signals', 'defusedxml', 'plistlib', 'traceback', 'datumaro.components', 'numpy.core._methods', 'pkg_resources._vendor.pyparsing', 'pkg_resources.extern.packaging.requirements', 'zipimport', 'pyexpat.errors', 'getpass', 'unittest.result', 'tensorboardX.proto_graph', 'tensorboardX.event_file_writer', 'os', 'google.protobuf.symbol_database', 'pickle', 'stat', 'tensorboardX.openvino_graph', 'os.path', 'email._parseaddr', 'numpy.config', 'matplotlib._version']
2020-09-02 15:43:29,989 DEBUG: CACHEDIR=/home/django/.cache/matplotlib
2020-09-02 15:43:29,990 DEBUG: Using fontManager instance from /home/django/.cache/matplotlib/fontlist-v300.json
2020-09-02 15:43:30,112 DEBUG: Loaded backend qt5agg version unknown.
2020-09-02 15:43:30,140 DEBUG: Loaded backend agg version unknown.
2020-09-02 15:43:30,140 DEBUG: Loaded backend agg version unknown.
2020-09-02 15:43:30,145 DEBUG: Imported the following symbols from coco_format.extractor.py: CocoCaptionsExtractor, CocoImageInfoExtractor, CocoInstancesExtractor, CocoLabelsExtractor, CocoPersonKeypointsExtractor
2020-09-02 15:43:30,145 DEBUG: Imported the following symbols from coco_format.init.py:
2020-09-02 15:43:30,146 DEBUG: Imported the following symbols from coco_format.converter.py: CocoCaptionsConverter, CocoConverter, CocoImageInfoConverter, CocoInstancesConverter, CocoLabelsConverter, CocoPersonKeypointsConverter
2020-09-02 15:43:30,147 DEBUG: Imported the following symbols from coco_format.importer.py: CocoImporter
2020-09-02 15:43:30,147 DEBUG: Imported the following symbols from init.py:
2020-09-02 15:43:30,148 DEBUG: Failed to import module 'openvino_launcher.py': No module named 'openvino'
2020-09-02 15:43:30,149 DEBUG: Imported the following symbols from transforms.py: BoxesToMasks, CropCoveredSegments, IdFromImageName, MapSubsets, MasksToPolygons, MergeInstanceSegments, PolygonsToMasks, RandomSplit, Reindex, RemapLabels, ShapesToBoxes
2020-09-02 15:43:30,149 DEBUG: Imported the following symbols from tf_detection_api_format.format.py:
2020-09-02 15:43:33,034 DEBUG: Imported the following symbols from tf_detection_api_format.extractor.py: TfDetectionApiExtractor
2020-09-02 15:43:33,034 DEBUG: Imported the following symbols from tf_detection_api_format.init.py:
2020-09-02 15:43:33,035 DEBUG: Imported the following symbols from tf_detection_api_format.converter.py: TfDetectionApiConverter
2020-09-02 15:43:33,035 DEBUG: Imported the following symbols from tf_detection_api_format.importer.py: TfDetectionApiImporter
2020-09-02 15:43:33,044 DEBUG: Imported the following symbols from voc_format.format.py:
2020-09-02 15:43:33,053 DEBUG: Imported the following symbols from voc_format.extractor.py: VocActionExtractor, VocClassificationExtractor, VocDetectionExtractor, VocLayoutExtractor, VocSegmentationExtractor
2020-09-02 15:43:33,053 DEBUG: Imported the following symbols from voc_format.init.py:
2020-09-02 15:43:33,054 DEBUG: Imported the following symbols from voc_format.converter.py: VocActionConverter, VocClassificationConverter, VocConverter, VocDetectionConverter, VocLayoutConverter, VocSegmentationConverter
2020-09-02 15:43:33,054 DEBUG: Imported the following symbols from voc_format.importer.py: VocImporter
2020-09-02 15:43:33,055 DEBUG: Imported the following symbols from image_dir.py: ImageDirConverter, ImageDirExtractor, ImageDirImporter
2020-09-02 15:43:33,055 DEBUG: Imported the following symbols from yolo_format.format.py:
2020-09-02 15:43:33,056 DEBUG: Imported the following symbols from yolo_format.extractor.py: YoloExtractor
2020-09-02 15:43:33,056 DEBUG: Imported the following symbols from yolo_format.init.py:
2020-09-02 15:43:33,056 DEBUG: Imported the following symbols from yolo_format.converter.py: YoloConverter
2020-09-02 15:43:33,057 DEBUG: Imported the following symbols from yolo_format.importer.py: YoloImporter
2020-09-02 15:43:33,057 DEBUG: Imported the following symbols from cvat_format.format.py:
2020-09-02 15:43:33,058 DEBUG: Imported the following symbols from cvat_format.extractor.py: CvatExtractor
2020-09-02 15:43:33,058 DEBUG: Imported the following symbols from cvat_format.init.py:
2020-09-02 15:43:33,058 DEBUG: Imported the following symbols from cvat_format.converter.py: CvatConverter
2020-09-02 15:43:33,058 DEBUG: Imported the following symbols from cvat_format.importer.py: CvatImporter
usage: datumaro [-h] [--version] [--loglevel LOGLEVEL]Dataset Framework
optional arguments:
-h, --help show this help message and exit
--version show program's version number and exit
--loglevel LOGLEVEL Logging level (options: error, warning, debug,
critical, info; default: info)Contexts:
project Actions on projects (datasets)
source Actions on data sources
model Actions on modelsCommands:
create Create project
add Add source to project
remove Remove source from project
export Export project
explain Run Explainable AI algorithm for modelRun 'datumaro COMMAND --help' for more information on a command.:
I tried running the same command without the word docker and it gave this Error:
(.env) somilshah:~/Desktop/medanta/cvat$ exec -it cvat bash -c 'python3 datumaro/datum.py --loglevel=debug -h'
bash: exec: -i: invalid option
exec: usage: exec [-cl] [-a name] [command [arguments ...]] [redirection ...]
Looks normal. Could you try with newer version?
Works Well in the new version !! Thanks for replying!
Hi @zhiltsov-max and @somilshah-q , I am experiencing the same issue, just deployed CVAT master branch.
Should be fixed in https://github.com/openvinotoolkit/cvat/pull/2756
@zhiltsov-max confirm, this helped to me.
I built cvat container with updated requirements.txt from this commit: https://github.com/openvinotoolkit/cvat/blob/931cd2bb4525549748697d81fb14f7dae61b7407/cvat/requirements/base.txt
And now I can export dumps and datasets.
Most helpful comment
Should be fixed in https://github.com/openvinotoolkit/cvat/pull/2756