Blenderproc: Errors in scenenet example

[ggaziv]

Please see scenenet example for 1Living-room/lr_kt7_blender_scene.obj, 1Living-room/living_room_33.obj, 1Kitchen/102.obj, 1Kitchen/1-14_labels.obj, 1Kitchen/kitchen_106_blender_name_and_mat.obj, 1Office/3_3dmodel777.obj, 1Office/7_crazy3dfree_old_labels.obj, 1Office/23_3dmodelfree.obj, 1Office/1_3dmodel777_labels.obj, 1Bedroom/bedroom27.obj, and more:

Traceback (most recent call last):
  File "/data/guyga/PycharmProjects/BlenderProc/src/run.py", line 40, in <module>
    pipeline.run()
  File "./src/main/Pipeline.py", line 86, in run
    module.run()
  File "./src/object/FloorExtractor.py", line 212, in run
    ms.fit(list_of_median_poses)
  File "/data/home/guyga/blender/blender-2.91.0-linux64/custom-python-packages/sklearn/cluster/_mean_shift.py", line 381, in fit
    " got %f" % bandwidth)
ValueError: bandwidth needs to be greater than zero or None, got 0.000000

Error: script failed, file: '/data/guyga/PycharmProjects/BlenderProc/src/run.py', exiting.

Also note a different error for 1Office/1_hereisfree_labels.obj, 1Kitchen/9.obj:

Traceback (most recent call last):
  File "/data/guyga/PycharmProjects/BlenderProc/src/run.py", line 40, in <module>
    pipeline.run()
  File "./src/main/Pipeline.py", line 86, in run
    module.run()
  File "./src/object/FloorExtractor.py", line 209, in run
    bandwidth = estimate_bandwidth(list_of_median_poses, quantile=0.2, n_samples=500)
  File "/data/home/guyga/blender/blender-2.91.0-linux64/custom-python-packages/sklearn/utils/validation.py", line 72, in inner_f
    return f(**kwargs)
  File "/data/home/guyga/blender/blender-2.91.0-linux64/custom-python-packages/sklearn/cluster/_mean_shift.py", line 66, in estimate_bandwidth
    X = check_array(X)
  File "/data/home/guyga/blender/blender-2.91.0-linux64/custom-python-packages/sklearn/utils/validation.py", line 72, in inner_f
    return f(**kwargs)
  File "/data/home/guyga/blender/blender-2.91.0-linux64/custom-python-packages/sklearn/utils/validation.py", line 653, in check_array
    context))
ValueError: Found array with 0 sample(s) (shape=(0, 1)) while a minimum of 1 is required.

Error: script failed, file: '/data/guyga/PycharmProjects/BlenderProc/src/run.py', exiting.

[themasterlink]

Thanks, we will investigate this. These scenes are really tricky.

We really need a test to check if all of them work.

[themasterlink]

Please delete that file: 1Office/3_hereisfree_not_labelled.obj as it is not even in meters ...

The name is also not that compelling :D

[ggaziv]

Please delete that file: 1Office/3_hereisfree_not_labelled.obj as it is not even in meters ...

The name is also not that compelling :D

This file in fact wasn't making any problems... Why deleting it?

[themasterlink]

But it should make problems ;) the problem is there is just no warning :D

It is in millimeters, as the config assumes everything is in meters, it doesn't work at all. We could scale it down, but if you check it out in blender, there is more wrong than just this.

[ggaziv]

Got it. Thanks

[themasterlink]

So, I fixed all bugs. I could find with the dataset, I ran all scenes and checked the outputs and all looked as expected.

Assuming you deleted 3_hereisfree_not_labelled.obj, it should work now. I also fixed a texture problem, where the SceneNetLoader did not fix materials, where already a texture was loaded. However, the loaded textures never linked any material, as these don't even exist in the whole dataset.

I will push the changes, after running our whole test pipeline, to be sure that it doesn't break anything else.

[themasterlink]

The new version is now online. This should fix all of your problems and some you haven't described, yet :D

[ggaziv]

When you're good you're good @themasterlink ;)
Flawless !

[ggaziv]

Hi,
Just FYI - Lighting needs to be corrected also for shapenet_with_scenenet: