Meshroom: [bug] significant high (200%+) cpu usage in UI

[skinkie]

Describe the bug
I noticed that the Python process featuring meshroom/ui is consuming 200%+ cpu but, in fact is actually idle.

To Reproduce
Unable to do this. I just open any project.

Log
The usual.

[2020-05-12 11:57:54,421][WARNING] == The following "submitters" plugins could not be loaded ==
  * simpleFarmSubmitter: No module named 'simpleFarm'

Fontconfig error: Cannot scan config file "infinality/conf.d"

Desktop (please complete the following and other pertinent information):

• OS: Linux
• Python version 3.6.10
• Qt/PySide version 5.14.2
• Meshroom version: please specify if you are using a release version or your own build
  
  
  
  • Commit reference (if applicable) 1e5889559b424dd90b8a0a882815660ed2fb92ed
  
  

[ChemicalXandco]

200%+ cpu

How is that? Surely it cant be using more cpu than the cpu on the machine?

This is probably the same problem as #336, there is some problem with the software on some Linux environments apparently.

[skinkie]

200%+ cpu

How is that? Surely it cant be using more cpu than the cpu on the machine?

Sure it can, it could have forked two threads, executed on two cores simultaniously.

This is probably the same problem as #336, there is some problem with the software on some Linux environments apparently.

I might be able to see if I can debug the python proces and see which threads are causing that. Never done that before, but @Baasje85 will probably volunteer to do it in PyCharm.

[natowi]

"Fontconfig error: Cannot scan config file "infinality/conf.d""
I have not seen this error before...
Could you check if the problem persists when you fix this?

[skinkie]

I recently updated freetype2 having infinality support, but did not yet do a eselect infinality and eselect lcdfilter. I think this can be ignored.

[skinkie]

Resolved that issue. After starting meshroom I see a 25% cpu load.

When opening one of my mega projects (1078 camera's, 221.126 points) I instantly hit the 220% usage.

(gdb) info thread
  Id   Target Id                                            Frame 
* 1    Thread 0x7f8d932d0740 (LWP 857423) "python"          0x00007f8d8f4c9ab3 in QWaitCondition::wait(QMutex*, QDeadlineTimer) () from /home/skinkie/.local/lib64/python3.6/site-packages/PySide2/Qt/lib/libQt5Core.so.5
  2    Thread 0x7f8d86692700 (LWP 857425) "QXcbEventQueue"  0x00007f8d938a415f in poll () from /lib64/libc.so.6
  3    Thread 0x7f8d7ffff700 (LWP 857426) "QQmlThread"      0x00007f8d938a415f in poll () from /lib64/libc.so.6
  4    Thread 0x7f8d7e52a700 (LWP 857427) "python"          0x00007f8d93429434 in do_futex_wait.constprop () from /lib64/libpthread.so.0
  5    Thread 0x7f8d7dd29700 (LWP 857428) "python"          0x00007f8d93429434 in do_futex_wait.constprop () from /lib64/libpthread.so.0
  6    Thread 0x7f8d7d528700 (LWP 857429) "python"          0x00007f8d93429434 in do_futex_wait.constprop () from /lib64/libpthread.so.0
  7    Thread 0x7f8d7cd27700 (LWP 857430) "python"          0x00007f8d93429434 in do_futex_wait.constprop () from /lib64/libpthread.so.0
  8    Thread 0x7f8d67fff700 (LWP 857431) "python"          0x00007f8d938a6493 in select () from /lib64/libc.so.6
  9    Thread 0x7f8d677fe700 (LWP 857432) "python"          0x00007f8d93429434 in do_futex_wait.constprop () from /lib64/libpthread.so.0
  10   Thread 0x7f8d66ffd700 (LWP 857433) "python"          0x00007f8d93429434 in do_futex_wait.constprop () from /lib64/libpthread.so.0
  11   Thread 0x7f8d667fc700 (LWP 857434) "python"          0x00007f8d93429648 in do_futex_wait.constprop () from /lib64/libpthread.so.0
  12   Thread 0x7f8d4a6e9700 (LWP 857435) "python:cs0"      0x00007f8d934269e7 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
  13   Thread 0x7f8d49d99700 (LWP 857436) "python:disk$0"   0x00007f8d934269e7 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
  14   Thread 0x7f8d49598700 (LWP 857437) "python:disk$1"   0x00007f8d934269e7 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
  15   Thread 0x7f8d48d97700 (LWP 857438) "python:disk$2"   0x00007f8d934269e7 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
  16   Thread 0x7f8d43fff700 (LWP 857439) "python:disk$3"   0x00007f8d934269e7 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
  17   Thread 0x7f8d437fe700 (LWP 857440) "python:sh0"      0x00007f8d934269e7 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
  18   Thread 0x7f8d42ffd700 (LWP 857441) "python:sh1"      0x00007f8d934269e7 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
  19   Thread 0x7f8d427fc700 (LWP 857442) "python:sh2"      0x00007f8d934269e7 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
  20   Thread 0x7f8d41ffb700 (LWP 857443) "python:sh3"      0x00007f8d934269e7 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
  21   Thread 0x7f8d417fa700 (LWP 857444) "python:sh4"      0x00007f8d934269e7 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
  22   Thread 0x7f8d40ff9700 (LWP 857445) "python:sh5"      0x00007f8d934269e7 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
  23   Thread 0x7f8d27fff700 (LWP 857446) "python:shlo0"    0x00007f8d934269e7 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
  24   Thread 0x7f8d277fe700 (LWP 857447) "python:shlo1"    0x00007f8d934269e7 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
  25   Thread 0x7f8d26ffd700 (LWP 857448) "python:shlo2"    0x00007f8d934269e7 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
  26   Thread 0x7f8d267fc700 (LWP 857449) "python:shlo3"    0x00007f8d934269e7 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
  27   Thread 0x7f8d25ffb700 (LWP 857451) "QDBusConnection" 0x00007f8d938a415f in poll () from /lib64/libc.so.6
  28   Thread 0x7f8cfdbe8700 (LWP 857452) "QThread"         0x00007f8d938a415f in poll () from /lib64/libc.so.6
  29   Thread 0x7f8cf3c50700 (LWP 857514) "python:gdrv0"    0x00007f8d934269e7 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
  30   Thread 0x7f8cf3356700 (LWP 857515) "QSGRenderThread" 0x00007f8d4ea46986 in ?? () from /usr/lib64/dri/radeonsi_dri.so
  31   Thread 0x7f8cf1d3a700 (LWP 857516) "python:gdrv0"    0x00007f8d934269e7 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
  32   Thread 0x7f8cf0d37700 (LWP 857517) "Thread (pooled)" 0x00007f8d934269e7 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
  33   Thread 0x7f8ce3fff700 (LWP 857518) "Thread (pooled)" 0x00007f8d8f552be4 in QString::reallocData(unsigned int, bool) () from /home/skinkie/.local/lib64/python3.6/site-packages/PySide2/Qt/lib/libQt5Core.so.5
  34   Thread 0x7f8ce37fe700 (LWP 857519) "Thread (pooled)" 0x00007f8d8f4c89d2 in QThreadStorageData::get() const () from /home/skinkie/.local/lib64/python3.6/site-packages/PySide2/Qt/lib/libQt5Core.so.5
  35   Thread 0x7f8ce2ffd700 (LWP 857520) "Thread (pooled)" 0x00007f8d934269e7 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
  36   Thread 0x7f8ce27fc700 (LWP 857521) "Thread (pooled)" 0x00007f8d934269e7 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
  37   Thread 0x7f8ce1ffb700 (LWP 857522) "Thread (pooled)" 0x00007f8d934269e7 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
  38   Thread 0x7f8ce17fa700 (LWP 857523) "Thread (pooled)" 0x00007f8d8f552c42 in QString::reallocData(unsigned int, bool) () from /home/skinkie/.local/lib64/python3.6/site-packages/PySide2/Qt/lib/libQt5Core.so.5
  39   Thread 0x7f8ce0ff9700 (LWP 857524) "Thread (pooled)" 0x00007f8d880d75d9 in QHash<int, Qt3DRender::Render::RenderView::StandardUniform>::findNode(int const&, unsigned int) const ()
   from /home/skinkie/.local/lib64/python3.6/site-packages/PySide2/Qt/lib/libQt53DRender.so.5
  40   Thread 0x7f8cc37fe700 (LWP 857802) "QQuickPixmapRea" 0x00007f8d938a415f in poll () from /lib64/libc.so.6

[skinkie]

htop with some magic:

[stale[bot]]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

[skinkie]

keep open (maybe something qt)