Mediapipe: Hand tracking on desktop?

[Allgoerithm]

Is it also possible to build the hand tracking also for a desktop system? If so, how?

[lisbravo]

It is but currently they dont have a video input processor

[jiuqiant]

We do have video input processor,e.g., OpenCvVideoDecoderCalculator. We also have desktop demos for object detection but not for the others.
The concern is we would like to run all the GPU calculators across desktop platforms but GPU support is not that ready yet. We are working on the other desktop demos and will have a better desktop coverage soon.

[wolterlw]

I have built a simple Python demo and wrote instructions on how to built a tflite interpreter that supports custom operations needed.
So far it works for single images only, but adding video support shouldn't be hard.
The hard part would be building a desktop GPU delegate for tflite.

[Allgoerithm]

Wow, this is great!

[mgyong]

@Allgoerithm We have just released v0.6.2 that has hand tracking desktop example. Pls check it out!

[GTron-1729]

Hello Folks, I saw the process of building mediapipe and running hand tracking on desktop and all other relevant details, but I wanted to know whether there is a desktop app for hand tracking using mediapipe which is OS dependant? As in the process for windows, later it gives an error at this line T{}.GetTypeName(), [] { return absl::make_unique>(new T); })); as discussed in this issue https://github.com/google/mediapipe/issues/908 . So as a result, I can run those desktop examples on my Virtualbox mac but not on windows. Also, on mac, it runs but the webcam fps seems very low, is there a way to improve that? Also is there a desktop app that could do hand tracking using mediapipe and which could run on windows? @jiuqiant @mgyong

[jiuqiant]

Hello Folks, I saw the process of building mediapipe and running hand tracking on desktop and all other relevant details, but I wanted to know whether there is a desktop app for hand tracking using mediapipe which is OS dependant? As in the process for windows, later it gives an error at this line T{}.GetTypeName(), [] { return absl::make_unique(new T); })); as discussed in this issue #908 . So as a result, I can run those desktop examples on my Virtualbox mac but not on windows. Also, on mac, it runs but the webcam fps seems very low, is there a way to improve that? Also is there a desktop app that could do hand tracking using mediapipe and which could run on windows? @jiuqiant @mgyong

For now you may do git checkout v0.7.5 to make the hand tracking demo work on Windows.