Mediapipe: Accessing hand landmarks on Android

[aaaldo]

Hello everyone,

I'm planning to use Mediapipe for a Hand control UI prototype on Android. So far, i'm taking inspiration on the advised method for desktop, discussed in this issue (#200).

As a pure Android dev', seeing the time and effort needed to add some basic C++ code conversion for JNI makes me thinkg that it would be a real timesaver for Android dev' to have more native format converters - Landmark, Detections, Location,etc - directly available in the PacketGetter java class.

Can any of those been added on later release ?

[mgyong]

@aaaldo - Yes we are looking to add this shortly in an incoming release.
@eknight7 - FYI

[Sara533]

@mgyong
Is there a plan to release a C++ version base on visual studio?
Or make it available for visual studio by a lib or other methods.
As a pure C++ dev', it is also a problem to use Android projects.

[eknight7]

Are you asking about how to access landmarks on C++ side @Sara533 ?

[Sara533]

@eknight7
I can access landmarks on C++ side. But that is base on bazel build.
I wonder if it is possible to build a lib or dll that can use in visual studio C++ project, just like build an aar for android studio project.
It is difficult to debug via bazel.

[HebaMohamed]

@Sara533 Can you please illustrate more about accessing landmarks from c++ to android java? Im stuck with that for a long time

[Sara533]

@HebaMohamed
Sorry, I have not got landmarks value from c++ to android java.
But via v0.6.3, you can use an aar lib in android studio project follow the instructions.
https://github.com/google/mediapipe/blob/master/mediapipe/docs/android_archive_library.md
I hope that can help you.

[mgyong]

@HebaMohamed @Sara533 @aaaldo Fixed in v0.6.6 Pls check it out and let us know