Vtk-js: mobile pan problem

[hwkim0325]

We want to use mobile double touch and pan, however we failed to use double touch action.

How can I use a double touch in my mobile circumstance?

Here is my code.

const fullScreenRenderer = vtk.Rendering.Misc.vtkFullScreenRenderWindow.newInstance({ background: [0.2,0.2,0.2]});

const renderer = fullScreenRenderer.getRenderer();
const renderWindow = fullScreenRenderer.getRenderWindow();

const interactorStyle = vtk.Interaction.Style.vtkInteractorStyleManipulator.newInstance();

const TrackballRotateManipulator = vtk.Interaction.Manipulators.vtkMouseCameraTrackballRotateManipulator.newInstance({ button: 1, });
const TrackballZoomManipulator = vtk.Interaction.Manipulators.vtkMouseCameraTrackballZoomManipulator.newInstance();
const TrackballPanManipulator = vtk.Interaction.Manipulators.vtkMouseCameraTrackballPanManipulator.newInstance({ button: 1, shift: true, });

interactorStyle.addMouseManipulator(TrackballRotateManipulator);
interactorStyle.addMouseManipulator(TrackballZoomManipulator);
interactorStyle.addMouseManipulator(TrackballPanManipulator);

TrackballZoomManipulator.setScrollEnabled(2);

fullScreenRenderer.getInteractor().setInteractorStyle(interactorStyle);

//always get gesture
//const CompositeGestureManipulator = vtk.Interaction.Manipulators.vtkCompositeGestureManipulator.newInstance();
const GestureCameraManipulator = vtk.Interaction.Manipulators.vtkGestureCameraManipulator.newInstance();
interactorStyle.addGestureManipulator(GestureCameraManipulator);

[floryst]

Hi, I don't think double touch is supported, but would be very useful to add. For reference, the touch handling code is here: RenderWindowInteractor#L552. I may take a closer look later.

@jourdain what do you think?

[jourdain]

@floryst it will be really nice especially if you have time. I'm currently swamp and can't be of much help right now.

[floryst]

I'll take a look into it.

[5dh15]

@floryst Did you figured it out?
I'm dealing with this problem, I think the vtk.js library doesn't support the multi-touch function on mobile invironment.
I think we can solve it with add a translucent button in mobile interface way.
The solution is, when someone touch and drag this button, the object going to panning on the mobile web invorionment.

But I want to solve this issue by implement multi-touch panning function, not the other litte tricks.
If you still looking this problem, tell me which step you currently on.

[floryst]

I'm beginning to look into it, and there appears to be some multi-touch pan code from a first glance, but I haven't verified. My initial plan is to add code that handles pan/pinch/rotate, and then figure out how we would want to integrate it. Maybe a multitouch event that users can then decide what to do with it.

[floryst]

Check out PR #1542. It should resolve the pan issues.

[floryst]

You can now check out the InteractorStyleManipulator example on your smartphone and it should support two-finger pan via vtkGestureManipulator.

[hwkim0325]

Thank you so much!.

[5dh15]

@floryst Thank you!
@jourdain Thank you!