Gnome-shell-extension-gsconnect: [DEVEL] Mousepad on Wayland

Created on 19 Oct 2018  Â·  16Comments  Â·  Source: GSConnect/gnome-shell-extension-gsconnect

It would be nice if mouse input could be made to work on Wayland too. There may be options, let's gather them here, so that if someone wants to implement it, there are some starting points.

UX needs testing wayland

Most helpful comment

BAM! (needs testing)

All 16 comments

https://stackoverflow.com/questions/31051173 suggests opening /dev/uinput for writing, though that's probably root-only access.
https://superuser.com/questions/1032270 points to some notes

Do feel free to close when this is out-of-scope (since it is Waylands design to prevent part of this).

It's in the FAQ.

But I agree that it would be good to have an issue here to track this…

Because AFAIK work is done on this, too, as e.g. remote desktop via pipewire is already an experimental feature.

just installed ubuntu 18.10 and vanilla Gnome. "Remote input" only works in "Gnome on Xorg".
Option "gnome" is wayland isn't it?

Correct, currently AT-SPI still doesn't have support for simulating mouse events on Wayland (See: Wayland + Accessibility).

It looks like someone has successfully used the remote desktop API to send mouse events: https://bugzilla.gnome.org/show_bug.cgi?id=709999#c5

Interesting and promising. At the moment, this doesn't seem likely to be usable by GSConnect, since mutter must be compiled with support for remote desktop and it relies on gnome-remote-desktop/pipewire (not core yet I think?).

Hopefully there's some movement on before gnome-shell 3.34, so we might see support included in atspi2. I'll keep an eye on this though, thanks for the link :)

Pipewire support in Mutter 3.32 seems to be enabled by default, judging by how Arch Linux packages it at least.

It's hard to tell for sure without spinning up some VMs, but Ubuntu seems to explicitly build mutter without remote desktop support, although it's probably on in Fedora.

If it's used by atspi2 we can be sure it will be available, but otherwise we will rely on pipewire, gnome-remote-desktop and gnome-shell >= 3.32. gnome-remote-desktop seem to still be living in a private repository, which is why I don't think it's considered core yet.

A proof-of-concept would be nice here. Implementing a low-latency client for the DBus interface (or two) in GJS might have some performance issues. AT-SPI is also effectively a DBus wrapper, but we use the C library so it's not too bad.

Does the built in mouse accessibility support for gnome-shell/mutter 3.34 that just landed help with this?

https://gitlab.gnome.org/GNOME/gnome-shell/merge_requests/474
https://gitlab.gnome.org/GNOME/mutter/merge_requests/512

Does the built in mouse accessibility support for gnome-shell/mutter 3.34 that just landed help with this?

What we really need is for AT-SPI to be supported on Wayland. There seems to be some movement in atspi2-core lately, but we'll have to wait until those changes propagate to see if AT-SPI will work on Wayland.

BAM! (needs testing)

I see a codename for v27 shaping up: "GSConnemeril Edition".

Has anyone else actually been able to get this working? It doesn't seem to work for me on Arch Linux (despite seeing "screen is being shared" in the system menu).

Just had a look through the dogtail stuff. Looks like you also need to set a dconf key for this to work. (No restart necessary.)

gsettings set org.gnome.desktop.interface toolkit-accessibility true
# or
dconf write /org/gnome/desktop/interface/toolkit-accessibility true
Was this page helpful?
0 / 5 - 0 ratings

Related issues

danieldeng2 picture danieldeng2  Â·  4Comments

jorgecodecom picture jorgecodecom  Â·  6Comments

sk0gen picture sk0gen  Â·  4Comments

AngusLogan02 picture AngusLogan02  Â·  4Comments

ricvelozo picture ricvelozo  Â·  4Comments