See #10841.
Games have icons, and custom can be set with EXTRA_SHORTCUT_ICON/setIcon.
The only trick is that the icon isn't quite the right aspect ratio, although the Vita has the same problem and its UI simply centers the icon and hopes for the best. Maybe that's fine?
-[Unknown]
Perhaps find a way to implement a shortcut creation feature for Windows too? That would be neat so people don't have to fully rely on custom icons.

Most helpful comment
Perhaps find a way to implement a shortcut creation feature for Windows too? That would be neat so people don't have to fully rely on custom icons.