When in List view, using Ctrl to deselect a game from the list won't actually visually deselect that game until you select/deselect another game. It should deselect the game immediately.
Yes this is just visual, the game is in fact not selected anymore, just the visual focus stays there for some reason.
Fixed in 5.7