For example, setting Visible to false works fine.
But the next time you save the page, Toggleable will be set to false so it goes back to default value (true) making the page visible again.
Set some settings to false

After save

After a second save without touching anything.

This was tested with a fresh install of 1.6.21 Grav core + Admin from getgrav.org
This seems to be fixed in 1.7
Fixed in form and admin 1.9/1.10.
Most helpful comment
Fixed in form and admin 1.9/1.10.