It would be useful to have a standard dropout layer. Should be easy to implement.
Could do it the “right” way or could do it the fast way
I think the dropout layer also need two differnet phase on training and testing. This situation is same as BatchNorm.
Most helpful comment
Could do it the “right” way or could do it the fast way