Unless Gerald just saves his creep for female members of the household

This seems very likely, ugh. Maybe it has to do with the whole "women are the generals" thing, like in his mind the boys are trained to follow orders so he he doesn't need to worry about them, he just needs to manipulate the women into his scary mind-set.