Grimoire says they are all or at least almost all female. Wizards implies male gender... Witches implies female, so that's what we call them.