I think that the vex were gardeners of the garden, i read that somewhere, but the darkness came and took control of them. The darkness could have done that, so it has an invincible army to use against the traveler. The traveler could be evil, and the darkness is fighting back.