[spoiler]They can't be in the main system, closest they can get is the star cluster if they're good, the energy pylons prevent that. Hence the lack of invasions.[/spoiler]