I don't know if that's really ruining Gambit but it is a quest objective that probably shouldn't be a thing. It's possible but since the invader is normally so far away it's almost impossible to kill them with a HC before they use sleeper, sniper, or a linear fusion rifle on you.