Invisibility doesn't work with all enemies, Hobgoblins can see you invisible or not, but thralls usually can't see you. Aren't they trying to attack another player behind you while you are invisible? (This is what happens most of the time in the first part of Crota raid)