You wouldn't even have to go mute individual players if there was a default "mute all outside of your fireteam" button. That way we both get what we want.