Depends. People who are immersed in a tribal worldview (us vs them) will use “Not one of us” to often justify cruelty or amoral behavior. People who see the world in legalistic terms (good people vs bad people) will use “bad people” to justify similar cruelty. Then people just start changing the definition of “bad person” ( to exclude themselves and those who agree with them, of course).