Nah, jokes are jokes. And even if they're made with ill-intent, I understand that the negative feelings behind them are likely based on negative past experiences or beliefs instilled in that person's youth. As long as the situation doesn't escalate to physical violence, I usually try to handle said negativity with a positive approach that might create a more healthy understanding.