This has not happened to me--but if someone did say that to me, I would look them right in the eye and say, without anger, "Why would you say something like that to me?" This puts the attention where it belongs, on the dope who made the comment. And then we would have quite a discussion...
Jay