Personally, going off of what Kaplods said earlier, I don't find that men get a way with it any more than woman do, nor do I feel that their no is more valued or that their is more pressure. But maybe thats just my area and my social groups.

I agree that it sounds rude. It's kind of a flippant way of saying no.