I think sometimes it's not so much your weight as your overall appearance and attitude. When I was heavier, I dressed like a homeless bag lady and had this aura of depressed & fughly that surrounded me like a storm cloud. Of course people want to ignore that! Now that I've lost some weight, I'm wearing nicer clothing and portray more confidence and energy. And people (women AND men) seem more friendly, polite, etc.
"I want to be improbable, beautiful, and afraid
of nothing, as though I had wings." (Mary Oliver)