Cali, being that you're 5'8..despite your weight, without a doubt you are most likely (visually) looking like you are about 175/180 which is a nice & head turning condition for 5'8.
They're just envious. Not just of your figure...but of the control that you are keeping over yourself. Control can tend to be intimidating. My theory is that if you have "haters" ...you're doing
something right.
Of course you're doing it for your health, in the same boat here. But vanity comes into play & who the heck doesn't want to feel confident, sexy..& attract the eye of another?! Vanity is one of my reasons.
It's natural. Celebrate your feminism & tell the haters, "bite me."