I get what you're saying, but keep a few things in mind..
One, a lot of people (myself included) lose weight quickly in their faces, which really stands out to people
Two, 9lbs is a LOT! The general idea is 10lbs is a dress size
I can see where you're coming from, but enjoy that people are noticing and commenting! That's the best feeling
It's not all that minor. 10lbs won't be as noticable on someone who's much larger.. so keep that in mind