I wear a much larger size than you, but have always had the same problem, even at times in my life when I was much smaller.
I love The Redcat stores online Woman Within (used to be part of Lane Bryant), Roaman's, Jessica London and OneStopPlus, and bcoutlet).
bcoutlet is the discount/clearance/outlet store and you can reach all of their other stores from this site (at the very bottom of their home page). I LOVE this store, and check it daily, and a bunch of other people must too, because if I don't buy something I like as soon as I see it, it's likely to be gone by the next day (at least in my size or preferred color).
For woven fabrics, I order according to their size charts, but their knit tops and bottoms (except in the Talls) seem to run about a size big.
They have a wide variety of sizes, styles, fabrics, and prices. I like that I can find styles that are comfortable, affordable, and flattering through several sizes of weight loss (drawstring waists, soft knits, casual dresses and skirts...).