I think you have the best approach in theory. So many people push themselves too far by trying to get to an arbitrary number- 120 pounds, or their weight in high school, or a size 2, etc. I don't have the experience to support this, though. It just seems to me like you will find a place where you are comfortable.
“Do not judge me by my successes, judge me by how many times I fell down and got back up again.” - Nelson Mandela