Happens to me as well. When I first started practicing IE I did really well and then just "lost it." I then tried dieting and it was a complete disaster.
I still have some days that I feel like I need to "take off a few pounds" but I know any type of restriction will be disastrous and will likely lead to more weight gain. So although I am tempted from time to time to diet, I now know better.