There are so many 'small' things that add up to weight loss success or failure you would be amazed. I am a huge advocate of the importance of 'small' things like trying to eat slower so you don't go for that last few spoonfuls and really, something like that can make all the difference.
I can give you one example from my own experience. I have lost roughly 90 pounds in the last 14 months. One third of that is due to simply cutting out....skim milk. Yep I was a milkaholic. And even though skim milk contains no fat, it does have 90 calories every 8 ounces. A conservative estimate for me was 3 glasses a day. I told you I was a milkholic. That works out to 98550 calories a year. 3,500 calories roughly equals one lb. In other words when you burn 3,500 more calories then you take in you should lose a lb of weight. So dividing 98550 by 3,500 you get 28.1. I consumed 98,550 calories less in 12 months by cutting milk out and I lost 28 lbs because of that.
So by getting to 300 calories a day or so you should be losing around 30lbs a year. What I mean by getting to 300 calories is some combination of increased exercise (which burns more calories and keeps your metabolism up and making small changes in diet). So think about some changes you can live with and make them even if they seem small, they add up.

