I either have to have a plan that counts calories for me, or I have to count them myself. If I have no counting at all, then I eat way more than I would if I were counting and I vastly underestimate how much I'm eating.
I'm not absolutely fanatical about it though. Livestrong.com has most of the foods I eat on a daily basis already, and then for things that don't have an exact count, I let it estimate for me (like a cup of tomatoes or 1/4 cup of shredded mozzarella).
If you can control your eating without counting calories, more power to you! For me, out of sight is out of mind - which can only lead to no good.