How about whole wheat toast, spread with light or nonfat cream cheese, and sugar free jam! It's very sweet tasting, but not loaded with sugar. Apple bran muffins are also good!
Do what you need to do to remind yourself of your goals. Put one of those magnetic write on/wipe off boards on your refrigerator and leave notes for yourself
An apple bran muffin may not be as good as a hostess cupcake, but if it helps you lose weight, then it's good enough. I've used that reasoning for myself, lol, and it really helped. Also, get rid of any trigger foods. Why were cupcakes in the house to begin with?
Throw them away, give them away, and don't buy them. If you give in to temptations at the supermarket, see if you can find a shopping buddy that will give you "that look" if you put something evil in your cart
If you feel that you must have these things, try making them homemade, using light recipes. Cooking Light offer incredible recipes for sweets that are lower in sugar and fats than Hostess, and taste better. Store them in the freezer, so you won't grab one on impulse.