Actually, you may find you lose weight more easily. Some people have issues with fatty food after it is gone - if they eat high fat food, it can go through you more quickly. It doesn't happen to everyone - just some people. DH had his gall bladder out two years ago and finds fatty foods go right through him now (instead of causing him pain). He still doesn't eat that sort of food much because it's still bad for you, but when he is in the mood, he can eat it without worrying about the calories. The down side of that is that you can have loose stool, or diarrhea.
"There is no great genius without a tincture of madness." - Seneca