I can relate to this, having gone wheat-free five months ago. It's still hard sometimes, but it's been easier to make peace with it since the effects for me are so immediate and drastic. Never eating wheat again would be a small price to pay for all the benefits, particularly the lack of daily headaches and migraines.
I also tend to prefer a flexitarian diet, but I just can't personally justify to myself going fully and permanently vegetarian/vegan like I can with the wheat-free. Moderation is the compromise there.