Definitely do it!! I know what you mean, my husband is slim, muscular, fit to the extreme and I am, well, quite larger!
I used to be insecure when we first started dating, but this man loves me for ME, and he loves my body the way it is too! Just like your man, my man wanted me fully, not partially. One thing that helped me was to just let myself GO, just be me. I have never looked back, and he let's me know all the time how beautiful and sexy he thinks I am, and I believe him now! Your man is not going to judge you based on ANY of the things you see wrong with yourself, TRUST ME!
Let go, it's hard at first, but like riding a bike it gets easier and easier and one day you will look back and giggle a little on why it took you so long to just be you no matter what!
I will also say, that some flattering lingerie and some candles can do wonders for your self esteem!