I've worked out 5-7 days a week since I was 16 so that's never been an issue for me, it's been my way of eating. I do think you should start, even if it's only 5 minute spurts NOW. You exercise to feel better and you'll be surprised eventually how much energy you'll have
