I find that yes rest days are good for you - however - I know if my goal is five workouts a week - that two rest days in a row are BAD. I always have to tell myself it's a slippery slope to not working out at all. Instead of complete rest - I have walked inside a mall and done lighter activity.
