No. I figure that my body needs the recovery time. But I am sick very infrequently (generally once a year at most), so it's easy for me to skip the gym time.
Side note, as a general plea to everyone: if you work out at the gym, please stay home when you're sick! There are enough germs at the gym already.