I experience all of my worst TOM symptoms the week BEFORE instead of during, but yes, I experience a decrease in energy around TOM. This month, I slept almost an entire day (3 p.m. - 2 a.m., 3 a.m. - 11 a.m.) after coming home and feeling nauseated. So it definitely affects me too.
Some good people on these boards told me to let my body rest when it needs to and to not beat myself up for missing the gym if that's what it takes.