We went to a seminar where a bunch of RE's gave various talks about TTC. This came up as a topic, and they said in a study women that exercised for more then 4 hours a week, had a less % of getting pg. This was done in an IVF study, but they said same thing is true for women in general. Too much exercise can really mess up the ovulation cycle. So I would say don't go to much over that if you are working out that much.
Also, if you ever get to the point where you are doing injectible drugs, you can't do anything that will "make your ponytail bounce around". Because you are gowing so many eggs you have the possibility of twisting your ovary and making the blood supply be cut off.
Don't worry about it too much though. Clomid is usually pretty safe for working out. Just wanted to give you more info, because I know I like having as much info as I can.