One thing I've learned about exercising outside is that people think about us far less often than we think they do, if that makes sense. If they notice you at all it would most likely be in passing and then only a fleeting thought. People are generally so wrapped up in themselves and what they're doing that they don't notice someone walking down the sidewalk, heavy or otherwise.
