Could it be that you try to hard to do it really good as opposed to easing your way into it?
I have a tendency of going full force at my workouts when I first start, end up hurting myself, and then not working out for a while. So I've taught myself to take each new work out as something alien and become use to the routine before giving it my all so that I don't hurt myself.