I go to a farmers market regularly. However being in the city I find it is quite expensive compared to when I go to markets in small towns or from roadside stands.
This being said it is worth paying more. I would rather buy organic steak from a farmer that can tell me about the meat/cow and so forth. I just eat steak less often.
Some things are more then fairly priced in season as well.