Around here we call Whole Foods Stores - Whole Paycheck stores
I do like to browse through them and their bulk items can be reasonable and if you catch something on sale, it isn't so bad. If I was a weathly woman, I'd shop there more but since I am poor, I make due with Trader Joe's.
To the original poster, you don't need a specialty store for whole foods and even organic foods are becoming more mainstream, but you'll pay for it. It you have room, a healthy and cheap idea would be to grown some of your own stuff. All I have room for are basil plants and an Asian Apple pear tree.
Shop around the edges of the store. That;'s where you are going to find most of your whole foods. Exceptions will exist of course, but that's where most of the more unproicessed stuff seems to be located. Grocers wants us to walk past all the impulse and processed items before we get to the "real" stuff.