I was taught in graduate school (developmental psych) that it's actually very common, perhaps even more common for agoraphobics to be afraid of anxiety or panic attacks in public rather than being afraid of being in public itself, so I would say this really is agoraphobia (at least a recognized sub-type).
In a sense, anxiety disorders share a lot in common. My advice would be to talk to your doctor about it, and even possibly see a psychiatrist or counselor working with a psychiatrist. I'm NOT saying you're crazy, but anxiety disorders, especially if they're not too extreme, respond very well to anxiety medication, and counselors can't prescribe meds, but family doctors and psychiatrists can. A lot of the anxiety medications are very mild, they're not major sedatives that knock you out or make you "drugged up."
For mild anxiety disorders, the meds alone often work very well. It might also be a mild form of OCD (obsessive compulsive disorder), and there's a lot of evidence that anxiety disorders and OCD are not so much psychological disorders that require instense counseling - they're brain chemistry disorders in that you've got yourself in an anxiety loop and your body and brain is responding in a way that reinforces that cycle. Breaking the loop sometimes isn't terribly difficult (counseling alone might do it, but very often an anti-anxiety med is prescribed, either alone or with counseling because it can break the cycle more quickly).
My sister was having anxiety attacks after a traumatic event, and her counseling sessions only lasted about 6 weeks and she was given an anti-anxiety med that she had to take regularly for a while, but was able to discontinue after only a short course. Some people do need the meds longer term, sometimes indefinitely.
If you're opposed to meds, counseling and cognitive/behavioral therapies do often work without meds, they just take longer.



