I suffered from severe anxiety with panic attacks for years. In the past two years I'm finally feeling like I have a great handle on these issues and now I'm focussing more on losing weight.
For me, it took medication, therapy and a lot of work educating myself about my conditions.
Are you on medication for your anxiety? Have you visited a therapist?
As scary as this might sound to you right now, the best way to overcome your anxiety is to face those situations that cause you panic face on.