Never give a panic attack the power to prevent you from doing anything, that is the first mistake you are making, you're heading down the path to agoraphobia if you do.. It's just a panic attack, it won't hurt you.
Go outside and pay no mind to your fears, take a walk, bring some music with you and before you know it, it will be off your mind and you are concentrating on other things. Photography is known to be a great hobby for people with anxiety, take some pictures of nature.
I have dealt with the worst forms of panic attacks imaginable, and never once in my mind wanted to avoid anything because of them.
You can write me if you have questions about panic attacks, I know everything about them.
btw, I am on Zoloft, and while it makes me feel less depressed, I still have panic attacks, you have to face them head on.. nothing can really help you rid of them except you, that's the harsh truth.