No way to get your money back without using the legal system. You first need to file a criminal complaint with the police, if they will agree to get involved. If they won't, then you'll have to go to court with only your word that the 'friend' did not have permission to use the card. Of course the 'friend' will argue that they did. It will come down to who is more believable, and the whole thing may turn on the answers to these:
How/why did this person have your card in their possession in the first place? If it was in their possession without your knowledge, did you report the card lost or stolen? I think the answer to that is no. It would mean that either you are so careless with your card that you don't know where it is and what's being done with it, or this person did, in fact, have permission to have it in their possession, with the implication being that they could use it.
If it's carelessness, that won't make you look good but you might win, but if it's the other, you're not going to win.
If the police will do something, your chances of winning go up.