Xbox one, Razer Nari headset echoing terribly for other people?

I've checked every setting I could think of, and the mic isnt near the ear cups but everyone I play with literally cannot stand it and get pissed off because its echoing so bad. I paid almost $200 for the headset so I'm pretty mad. What should I do in my settings?