There's no point in being "for" or "against" something like diversity. It exists and that's a fact. People do not all think the same, they don't all believe the same thing, and they don't all agree on things. You can't make all the many different types of diversity go away.
For me, the question is how how tolerant should we be as a society of diverse ideas? And how tolerant of intolerance should we be (aka the tolerance paradox)? Obviously we can't tolerate all diversity. For example, when what we’re asked to tolerate comes at the expense of somebody else’s existence or well-being (for example, ideas that threaten the existence of people on the basis of age, race, gender identity, sex, national origin, religion, or disability), showing tolerance for such ideas is in itself deadly. Does that mean I'm "against" diversity because I find something like white supremacy "wrong" and refuse to tolerate it?