You aren't showing signs of infection. It's irritated because you forced the old jewelry out even though it was resisting, and put new jewelry in. And now you're moving the new jewelry around! Stop moving it. Don't touch it. Treat it like a new piercing for a while, until it calms back down. That means doing sea salt soaks (in your case, once per day is fine) - 1/4 teaspoon of sea salt mixed into a cup of warm water. Soak the piercing (you can use cotton balls to help with this, or just stick your nose in the cup) for five minutes. Rinse well, pat dry with a very clean towel (paper towels are good for this.) The soak should calm things back down.
Only move the jewelry, if you must, when it's wet from the soak. But I'd suggest you leave the jewelry alone for now. Let things calm back down.