Absolutely it is okay. My toddler has excema, and I bathe her, change her, feed her, dress her--I don't have it. It isn't contagious. However, she shouldn't be touching your baby if she has put steroid creams on it. I have to use those on my daughter, and am suppose to wash my hands after applying it. Other than that, if she is a great potentil-go for it!