Every stages has its ups and downs. And what seems difficult now will look easy as you enter the next stage.
My daughters are 19 and 16. Looking back, I had thought the infant stage was rough, especially with my oldest, because I was inexperienced and had no one to turn to and was doing it all on my own (my husband read the books and tried to help but we were both new to this). When I had my younger daughter, suddenly, infancy was easy. Ditto for the next stage and so on and so on.
My older daughter was the ideal toddler, her sister was a hell raiser. The older one was a rough pre-teen, her sister was easy. My older daughter suddenly blossomed into a human being around age 16, we are still waiting for her sister to have that metamorphosis.
My older daughter is now a sophomore in college. She knows exactly what she plans to do, how she plans to do it and what it will take. She has had her game plan since she was 17 and has not wavered from it. Her sister is just a bit hazy on those details, but I know she will come around. So technically, I could say that this stage is rough considering my younger daughter, but in about 20 years, I will probably view it as equal to a walk in the park.