You look at it in too simple terms.
First of all, the USA economic gains since 1979 have gone almost entirely to the top 20%. Middle class barely beats inflation, to lower middle class which fell behind, and minimum wage working poor are cheated. $3.10 in January 1980 is $10.22 now; not $7.25.
Those growing up in poor neighborhoods have lower quality education and bad influences around them.
You went to college because tuition and costs were paid by someone.
When the cards are stacked against people, it's very much harder to succeed.
75% of Black children are not born into traditional family of married mother and father and their biological children. It is also over 60% of Hispanic.
It is not the same country as immigrants coming in and working hard to succeed.
I will grant that work ethic and even genetics can be factors, but to ignore the fact that growing up in poverty is not conducive to succeeding in life is looking at your own world and asking why aren't you in my world?
Recent court rulings explain part of it.
Police arrest vagrants living on the street, and maybe even urinating in public.
People arrested are homeless and public restaurants and other businesses say "customer use only".
Judges ruled, and upheld on appeal, that unless the city provides housing, they cannot arrest people for laws they cannot comply to. Under this same logic, you cannot say poor people deserve to be poor when they really aren't given a fair chance to improve their situation. In reality, they simply don't have the baseline start that you had in life and cannot reference 20, 40, 80, 100 years ago situations because times changed.
It takes a full time 40 hour job of $20 an hour to afford the median price of a one bedroom apartment in the USA.