Do you know any cultures that would possibly see people with minor learning disorders as a vulnerability and a burden to society?

Answer 1

Pretty much every culture felt that way in the past, until we started finding out how to diagnose learning disorders and help students overcome them- sometime in the second half of the 20th century. 

Answer 2

well, Nazism springs immediately to mind