Down Syndrome - Special Needs
As a father of three children on the Autism Spectrum I can understand exactly what is meant… people focus so much on the "Special needs" which is more about pointing out differences rather than integration and giving purpose: jobs, education - life!
Too many people point out the differences you are correct. It gives them a reason to try and not let that person be friends with them or to not include them in things. It is all part of bullying. It does not matter what they say it is their action that speak louder than words.
The sad thing about this is within we all are the same, its just that some of us have a harder time or a different way of expressing ourselves. My own children (ASD) told me that when they were younger they knew what they wanted to say but could not say it in the way they wanted it to come out. Considering that Down Syndrome has a particular outward appearance people already assume too much about the person before getting to know them - their inside.