Experiences At Every Stage Of Life Contribute To Cognitive Abilities In Old Age
Early life experiences, such as childhood socioeconomic status and literacy, may have greater influence on the risk of cognitive impairment late in life than such demographic characteristics as race and ethnicity, a large study has found. "These findings are important," Explained the lead author of the study "Because it challenges earlier research that suggests associations between race and ethnicity, particularly among Latinos, and an increased risk of late-life cognitive impairment and dementia.
Source
Even if that is true the sad thing is at an early job you count on others to help you with your cognitive abilities. So if you were neglected early on then you could be affected later in life through no fault of your own.