There are different skull shapes between races, so we we know there isn't a barrier. The brain is just another organ, why wouldn't it be susceptible to evolution?
Evolution is slow paced. Such a change couldn't have happened in the last centuries or milennia. It'd take a longer time for it to cause a perceivable change.