It would be interesting to see an analysis of DNA percentage from South to North. If there were a significant variation, and the highest concentration of DNA is found North (Scandinavia), then perhaps this can also explain the disappearance of the Neanderthal. I assume here that being 2 different species (or sub-species since they could produce viable offspring), Neanderthals were light skinned and fair, whereas the human population was darker skinned and dark haired.
I take it as a given, that whenever humans saw the blond neanderthal women, their reaction was pretty much the same as today. That is, jaw drops, tongue rolls out, eyes bulge...you get the picture

. If the neanderthal women caused such a reaction, they were probably highly prized and sought after. Given that they were much smaller as a population than humans, it didn't take long for them to be absorbed into the general population, remaining only as percentage of our own DNA. This would explain their apparently non-violent demise. The fact that they were concentrated up North, would explain the reason why Scandinavians are fairer.
We've seen similar scenarios play out in recent history, so don't laugh out loud just yet. When the Turks arrived from Mongolia, they were also short and dark skinned. As soon as they laid eyes on the Balkan women, they preferred them to their own, to the extent that you would never guess that Turks are not an indigenous people in the area they now occupy, while the people that once lived in what is now modern Turkey are nowhere to be seen.
"Not everything that counts can be counted, and not everything that can be counted counts." (Sign hanging in Einstein's office at Princeton)