Your baby's skin color is determined by the genes passed on from you and your partner. Skin color is what is called a polygenic trait, meaning that it depends on more than one gene. Genetics determine melanin, which in turn decides your baby's natural complexion. The more melanin, the darker the complexion.