Newborns only worry whether someone is meeting their needs, and it doesn't matter who that is. It isn't until they're between five and eight months old that they begin to miss you. And object permanence is the reason for your baby missing you when you're not there.