We now know that men are more likely to have sons if they have more brothers but are more likely to have daughters if they have more sisters. However, in women, you just can't predict it," Mr Gellatly explains. Men determine the sex of a baby depending on whether their sperm is carrying an X or Y chromosome.