Three times a week might be enough until your baby becomes more mobile. Bathing your baby too much can dry out your baby's skin. If you're quick and thorough with diaper changes and burp cloths, you're already cleaning the parts that need attention — the face, neck and diaper area.