How do I go about changing my baby's last name to it's father's last name on the birth certificate in the state of Louisiana?

If both you and the LEGAL father agree to the name change, it is a simple matter in family court. Since each county/parish does things a little differently, I would recommend calling the court clerk and asking what you need to do in your specific jurisdiction.