the physics are broken, i got rid of the Baby in chapter 1.
you just need to squash it between the fridge doors and the wall, and it will be gone forever.
Also its random teleportation is quite hilarious if you make sure to do the Jobs in a different order. so you can always take the baby with you. Making its random teleportation more Hilarious than creepy/scary.