Im not sure the other answer is correct. After the first town improvement is complete (either fair or watchtower) you can wait and do the next one, but iirc you don't get the option to do a second improvement to Bernard's place.