No, you don't need to worry. Choosing the wrong option will slightly lower her affinity. You will have to raise it again until she asks the question again.
