Hi! The guests get annoyed when they see you in their room. It's represented by question mark or exclamation mark above their head. Basicly you need to leave the room and wait a bit for them to cool their nerves down.