You're probably in the part of the story where Toru starts avoiding Haato (because of his crush on him). You'll soon after become boyfriends and he'll accept again. He's just trying to hold himself back (it's a story thing :))