It usually always happens if you get the best ending with them, for Hikaru and Shuu, Haato moved in with both in their respective routes on their endings. (I haven’t done the others yet but assume it is the same)