Indeed! Crimson Village, the Royal Capital and Arcanletia are all planned locations for the next chapters of the game.
There are no negative consequences for turning characters down, the harem route is pretty much the intended way to play. Some people simply want to opt out of routes so that option is specifically for them