That means you're in a part of the main story with stuff to do inside the city. It happens 99% of the time when you're missing a team member or when it isn't daytime. Just keep playing the main story, you'll get another chance to go outside ^^
Edit.: someone just pointed out that they're unable to leave the city after completing chapter IX. If that's your case, sorry it's totally my fault! The issue is gonna be fixed in the next update. For now you can still do the side quests at any point before he end of chapter IX ;-;