Following the whole game flow until after the dialogue tells you that you can now change the time of day and see the latest renders of Lila.
The player is now in control (it's in Freeplay) and if you use the map and go to Village as you say you can re-enter Jim's flat.
At this point is when it won't let you leave Jim's room.
The solution for the moment to this is to use the map again and travel to the Village and you shouldn't have any problems, you can go back into Jim's room and leave whenever you want, you can use the time change and at night go to bed to sleep and the next day the Pizza event will happen.