That's what I figured but I guess it was bugged for me:
One my second playthrough I spent my first hour in the coffee shop talking about the concert and when I exited, it looked like it said 5pm. However, after going on the computer and reading manga, it was still at 5pm I think?