Yup, that’s spot on! Or said differently, “time increases as you walk around the town clockwise” with the gates closed at midnight.
Beautiful choice there!
Reminds me of the old Myst games