This is such a cool idea! Reminds me of Zelda games with time travel or season change, but the real-time aspect makes it super dynamic.
Do you mind if I take inspiration from your gifs to make a game? (probably on Pico-8, probably not soon, but I would post a link when ready)