There's some jankiness with the mouse controls and a bug didn't let me return to a certain room (the one with the hat), but you have something going on there with this idea, keep going!