I like the game and the atmosphere but could not figure out the puzzle. I think it was time based and that does not fit the game play style. I could be wrong.
Excellent point, the timing aspect did feel clunky and I think you nailed it on the head.