It is a cool idea! It lacks a bit of the ability to prepare a plan properly and execute it, you end up rerolling dices until the rng got you the piece you need and hoping you have enough rerolls. Maybe having different paths that one could choose to take would solve this. Nice submission :)