I think the doubles idea is good!
Although it's hard to play around in any meaningful way, so it just slightly incentivises grabbing extra dice. But there is already huge incentive to grab extra dice, to help get the right paths, especially when you can walk past hallways.