Oh, cool idea. That's totally opposite of the way I did it but actually sounds solid and very appropriate for your design goals.
I'm looking forward to playing your game!