I do think that'd be a fun idea! Just a hole in a ditch somewhere that leads to this lil mushroom dictatorship! Adding it to me "do this eventually" list.
I think people will have plenty of inspiration to create all kinds of mischievous scenarios. But I'd be excited to see what you do with it. It's always interesting to catch glimpse how a designer intends something to be used at the table.