Wow, this has Will Wright written all over it. There's certainly room for some interesting possibilities with all of these systems interacting with each other.
Definitely explore this idea further. It would be great if you could wrangle it into more concrete goals