Obviously not yet a game, but the idea/POC is interesting and could make for an interesting game :)
Distantly reminds me of some non-Euclidean games.