I really like this idea, a lot of small fixes could be done to this, but it's a really unique concept that makes total sense! I think if it was more of a tile-based/grid-based map, it would be easier to place parts of the map.
