Seems like an interesting idea but the UI needs to be simpler to be effective. Otherwise the complexity can overwhelm a casual player.
