Really cool concept. With only three lives, I think D4 is a bit small to start with because it leads to a lot of ties and that reduces the importance of the actually-rolled value.
Ah, you make a very valid point!