He kept beating your 1s? That's weird. Did he somehow keep tying with you on the 1s? Unless if that portion's broken, I don't think you did anything wrong as long as you roll lower than him. The game is also mostly luck based, so that could be a contributing factor.
