I dont know if that was a bug, but the secondary game mechanics is that number disapear, when they are used, so you cant just spam 6 and you can get them back by guessing what will your player have next turn.