I just rechecked it aaand I might have mistaken the torch lying on the table for one of the wall torches. And then I must have overlooked either one wall torch or the table torch in each playthough !
The wall torches probably dont even have a rigidbody right ? that would have been a very weird bug ^^