Basically, I do the same raycasting pass to detect a wall, if the wall got detected I destroy it without mercy.
