nice work! i like how destruction has no range. you can smash from across the "map" if there is such a thing.
Basically, I do the same raycasting pass to detect a wall, if the wall got detected I destroy it without mercy.