Not a bad concept. Controls not being very well explained are a real issue though and I could barely read the X above the lever, too.
I do like the idea of having to switch hammers for different challenges, but I never felt the need to build anything, and didn't even realize that breaking boxes adds them to your inventory until I was about to walk out the door!