Yeah, I changed the cursor to indicate that the whole device was a button but it didn't end up being clear enough.
Your last bit of feedback game me an idea for some future iterations...