To be fair, at least once it happened while I was trying to run away from something, and it did really add to the tension ^_^. But, usually I was misclicking while just exploring, which was just (very mildly) frustrating.
Haha, that is the exact moment I was hoping to cause, glad to hear it!