I noticed spacebar would sometimes scroll the page and that's when I would lose control and had to refresh. Maybe it lost control right before I clicked spacebar though.
