Not just you. We're unsure of why this slowdown only occurs for some folks and not others.
Right now, best temp fix is to use mouse click controls, and close any other background programs you're running. Playing the game windowed might help slightly too.