I don't know if it's a bug or a result of the game engine, but it seems the game does not like constantly spamming z or x since it tends to freeze the game during interactions like skipping through victory screens or pushing people around. Sometimes you can still interact with things in the background but you can't see what's happening.