Thank you very much for the detailed feedback, most of the bugs are caused by the auto-rotation algorithm, that I've spent too much time on figuring out, and probably shouldn't've bothered about at all, as it sometimes makes the majority of correct moves for you and sometimes just breaks :)
I will most likely go with manual rotation in the future to rule those bugs out and make the process more interactive.
Thanks for playing!