Nevermind I just realised you have to disallow map overlay in the options
I am also going to be posting a patch tomorrow which SHOULD fix this bug forever for everyone. I did extensive testing with a user who had the same issue.