I fixed it by just saving and restarting the game, but I have to constantly do that since there are multiple things that seem to trigger it.