It seems to work now. Not sure what happened. :)
Im playing this on a DMG gameboy. I had the same problem but I talked to the guard and then said no problem and then it worked for some reason