There are arrows flashing blue in towns/castles. What are they?

Those are teleporters, but you can disregard them in towns. They don’t have any effect.