I had an occurrence where I was not able to enter the portal from the south side.
The portal was surrounded by three walls on the west, north and east sides.
So I blew up the wall on the left side of the portal and was able to enter the portal from the west side.