This game desperately needs a guide. Way, WAY too open-ended. I spent around 3 hours(?) and hardly found any size-related content, aside from the first boss if that counts for anything.
Head west of the town and enter the port. At the bar, purchase a boat from the captain for 750g and head north. A bunch of enemies have surrounded an island. Interact with it, then enter.
