From the Quiet Meadow's Inn, you wanna head straight downwards, and then go all the way to the left! You'll end up back at the cliffside you started the game at... and there'll be a path further to the south that'll take you to where the veteran's group have gone!
Hope you'll be able to continue playing and enjoy yourself!