You can get rocks anywhere by exploring, but I'd recommend going to the riverside. There are no enemies there and you can get plenty of rocks.
