Make sure you have a bow, and have arrows in your inventory.
Open your pouch, select the arrows you want to use with Enter.
Then exit your pouch and make sure to press R to load your arrows up!
As a small caveat, you can't load your weapons inside your tent. And some arrow types require a more sturdy bow to be used.