Are you saying you have only found what Wimborn has? if so doing the mage guild quest line will lead to new weapons or if you need them right away if you go to Gorn (Wimborn Outskirts, Prairies, Gorn Outskirts, Gorn) there are more powerful weapons there but you need to have some gold saved up. Otherwise for early game it would be defeating bandits in the local area which can have very good drops.
Viewing post in Aric's Expansion Rebred
Instructions on installations and upgrades on front page rather clear, you wouldn't be able to get pass new game menu if you bonk it unless game non-modded.
Only thing I can add is the file line User/Username/AppData <- this mark as hidden so will need check Hidden items box from view menu that is on top toolbar to access rest of the line, should be able to follow instructions from there on.