You may be too low level or under geared! Ideally LVL 10 and with some decent gear. You can check out the areas outside the castle for gear!
Thanks
