Sounds like you either need to grind for more experience and levels, or your build needs some work/rework. There isn't just one way to win that fight… critical hits and aphrodisiacs should help at least a bit.
See i tried the crit stuff but the status affect is hard to deal with especially when i instantly goes into 50% because thats when distract doesnt work anymore