If you are not in a cage, then you have probably donned the cursed armor of anal torment which also counts towards this.It's removable with an anti-curse scroll.
Can you get rid of the warlock's curse though ? Is there any way to do so ?
Nope, can't remove that.The question is though, why would you ever want to. She'll be there for all your needs and treat you right when you need it ;)