Not unfair. I would maybe suggest it moving based on player direction at least though!
Well in that case it would be hard to kite and fight at the same time
I'm suggesting it because from my experience it forces you to kite in a specific direction, rather than dynamically in response to were the enemies approach you from - and I think that would do a lot to alleviate it is all :)
