you have to watch his moves carefully, when he puts up his wand and does the awkward stance hes blocking and you cannot hit him, when he is making a portal on the ground he is doing a special attack or something and you need to block in advance as that is his most powerful move i believe, and when he is idle of course you can hit him.