I'm pretty sure you miss out on +1 influence and he won't be friendly with you (its been a while since I played so I might not remember correctly)