There was a minor change that removed Allowance as a way to keep Affection dropping (to Amiable) but that has been reinstated in 0838 with a script that also checks for the Materialistic trait.
All drops don't pass below Amiable, however, so if they're Despising you, something else is going on.