It's sort of a "gradually I began to hate him" type thing.

Any conversation with him was utterly grating. Probably most annoying was his habit of arguing superiority from agreement.

You'd say something and he'd somehow manage to agree and call you stupid for thinking it at the same time.