I don't know what's your question. You say you don't like to work with him but then say you have to work with him. I don't see the confusion or problem.
Well, you could always go to HR and tell them that in spite of any contributions that he or those kind of people make, all HR and management...