It's not what he said that's the problem. This is a smear campaign that is simply trying to ruin Adams and did the standard thing of reporting a joke/humor as a serious/solemn comment, saying "this is what he said" without mentioning the rest of the context.
Adams was commenting on results of someone else's poll. The poll was about the trite phrase "It's OK to be white" and asked "Do you agree?". Apparently the poll results showed that 74% of blacks disagreed and Adams jokingly said (I'm paraphrasing from memory) "that almost sounds like a hate group.".
Well, the smear campaign took the quote and ran without providing any of the context whatsoever.