I listened to the same lotus eaters segment, and I think Carl sums it up accurately as: "He's in favor of white flight" and "You shouldn't have to live near racists".

I don't disagree with either statement, and frankly, neither did Malcolm X. I'll add his quote in a separate reply later.