actually, most non-racists don't

Buchanan argues against affirmative action: ‘One prefers the old bigotry.’
(Think Progress)