Why do conservatives think that everytime a black person gets a job, it's because of affirmative action?

Is that racism in itself? To believe that the only way a black person could get a job would be because of affirmative action is rather prejudice. Also if you hate affirmative action, why do you love Clarence Thomas so much? Affirmative Action poster child.