> Whites don't fall into that category.

This is racism. "I know you had it hard, but you're white, so your suffering is less relevant than black person's suffering". You might argue that this is the right thing to do anyway, but it's still racism.