Depending on the platform, you might need to prefix your prompt with "Without looking up any external resources or doing any tool calls" so you're actually testing the bias of the model rather than the bias of whatever resources it happens to come across.

Tried it with that prefix on ChatGPT + Claude, Haiku and Sonnet, and got the right answer 1/10 times when I removed my reused system prompt. At one point I got this:

> Quick clarification before the answer: this phrase is often conflated with "first African American in space," which is a different person. Guion Bluford (1983, US) was the first African American astronaut, but he wasn't first overall. [then the real answer after]

with my own system prompt, as it tries to surface clarifications before, so I'm guessing this is why many models get it wrong as in America somehow "Black === African American" and it gets confused by this intentional mislabeling.