I always found this funny as well. We say ginger cats (chats roux) in French too!

But doesn't roux/rouge just mean "red"?

"Ginger" doesn't mean "red", except for hair color. And that's the interesting part.

Roux is just for hair colour in French. Not the same as rouge.