I don't just find it offensive in that context, I find it fucking stupid.
It's not "black and white", per se, it's light and dark. Think about a small group of proto-humans a couple million years ago. Fearing the dark of night, because that's when the nocturnal predators hunted. The light of day brought relative safety. In other words "dark == bad, light == better" is embedded in our very genetics.
And let's not forget that those first early humans were undoubtedly dark skinned. The entire concept of black vs white being a racist thing is laughable.