A smile and polite demeanor will disarm just about everyone.
Here's what's really intriguing about the situation: the people who jump to the conclusion that your bald head makes you a racist probably wouldn't think of themselves as bigoted.