For my own part being white I excised it from my vocabulary and told my children they needed to do the same because it could only bring evil their way. Many black people I know think it's vulgar for anyone black or white.
Who knows maybe some time in the future everyone will be throwing it around without a second thought.