Had I grown up black, and in that culture, I would probably like hip-hop. I grew up white listening to top-40 and rock. So hip-hop is uninteresting. To me.
If you look at record sales in instances where data has been obtained about the purchaser, you'll find more hip-hop is consumed by non-Hispanic whites than by African Americans. It's totally mainstream.
And "growing up white" is not something that defines your taste. Music is the product of nurture, not nature. And that's why hip hop is so popular among non-Hispanic whites and Hispanics as well as among Blacks.