Oh...
It's not that you're racist, you're just incredibly naive.
Here's
a starting point with some information.
Ever heard of
Jim Crow laws?
Redlining?
Plessy v. Ferguson?
Plessy was overturned by
Brown v. Board of Education in 1954. But despite that, throughout the country municipalities resisted school integration and bussing. In our own state of Michigan,
Milliken v. Bradley came down in 1974, and similar cases put an end to federal and state action in terms of forcing integration on a reluctant, hostile and generally racist white population.
These days, while overt or explicitly stated discriminatory laws are rejected as unconstitutional, you still have racist gerrymandering, and other incentives intended to roll back the rights of minorities, particularly African American minorities, like Voter ID laws,
which even notable Republican & right-leaning Judges have stopped being fooled by.
you can try to argue that these were just motivated by individual racists within government, and there's no pattern or overall intent, and you maybe right (and would certainly be a popular speaker at CPAC, StormFront, etc.), but these actions have been so pervasive and devasting to African American communities throughout the country and its entire history that I think it's fair to say the situation of blacks today (education in particular, but also wealth, safety, health, and civil rights) is the result of a calculated, consistent policy of totally screwing them over.