That's the problem, none of the legislation says "black people can't be allowed to vote" but we know based on statistics that things like voter ID disproportionately harm people in lower income brackets, which are disproportionately minorities. So we get these wheedling "not racism actually" rulings. There's a massive compounding effect that the restriction of economic opportunity has had over generations.

One of the more direct actions was the dismantling of affirmative action, which was an intentional set of rules set to undo some of this historical aggregated harm.