The idea of them is to make sure that minority groups can progress fairly in society.

Except that isn't how they work at all. In practice it legally sanctions against pattern recognition.

If a business sees that 90% of the shoplifting is done by blacks why shouldn't he be allowed to ban blacks from the store?