top | item 40605681

(no title)

Booktrope | 1 year ago

> It's a completely generic algorithm. If the school had a uniquely high percentage of any "group" of people, whether based on race, region, hobbies, interests, literally anything, ads for that school would be more likely sent to people in those groups.

Um, oops. There are laws against discriminating on the basis of race, like, steering Black people to different schools on that basis. That's the difference.

When you say, it's a neutral algorithm because it steers people on the basis of other factors as well, you miss the whole point of having anti-discrimination laws. There's no law prohibiting steering on the bases of "hobbies, interests, literally anything". So when you say the algorithm is okay for that reason, you're saying discrimination based on race is okay if you also discriminate on other, lawful grounds. That seems to me like saying, race discrimination ought not be unlawful. If that's your opinion so be it, but an algorithm that steers people based on race is racially discriminatory.

For example, as Meta previously recognized, steering people seeking apartments based on their race was racially discriminatory, even though steering people seeking apartments based on hobbies or interests isn't that kind of discrimination. The argument you're making would apply equally to steering based on race in connection with jobs, housing, education, and all other areas of society, permitting racial steering because there's an algorithm involved that doesn't just include racial discrimination.

Meta hopefully will recognize this was a mistake, and hopefully will do the right thing by adjusting their algorithm to refrain from steering people in this way based on race.

discuss

order

No comments yet.