AI social media moderators harsher than humans, MIT-led team finds


Unwanted post sanctions are coming: Experts believe the AI moderators being deployed to take down inappropriate posts on social media are going to be far too harsh. — Photo: Silas Stein/dpa

WASHINGTON: The alarm around so-called artificial intelligence (AI) and machine learning has prompted the technology’s “godfather” Geoffrey Hinton to lament his life’s work.

AI, the warnings go, could see widespread job losses or worse, should it “get smarter than people”, as Hinton put it when he quit his job at Google in early May.

Hinton’s concerns followed tech business bosses putting their names to a letter calling for a six-month pause on AI advances, lest we “develop nonhuman minds that might eventually outnumber, outsmart, obsolete and replace us” and in turn “risk loss of control of our civilization.”

A less hair-raising warning came on May 10, with the publication in Science Advances of research showing AI to be a harsher judge of social media posts than human counterparts.

AI moderators are used instead of people to clear the backlogs of complaints and reports generated by the fickle billions of social media users, but “often do not replicate human decisions about rule violations,” the researchers found.

Not only that, but AI is "likely to make different, often harsher judgements than humans would,” if not trained with the right data.

“I think most artificial intelligence/machine-learning researchers assume that the human judgements in data and labels are biased, but this result is saying something worse. These models are not even reproducing already-biased human judgements because the data they’re being trained on has a flaw,” said Marzyeh Ghassemi, an assistant professor at Massachusetts Institute of Technology (MIT).

“We are going to end up with systems that are going to have extremely harsh moderations, much harsher than what humans would do. Humans would see nuance or make another distinction, whereas these models don’t,” Ghassemi warned.

So, for anyone who ends up unemployed because of AI, there might be no point posting a fiery complaint on Twitter or Facebook, railing against the injustice of it all. Who knows, an AI moderator might get wind of it and sanction the account. – dpa

Follow us on our official WhatsApp channel for breaking news alerts and key updates!
   

Next In Tech News

Qualcomm saw Nuvia buy as chance to save $1.4 billion a year on Arm fees, CEO tells jury
Pokemon is back with a hit new gaming app
Apple hits out at Meta's numerous interoperability requests
Amazon faces possible US strikes as Christmas looms
Micron Technology expects second-quarter revenue below estimates
Powell says Fed cannot hold bitcoin, not seeking to change that
Two Epic Games directors appointed by Tencent resign, US Justice Department says
Congo sues Apple alleging 'pillaged' minerals in products
BNPL lender Sezzle plunges as short-seller Hindenburg Research takes aim
Firms including chip equipment maker ASML set up fund for Eindhoven development

Others Also Read