Meta’s ‘Supreme Court’ Criticizes Instagram’s Handling of AI Deepfake Porn

Meta’s Oversight Board, known as the social media giant’s “supreme court,” has concluded that Instagram should have removed AI deepfake pornography made of a Indian public figure, highlighting significant gaps in the platform’s content moderation policies and practices. PCMag reports that in a recent investigation, Meta’s Oversight Board has found that Instagram failed to promptly
Meta’s ‘Supreme Court’ Criticizes Instagram’s Handling of AI Deepfake Porn

Meta’s Oversight Board, known as the social media giant’s “supreme court,” has concluded that Instagram should have removed AI deepfake pornography made of a Indian public figure, highlighting significant gaps in the platform’s content moderation policies and practices.

PCMag reports that in a recent investigation, Meta’s Oversight Board has found that Instagram failed to promptly remove an AI-generated nude deepfake of a real Indian public figure. This incident, along with a similar case involving an American woman on Facebook, has brought to light crucial issues in Meta’s approach to handling non-consensual intimate imagery.

The board’s investigation revealed that while the explicit deepfake of the American woman was quickly removed from Facebook and added to Meta’s database of flagged images, the case of the Indian woman was not addressed until the board’s inquiry began. This discrepancy in treatment raises concerns about the effectiveness and fairness of Meta’s content moderation practices.

Meta’s current strategy relies heavily on media reports to identify content for its internal database of flagged images. The Oversight Board criticized this approach as inherently reactive, potentially allowing harmful content to spread before action is taken. The board expressed particular concern for victims who are not in the public eye, as they may face greater challenges in getting their non-consensual depictions removed.

The investigation also highlighted issues with Meta’s policy language. The board found that both AI deepfakes violated Meta’s rule against “derogatory sexualized Photoshop or drawings.” However, they suggested that the policy would be clearer if it focused on the lack of consent and the harm caused by such content, rather than the specific technology used to create it.

Recommendations from the Oversight Board include rephrasing the rules to emphasize that non-consensual sexualized deepfakes of any kind are not allowed, and replacing the term “Photoshop” with a broader term that encompasses various methods of image alteration. Additionally, the board suggested moving this policy from the “Bullying and Harassment” section to the “Adult Sexual Exploitation Community Standard.”

Another area of concern identified by the board is Meta’s policy of automatically closing user reports within 48 hours if no staff member responds. This policy led to the delayed removal of the Indian woman’s deepfake, which was only taken down after the board brought it to Meta’s attention.

The board’s findings come at a time of increasing legislative action against deepfake pornography. The US Senate recently passed the Defiance Act, which would allow victims of deepfake porn to sue creators, distributors, and recipients of such images. Additionally, Sen.Ted Cruz (R-TX) has proposed the TAKE IT DOWN Act, aimed at criminalizing the publication of explicit non-consensual AI deepfake imagery and mandating its removal from platforms like Facebook and Instagram.

Read more at PCMag here.

Lucas Nolan is a reporter for Breitbart News covering issues of free speech and online censorship.

Total
0
Shares
Leave a Reply
Related Posts
DNC Crowd Size Compared to RNC in Photos
Read More

DNC Crowd Size Compared to RNC in Photos

The 2024 Democratic National Convention (DNC) kicked off on Monday in Chicago, drawing immediate crowd size comparisons with last month's Republican National Convention (RNC) in Milwaukee. Supporters of former President Donald Trump, the Republican presidential nominee, took to social media on Monday night to claim that attendance at the DNC paled in comparison to the
Thousands fill central London for Tommy Robinson rally amid chants of ‘We want our country back’ as Met police flood streets with 1,000 officers to keep the peace as capital with anti-racism counter-protest and Trans Pride event also due
Read More

Thousands fill central London for Tommy Robinson rally amid chants of ‘We want our country back’ as Met police flood streets with 1,000 officers to keep the peace as capital with anti-racism counter-protest and Trans Pride event also due

Thousands of protesters who descended on central London with chants of 'we want our country back' for a Tommy Robinson rally. The demonstrators, waving Union, English, Scottish and Welsh flags, have gathered at the Royal Courts of Justice ahead of a march to Trafalgar Square this afternoon. Cries of 'Rule Britannia' have been seen before
Taperoo stabbing: Adelaide grandmother Caroll Hopkinson claims she acted in ‘self-defence’ when she allegedly murdered her husband
Read More

Taperoo stabbing: Adelaide grandmother Caroll Hopkinson claims she acted in ‘self-defence’ when she allegedly murdered her husband

A grandmother allegedly stabbed her husband to death in a desperate act of self-defence after trying to stop him from taking his own life, a court has heard.   Caroll Hopkinson, 58, appeared in Adelaide  Magistrates Court via video link from custody on Tuesday, charged with the murder of her husband Simon in their Taperoo home in Adelaide's