Meta Takes Action Against 5.3 Million Child Exploitation Content Pieces In India

Meta has taken down 5.3 million pieces of child sexual exploitation content from Facebook and Instagram in India between January and June this year. This follows the company’s emphasis on the role of artificial intelligence (AI) in detecting and countering child sexual exploitation material.

Over 98% of child sexual exploitation content detected in India was removed before being reported to the company, according to the parent organization of Facebook and Instagram. According to Meta’s data, 33.2 million items of child sexual exploitation content were eliminated from Facebook and Instagram worldwide in the first half of this year, of which over 97% were discovered and taken down before being reported.

Meta Highlights New AI Safety Tools to Tackle Child Sexual Exploitation

Meta has announced new AI safety tools to detect and counter child sexual exploitation on its platforms. The company stated that bad actors are increasingly using deceptive advertising to lure users into landing pages containing illegal material on third-party websites.

Meta has developed new artificial intelligence tools that can detect suspicious ads and weblinks. For instance, the company has created a new Large Language Model that can detect “signposting,” which is when ordinary-looking web content or communications appears to be leading to illegal content.

Additionally, the company has enhanced its tools to analyze the destination of web links and not just the link provided in the ads. The improved technology enables it to detect malicious destinations and abuse accounts, according to Meta.

New AI Content Sweeps and Account Security Measures

The company has also announced the use of additional AI content sweeps to identify harmful content that evades their current detection systems. In addition, the company is using an AI-powered red teaming technique to uncover vulnerabilities in its safety operations and better understand how perpetrators of cybercrime may exploit its systems.

Meta has improved its account security measures to detect and protect users from suspicious accounts impersonating legitimate accounts that have been banned for violating the company’s policies.

Child Sexual Exploitation Investigations and Report Removals

Meta stated that its child sexual exploitation investigations go beyond just examining harmful content, such as ads and images. For instance, the company’s teams look into and eliminate illicit content and links after spotting something worrying.

The removals come as India has intensified its focus on child sexual abuse material (CSAM), child safety on social media, and online safety. Earlier this year, Meta faced several regulatory challenges after reports indicated that Instagram advertisements facilitated sexual assault accusations.

Meta’s Child Safety Measures and Law Enforcement Collaboration in India

Meta says it prioritizes the safety of children and young people on its platforms. Additionally, the company collaborates with law enforcement to ensure that crimes that come to its attention are investigated. In India, for instance, child safety reports are submitted to the National Cyber Crime Reporting Portal managed by the Indian Cybercrime Coordination Centre (I4C) by law enforcement agencies as required by the applicable laws.

The latest stats on child sexual exploitation materials illustrate the scale of the problem that tech companies face in dealing with illegal content on their platforms. Additionally, it highlights how bad actors are using technology to make it harder for social media firms to detect and delete criminal content. Meta says it will continue to invest in AI content moderation, child safety tools, proactive safety measures, and online safety technologies to detect and remove harmful content faster.