📰 Newspapers

OpenAI lays out tools, support to fight spread of child sexual abuse material

OpenAI lays out tools, support to fight spread of child sexual abuse material

OpenAI's new image classifier can identify and help detect CSAM images, including those generated by AI, potentially making it easier for reviewers to do their jobs

MANILA, Philippines – OpenAI announced the release of a new image classifier that can detect potential child sexual abuse material (CSAM), including AI-generated material.

The classifier can identify and help detect CSAM images, including those generated by AI. OpenAI said their new classifier “looks for visual signs of abuse, helping teams identify novel images that may not have been seen before.”

The classifier assigns scores to images it spots, helping content reviewers decide which images may require attention or intervention, and OpenAI said this will be made available to select companies through its API with no cost.

The company added that theirs is “the first CSAM classifier with broad availability that has a specific signal on indicating if CSAM may be AI generated.”

In early testing with partners, OpenAI said the new image classifier flags 48% fewer images but finds the same number of abusive images. This means a potential reduction of work for reviewers, as it noted that images flagged by the classifier are apparently twice as likely to contain abuse.

Intervention

OpenAI also said it is implementing “product warnings in ChatGPT that interrupt attempts to find abusive material, explain the consequences, and point people toward help to stop harmful behavior.”

The company said their warning makes it clear that “sexualizing children causes harm, including when the requested material…

In brief

MANILA, Philippines – OpenAI announced the release of a new image classifier that can detect potential child sexual abuse material (CSAM), including AI-generated material. The classifier can identify and help detect CSAM images, including those generated by AI. In early testing with partners, OpenAI said the new image classifier flags 48% fewer images but finds the same number of abusive images.

This is the opening of the story, shared with credit to Rappler (Philippines). The rest of the report — with every detail — continues on the publisher’s website.

Continue reading at Rappler (Philippines) ↗

Cookie settings

Choose which cookies we may use. You can change this at any time from Cookie settings in the footer. Details of each cookie are in the Cookie Policy.

Strictly necessary

Needed for sign-in, security, payments and remembering these choices. Always on.

Preferences

Remember settings such as dark mode.

Analytics & performance

Help us count visits, understand which pages, devices and countries our readers use, and measure how well the site performs – anonymous and aggregated.

Advertising & marketing

Lets advertising partners show and personalise adverts, measure impressions, clicks and visits, prevent ad fraud and pay us – this is how the free site is funded.

🔔 News notifications

Get headlines from NewsHub on this device — even when the site is closed.

You can switch this off at any time. Works on Android, Windows, Mac and Linux browsers; on iPhone/iPad add the site to your Home Screen first.