📰 Newspapers

OpenAI releases a new image classifier and ChatGPT warnings to combat CSAM

OpenAI releases a new image classifier and ChatGPT warnings to combat CSAM

ChatGPT will ban an account trying to access CSAM content for 24 hours as a warning

OpenAI today announced new tools to combat child sexual abuse material (CSAM) amid growing safety concerns around the use of AI tools. These features include a new image classifier to detect CSAM, warnings and temporary blocks to prevent users from creating or accessing content that sexualizes children, a new guideline for developers, and a set of tools for law enforcement.

The company unveiled a new image classifier that can detect CSAM images, including the ones generated by AI. OpenAI is giving select companies access to its classifier through its API at no cost. The tool looks for visual signs of abuse in images not seen before and assigns a score that can give an indicative direction to reviewers about dealing with CSAM.

OpenAI said that it developed this classifier with the National Center for Missing and Exploited Children (NCMEC), and it is working with Tech Coalition and ROOST to share access to the tool. In its early testing with partners, the AI company found that the classifier flags 48% fewer images while finding the same number of abusive images, reducing the work of reviewers. Plus, images flagged by the classifier are twice as likely to be abusive images.

What’s more, the company is adding new warning screens in ChatGPT to prevent users from accessing material that sexualizes children.

In brief

OpenAI today announced new tools to combat child sexual abuse material (CSAM) amid growing safety concerns around the use of AI tools. The company unveiled a new image classifier that can detect CSAM images, including the ones generated by AI. OpenAI is giving select companies access to its classifier through its API at no cost. Plus, images flagged by the classifier are twice as likely to be abusive images.

This is the opening of the story, shared with credit to TechCrunch. The rest of the report — with every detail — continues on the publisher’s website.

Continue reading at TechCrunch ↗

Cookie settings

Choose which cookies we may use. You can change this at any time from Cookie settings in the footer. Details of each cookie are in the Cookie Policy.

Strictly necessary

Needed for sign-in, security, payments and remembering these choices. Always on.

Preferences

Remember settings such as dark mode.

Analytics & performance

Help us count visits, understand which pages, devices and countries our readers use, and measure how well the site performs – anonymous and aggregated.

Advertising & marketing

Lets advertising partners show and personalise adverts, measure impressions, clicks and visits, prevent ad fraud and pay us – this is how the free site is funded.

🔔 News notifications

Get headlines from NewsHub on this device — even when the site is closed.

You can switch this off at any time. Works on Android, Windows, Mac and Linux browsers; on iPhone/iPad add the site to your Home Screen first.