📰 Newspapers

Open-source AI like 'a Nazi coach', UN-backed anti-terror group says

Open-source AI like 'a Nazi coach', UN-backed anti-terror group says

A group that aims to prevent the unsafe use of artificial intelligence says open-source AI is like "having a Nazi coach at your disposal, reinforcing your thoughts".

In the months before he was arrested, allegedly on his way to carry out a plan to kill children at a local school, a 13-year-old boy spent hours alone in his bedroom.

During the long, caffeine-fuelled nights in his home in Maryborough, 300 kilometres north of Brisbane, the boy was allegedly radicalised online.

Last month, the Australian Federal Police told a parliamentary inquiry into youth radicalisation that the boy was exposed to extremist content in the "darker corners of the web".

But police allege the boy also used more widely available technology in the lead-up to his arrest.

Analysis of electronic devices seized from the boy's home allegedly found he had asked an AI chatbot, on multiple occasions, to describe mass-shooting scenarios targeting "a Jewish and black festival".

The responses provided by the chatbot were not revealed in court, so it was unclear whether the requests were rejected by the AI model's safety guardrails, the filters and rules designed to ensure the model is used within legal and ethical boundaries.

But Tech Against Terrorism, a United Nations-supported group dedicated to preventing the unsafe use of AI, has raised the alarm that the ability of extremists and terrorists to bypass AI safety guardrails, or remove them altogether, is rapidly accelerating.

In brief

In the months before he was arrested, allegedly on his way to carry out a plan to kill children at a local school, a 13-year-old boy spent hours alone in his bedroom. During the long, caffeine-fuelled nights in his home in Maryborough, 300 kilometres north of Brisbane, the boy was allegedly radicalised online. Analysis of electronic devices seized from the boy's home allegedly found he had asked an AI chatbot, on multiple occasions, to describe mass-shooting scenarios targeting "a Jewish and black festival".

This is the opening of the story, shared with credit to ABC News Australia. The rest of the report — with every detail — continues on the publisher’s website.

Continue reading at ABC News Australia ↗

Cookie settings

Choose which cookies we may use. You can change this at any time from Cookie settings in the footer. Details of each cookie are in the Cookie Policy.

Strictly necessary

Needed for sign-in, security, payments and remembering these choices. Always on.

Preferences

Remember settings such as dark mode.

Analytics & performance

Help us count visits, understand which pages, devices and countries our readers use, and measure how well the site performs – anonymous and aggregated.

Advertising & marketing

Lets advertising partners show and personalise adverts, measure impressions, clicks and visits, prevent ad fraud and pay us – this is how the free site is funded.

🔔 News notifications

Get headlines from NewsHub on this device — even when the site is closed.

You can switch this off at any time. Works on Android, Windows, Mac and Linux browsers; on iPhone/iPad add the site to your Home Screen first.