AI-generated child sexual abuse imagery reaching ‘tipping point’, says watchdog

A picture


Child sexual abuse imagery generated by artificial intelligence tools is becoming more prevalent on the open web and reaching a “tipping point”, according to a safety watchdog,The Internet Watch Foundation said the amount of AI-made illegal content it had seen online over the past six months had already exceeded the total for the previous year,The organisation, which runs a UK hotline but also has a global remit, said almost all the content was found on publicly available areas of the internet and not on the dark web, which must be accessed by specialised browsers,The IWF’s interim chief executive, Derek Ray-Hill, said the level of sophistication in the images indicated that the AI tools used had been trained on images and videos of real victims,“Recent months show that this problem is not going away and is in fact getting worse,” he said.

According to one IWF analyst, the situation with AI-generated content was reaching a “tipping point” where safety watchdogs and authorities did not know if an image involved a real child needing help,The IWF took action against 74 reports of AI-generated child sexual abuse material (CSAM) – which was realistic enough to break UK law – in the six months to September this year, compared with 70 over the 12 months to March,One single report could refer to a webpage containing multiple images,As well as AI images featuring real-life victims of abuse, the types of material seen by the IWF included “deepfake” videos where adult pornography had been manipulated to resemble CSAM,In previous reports the IWF has said AI was being used to create images of celebrities who have been “de-aged” and then depicted as children in sexual abuse scenarios.

Other examples of CSAM seen have included material for which AI tools have been used to “nudify” pictures of clothed children found online.More than half of the AI-generated content flagged by the IWF over the past six months is hosted on servers in Russia and the US, with Japan and the Netherlands also hosting significant amounts.Addresses of the webpages containing the imagery are uploaded to an IWF list of URLs which is shared with the tech industry so they can be blocked and rendered inaccessible.The IWF said eight out of 10 reports of illegal AI-made images came from members of the public who had found them on public sites such as forums or AI galleries.Meanwhile, Instagram has announced new measures to counteract sextortion, where users are tricked into sending intimate images to criminals, typically posing as young women, and then subjected to blackmail threats.

Sign up to TechScapeA weekly dive in to how technology is shaping our livesafter newsletter promotionThe platform will roll out a feature that blurs any nude images users are sent in direct messages, and urges them to be cautious about sending any direct message (DM) that contains a nude image.Once a blurred image is received the user can choose whether or not to view it, and they will also receive a message reminding them that they have the option to block the sender and report the chat to Instagram.The feature will be turned on by default for teenagers’ accounts globally from this week and can be used on encrypted messages, although images flagged by the “on device detection” feature will not be automatically notified to the platform itself or authorities.It will be an opt-in feature for adults.Instagram will also hide follower and following lists from potential sextortion scammers who are known to threaten to send intimate images to those accounts.

cultureSee all
A picture

Jerry Seinfeld says he was ‘wrong’ to blame ‘extreme left’ for killing comedy

Jerry Seinfeld has backtracked on comments he made earlier this year blaming the “extreme left and PC crap” for negatively affecting comedy, saying he now believes “it is not true”.The 70-year-old comedian told the New Yorker in April that he believed television comedy was suffering because “people [are] worrying so much about offending other people”.“Nothing really affects comedy. People always need it. They need it so badly and they don’t get it,” he said

A picture

Kimmel on Trump’s latest attacks: ‘When they go low, they go really low’

Late-night hosts looked back at Donald Trump’s most recent, unhinged rallies and at the damage that some of his more harmful comments have had.On Jimmy Kimmel Live!, the host said that it “feels like the longest election campaign of all time” with just a few weeks left. He joked that we are now in the “somebody please put Trump in a home stretch”.Kimmel said that at this stage “it’s hard to believe that anybody is going along with” the former president given his recent behaviour.Trump recently visited Aurora, Colorado, a city he has demonised by claiming that Venezuelan immigrants have turned it into a war zone

A picture

Calls for ACCC investigation into live music industry amid warnings artists may be getting ‘ripped off’

Calls are mounting for the Australian Competition and Consumer Commission (ACCC) to investigate business practices in the live music industry, as the ABC prepares to air a Four Corners report scrutinising the Australian arm of the live entertainment behemoth Live Nation.The public broadcaster began promoting the Monday night program late last week, alleging monopolistic behaviour and “maximising profits at the expense of both consumers and artists”.The 30-second screen promo includes Midnight Oil frontman and former Labor arts minister Peter Garrett accusing Live Nation of “misusing its market power” and “calling the shots” at the expense of artists and consumers.Before the program aired, Live Nation issued a statement, saying that based on the promotional material it had seen the company was expecting an “inaccurate and unbalanced” story.“The program was obviously fully formed without any input from Live Nation,” the statement said

A picture

‘It’s quite a thing to do a show here and openly use the word looting’: artist Hew Locke on decolonising the British Museum

After his triumphant Tate installation, The Procession, the artist is preparing a radical exhibition tackling Britain’s imperial past. He talks about why we must return plundered artefacts and rethink attitudes to heritageWithin the oak-panelled walls and glass display cases of the Enlightenment Gallery of the British Museum – a long, impossibly high-ceilinged room that is a temple to the gods of reason and imperialism – there is a little unmarked secret door, leading backstage or who knows where. You would never spot it unless you were looking. But for the rest of the autumn – for the first time in its 200-year history – that door will be symbolically flung open and three raucous figures will be emerging from it, invading the hushed space of marble busts and dinosaur fossils and leather-bound books. Leading the charge will be a young child of indeterminate heritage, in rags and patches, calling the others on

A picture

Sculpture by the Sea 2024: giant melanoma on Sydney beach to deliver ‘message that will be hard to ignore’

Sculpture has a knack of provoking debate. The medium’s ability to divide viewers on the aesthetics of a work – and often its cost to the public purse – can make sculpture a polarising subject. But it’s rare for a work to claim it may save lives.Working in the field of advertising, Sydney creative Andrew Hankin is not above hyperbole. But his team’s entry into this year’s Sculpture by the Sea could very well save a life or lives, as visitors to Tamarama gaze down in horror/awe/morbid fascination at a gargantuan sculpture resembling a melanoma

A picture

Melissa Leong: ‘The weirdest thing I’ve done for love? Live on an abattoir’

The food personality and Dessert Masters judge raves about meat, Michelle Yeoh and macho moviesYou’re a judge on this year’s Dessert Masters. What are you secretly the master of?I am the master of dodging a question. I feel like the last couple of years have been a good time to flex my media training. You don’t always want to, as human beings, share everything of who you are. I feel like I can say what I want to say, but keep a little bit for myself