AI increasingly used for sextortion, scams and child abuse, says senior UK police chief

A picture


Paedophiles, scammers, hackers and criminals of all kinds are increasingly exploiting artificial intelligence (AI) to target victims in new and harmful ways, a senior police chief has warned.Alex Murray, the national police lead for AI, said that the use of the technology was growing rapidly because of its increasing accessibility and that police had to “move fast” to keep on top of the threat.“We know through the history of policing that criminals are inventive and will use anything they can to commit crime.They’re certainly using AI to commit crime now,” he said.“It can happen on an international and serious organised crime scale, and it can happen in someone’s bedroom … You can think of any crime type and put it through an AI lens and say: ‘What is the opportunity here?’”Speaking at the National Police Chiefs’ Council conference in London last week, Murray revealed concerns over emerging AI “heists” in which fraudsters use deepfake technology to impersonate company executives and trick their colleagues into transferring large sums of money.

This year, a finance worker at a multinational firm was duped into paying HK$200m (£20,5m) to criminals after a video conference call in which the scammers were able to convincingly pose as the company’s chief financial officer,Similar cases have been reported in several countries, while the first heist of its kind is believed to have targeted a British energy firm in 2019,Murray, who is director of threat leadership at the National Crime Agency, said the phenomenon was a “high cost, low prevalence crime” and that he was personally aware of ­dozens of cases in the UK,He said that the greatest volume of criminal AI use was by paedophiles, who have been using generative AI to create images and videos depicting child sexual abuse.

“We’re talking thousands and thousands and thousands of images,” Murray said.“All images, whether they are synthetic or otherwise, are against the law, and people are using generative AI to ­create images of children doing the most horrific things.”Last month, 27-year-old Hugh Nelson, from Bolton, was jailed for 18 years after offering a paid service to online paedophile networks in which he used AI to generate requested images of children being abused.The same technology is also being used for sextortion, a type of online blackmail in which criminals threaten to release indecent images of victims unless they pay money or carry out demands.The phenomenon has previously used photos that victims had shared of themselves, often with former partners or abusers who used false identities to gain their trust, but AI can now be used to “nudify” and manipulate photos taken from social media.

Murray said hackers were also using AI to look for weaknesses in targeted code or software and to provide “areas of focus” for cyber-attacks.“Most of the AI criminality at the moment is around child abuse imagery and fraud, but there are a lot of potential threats,” he added.There is mounting concern that apparently benign chatbots could incite people into crime and terrorism after revelations that a man who tried to attack Queen Elizabeth II with a crossbow in 2021 had gained encouragement from a female “AI friend”.Jonathan Hall, the government’s independent reviewer of terrorism legislation, has been researching the potential uses of AI by terrorist groups and highlighted “chatbot radicalisation” as a threat alongside propaganda generation and attack facilitation and planning.Sign up to ObservedAnalysis and opinion on the week's news and culture brought to you by the best Observer writers after newsletter promotionHe found that he was able to create an Osama bin Laden chatbot using a popular commercially available platform, and that it was “very easy to do”.

In a speech at Lancaster House last month, Hall warned: “Even if we don’t know precisely how generative AI is going to be exploited by terrorists, we need a common understanding of generative AI and a confidence to act, and certainly not a reaction that says: ‘This is just too difficult,’“We need to avoid the mistakes of the early internet period where there is a free-for-all,”Murray said that with AI technology becoming increasingly advanced, and more generative text and image software coming on to the market and into widespread use, its exploitation by criminals of all kinds was expected to rise,“Sometimes you can spot if something is an AI image, but very quickly that will disappear,” he warned,“People using this sort of software at the moment are still quite niche, but it will become very easy to use.

“The ease of entry, realism and availability are the three vectors which will probably increase … We, as policing, have to move fast in this space to keep on top of it.“I think it’s a reasonable assumption that between now and 2029 we will see significant increases in all these crime types, and we want to prevent that,” he said.
businessSee all
A picture

Labour could be knocked off course as it sticks to £40bn mission | Heather Stewart

‘“Starmer the farmer harmer”: the placards sported by the army of angry landowners who rolled into Westminster last Tuesday sent a clear message to the prime minister, albeit while he was out of the country.By Thursday, the Treasury was hinting at a retreat, albeit a very modest one, on its plans to levy inheritance tax on larger estates, mooting a transitional regime for the oldest farmers, who may not have time to organise their affairs.Meanwhile, the Bank of England governor, Andrew Bailey, fresh from wading into the future of EU relations, said retailers were right to warn of job losses as a result of Rachel Reeves’s £25bn national insurance contributions (NICs) increase. Scores of companies had written to the chancellor to plead their case.The noisy protests and hurried government consultations conjured botched budgets of the past – George Osborne’s omnishambles in 2012, with its pasty and caravan taxes; Gordon Brown’s abolition of the 10p tax rate in 2007, which Alistair Darling later had to paper over

A picture

Without the EU, the joke is on us if Trump gets his tariffs | William Keegan

‘As democracy is perfected, the office of president represents, more and more closely, the inner soul of the people. On some great and glorious day the plain folks of the land will reach their heart’s desire at last, and the White House will be occupied by a downright fool and complete narcissistic moron.”Those were the words of the great American journalist HL Mencken (in the Baltimore Evening Sun, 26 July 1920). The impending arrival back at the White House surely fulfils his prophecy.Last time Trump arrived in office, he was relatively unprepared

A picture

Remember the global financial crisis? Well, high-risk securities are back

When Margot Robbie made a surprise cameo in the 2015 film adaptation of Michael Lewis’s book The Big Short, she did more to educate the general population about the risks of securitisation than most financial experts.The Australian actor’s brief monologue, notoriously delivered from a champagne bubble bath, explained how banks were bundling up their growing cache of risky sub-prime mortgages into investable bonds, before slicing them up and selling them off for profit.But the proliferation of these mortgage-backed securities in the early 2000s meant there was a catastrophic ripple effect across the global financial system when borrowers started to default on their home loans.The resulting crisis in 2008 triggered a crackdown by regulators. They introduced new rules that could help ensure that asset-backed securities – once allegedly referred to as “crack cocaine of the financial services industry” by the billionaire Guy Hands – would never again spark such a massive meltdown

A picture

Jaguar boss defends new ad and rebrand amid ‘vile hatred’ online

The boss of Jaguar has defended the company’s move away from “traditional automotive stereotypes” after a clip of its new advert was met with a barrage of “vile hatred and intolerance” online.This week, Jaguar Land Rover, the luxury UK carmaker owned by India’s Tata Motors, posted a 30-second clip on X featuring models in brightly coloured clothing set against equally vibrant backdrops, without a car or the company’s traditional cat logo.“If we play in the same way that everybody else does, we’ll just get drowned out. So we shouldn’t turn up like an auto brand,” Jaguar’s managing director, Rawdon Glover told the Financial Times of the company’s “copy nothing” campaign.The new ad and rebrand prompted a backlash online, including on X where the platform’s chief executive, Elon Musk, posted: “Do you sell cars?”In response, Glover said, “Yes

A picture

Energy bills, mortgages, food: will cost of living surge again under Labour?

Labour swept to power in the wake of a cost of living crisis that hit households hard, with the price of food and energy rocketing alongside the impact of Liz Truss’s disastrous mini-budget on mortgage rates.At 2.3%, inflation is nowhere the 10% peak after Russia’s invasion of Ukraine, but it is creeping up, and could hit 3% in 2025, say forecasters.Here are some of the pressures households are likely to face in the coming months at a time when the government claims to be “fixing the foundations” of the economy.Ofgem announced its latest price cap on Friday morning, with average energy bills to increase by 1

A picture

Spain’s floods force some UK sellers to buy oranges from southern hemisphere

Some British retailers and wholesalers have been forced to switch to sourcing oranges from South Africa and South America early after last month’s catastrophic floods in eastern Spain left farmers struggling to harvest and ship their crops.Companies in the UK have moved to buying fruit from the southern hemisphere several weeks earlier than in a typical year to prevent gaps emerging on supermarket shelves and amid fears over the quality of Spanish produce.Persimmons, also known as sharon or kaki fruit, have been affected even worse than oranges by the flooding as they are more delicate than citrus, analysts and industry insiders said.The Valencian branch of Asaja, Spain’s biggest farming association, has estimated that the floods have resulted in losses of more than €1bn for the region’s agricultural sector.“The damage is catastrophic in terms of output, cultivated fields, agrarian infrastructure, agricultural machinery and vehicles, livestock farms and nurseries – and in terms of the lands lost as entire fields have disappeared,” it said