British AI startup with government ties is developing tech for military drones

A picture


A company that has worked closely with the UK government on artificial intelligence safety, the NHS and education is also developing AI for military drones.The consultancy Faculty AI has “experience developing and deploying AI models on to UAVs”, or unmanned aerial vehicles, according to a defence industry partner company.Faculty has emerged as one of the most active companies selling AI services in the UK.Unlike the likes of OpenAI, Deepmind or Anthropic, it does not develop models itself, instead focusing on reselling models, notably from OpenAI, and consulting on their use in government and industry.Faculty gained particular prominence in the UK after working on data analysis for the Vote Leave campaign under Dominic Cummings, who went on to serve as Boris Johnson’s adviser.

Johnson’s government later gave work to Faculty during the pandemic, and included its chief executive, Marc Warner, in meetings of its scientific advisory panel.Since then the company, officially called Faculty Science, has carried out testing of AI models for the UK government’s AI Safety Institute (AISI), set up in 2023 under former prime minister Rishi Sunak.Governments around the world are racing to understand the safety implications of artificial intelligence, after rapid improvements in generative AI prompted a wave of hype around its possibilities.Weapons companies are keen to potentially put AI on drones, ranging from “loyal wingmen” that could fly alongside fighter jets, to loitering munitions that are already capable of waiting for targets to appear before firing on them.The latest technological developments have raised the prospect of drones that can track and kill without a human “in the loop” making the final decision.

In a press release announcing a partnership with London-based Faculty, the British startup Hadean wrote that the two companies are working together on “subject identification, tracking object movement, and exploring autonomous swarming development, deployment and operations”,It is understood that Faculty’s work with Hadean did not include weapons targeting,However, Faculty did not answer questions on whether it was working on drones capable of applying lethal force, or to give further details of its defence work, citing confidentiality agreements,A spokesperson for Faculty said: “We help to develop novel AI models that will help our defence partners create safer, more robust solutions,” adding that it has “rigorous ethical policies and internal processes” and follows ethical guidelines on AI from the Ministry of Defence,The spokesperson said Faculty has a decade of experience in AI safety, including on countering child sexual abuse and terrorism.

The Scott Trust, the ultimate owner of the Guardian, is an investor in Mercuri VC, formerly GMG Ventures, which is a minority shareholder in Faculty,“We’ve worked on AI safety for a decade and are world-leading experts in this field,” the spokesperson said,“That’s why we’re trusted by governments and model developers to ensure frontier AI is safe, and by defence clients to apply AI ethically to help keep citizens safe,”Many experts and politicians have called for caution before introducing more autonomous technologies into the military,A House of Lords committee in 2023 called for the UK government to try to set up a treaty or a non-binding agreement to clarify the application of international humanitarian law when it comes to lethal drones.

The Green party in September called for laws to outlaw lethal autonomous weapons systems completely,Faculty continues to work closely with the AISI, putting it in a position where its judgments could be influential for UK government policy,In November, the AISI contracted Faculty to survey how large language models “are used to aid in criminal or otherwise undesirable behaviour”,The AISI said the winner of the contract – Faculty – “will be a significant strategic collaborator of AISI’s safeguards team, directly contributing key information to AISI’s models of system security,”The company works directly with OpenAI, the startup that began the latest wave of AI enthusiasm, to use its ChatGPT model.

Experts have previously raised concerns over a potential conflict of work in the work Faculty has carried out with AISI, according to Politico, a news website.Faculty did not detail which companies’ models it had tested, although it tested OpenAI’s o1 model before its release.Sign up to Business TodayGet set for the working day – we'll point you to all the business news and analysis you need every morningafter newsletter promotionThe government has previously said of Faculty AI’s work for AISI: “crucially, they are not conflicted through the development of their own model”.Natalie Bennett, a peer for the Green party, said: “The Green party has long expressed grave concern about the ‘revolving door’ between industry and government, raising issues from gas company staff being seconded to work on energy policy to former defence ministers going to work for arms companies.“That a single company has been both taking up a large number of government contracts to work on AI while also working with the AI Safety Institute on testing large language models is a serious concern – not so much ‘poacher turned gamekeeper’ as doing both roles at the same time.

”Bennett also highlighted that the UK government has “yet to make a full commitment” to ensure there is a human in the loop for autonomous weapons systems, as recommended by the Lords committee.Faculty, whose biggest shareholder is a Guernsey-registered holding company, has also sought to cultivate close ties across the UK government, winning contracts worth at least £26.6m, according to government disclosures.Those include contracts with the NHS, the Department of Health and Social Care, the Department for Education and the Department for Culture, Media and Sport.Those contracts represent a significant source of revenue for a company that made sales worth £32m in the year to 31 March.

I t lost £4.4m during that period.Albert Sanchez-Graells, a professor of economic law at the University of Bristol, warned that the UK is relying on tech firms’ “self-restraint and responsibility in AI development”.“Companies supporting AISI’s work need to avoid organisational conflicts of interest arising from their work for other parts of government and broader market-based AI business,” Sanchez-Graells said.“Companies with such broad portfolios of AI activity as Faculty have questions to answer on how they ensure their advice to AISI is independent and unbiased, and how they avoid taking advantage of that knowledge in their other activities.

”The Department for Science, Innovation and Technology declined to comment, saying it would not go into detail on individual commercial contracts.This article was amended on 7 January 2024 to clarify that Boris Johnson’s government, rather than Dominic Cummings as an earlier version said, gave work to Faculty during the pandemic, and likewise that it was the government that invited Marc Warner to attend scientific advisory group meetings, which he did in an observer capacity.
trendingSee all
A picture

Six big US banks quit net zero alliance before Trump inauguration

The six biggest banks in the US have all quit the global banking industry’s net zero target-setting group, with the imminent inauguration of Donald Trump as president expected to bring political backlash against climate action.JP Morgan is the latest to withdraw from the UN-sponsored net zero banking alliance (NZBA), following Citigroup, Bank of America, Morgan Stanley, Wells Fargo and Goldman Sachs. All six have left since the start of December.Analysts have said the withdrawals are an attempt to head off “anti-woke” attacks from rightwing US politicians, which are expected to escalate when Trump is sworn in as the country’s 47th president in just under a fortnight.Trump’s vows to deregulate the energy sector, dismantle environmental rules and “drill, baby, drill”, were a big part of his campaign platform and are expected to form a key part of his blueprint for governing the US, the world’s biggest oil and gas producer

A picture

Great Britain’s grid operator calls for extra electricity amid freezing weather

Great Britain’s energy grid operator has asked power plant owners to provide extra electricity by Wednesday evening as freezing temperatures take hold.Demand for electricity is expected to climb between 4pm and 7pm as fresh weather warnings take effect across England, with snow expected as far south as London.The National Energy System Operator (Neso) – which manages the energy systems in England, Scotland and Wales – said it needed an extra 1,700 megawatts of power generating capacity to avoid falling short of the electricity required to power homes and businesses within its normal safety margins.This shortfall, which was flagged by Neso on Tuesday evening, is roughly the equivalent of the output of two to three gas-fired power plants, or the amount of electricity needed to power about 850,000 homes.In an official market notice, the grid operator said: “We would like a greater safety cushion [margin] between power demand and available supply

A picture

Elon Musk’s Tesla has received almost £200m in UK grants since 2016

Elon Musk’s electric vehicle company has received almost £200m in grants from the UK government since 2016, according to analysis.Tesla, which is run by the tech billionaire who has become increasingly vocal about the UK government, has received £191m from Westminster through grants, according to Tussell, which analyses public contract data.The bulk of the funds came from the Department for Transport (DfT), which has given the company £188m over that period.The transport funds related to the plug-in car grant, which was designed to encourage the uptake of EVs and plug-in hybrids. Introduced in 2011, the grant provided a discount towards the cost of new plug-in cars, initially at £5,000, until the scheme ended in June 2022

A picture

Meta scrapped factcheckers ‘because systems were too complex’

The co-chair of Meta’s oversight board said the company’s systems had become “too complex”, as the chief executive of Elon Musk’s X welcomed its decision to scrap factcheckers.Helle Thorning-Schmidt, the co-chair of the social media company’s oversight board and the former prime minister of Denmark, has said she and the departed president of global affairs, Nick Clegg, had agreed “Meta systems have been too complex”, adding that there had been “over-enforcement”.On Tuesday, Mark Zuckerberg made the surprise announcement that the Facebook owner would move away from using third-party checkers to flag misleading content in favour of notes from other users.The 40-year-old billionaire said that, starting in the US, Meta would “get rid of factcheckers and replace them with community notes similar to X”, as the company moves to prioritise free speech in the run-up to Donald Trump’s return to the White House.The move came only days after Clegg, Britain’s former deputy prime minister, left Meta after six years at the company, most recently in the role of president of global affairs

A picture

Peter Hain urges South Africa to protest Afghanistan game at Champions Trophy

The veteran anti-apartheid campaigner Peter Hain has called on Cricket South Africa to challenge the ban on women’s and girl’s cricket in Afghanistan. In a letter seen by the Guardian, Lord Hain urges the Cricket South Africa’s chief executive, Pholetsi Moseki, to take up the issue with the International Cricket Council before South Africa’s Champions Trophy match against Afghanistan in Karachi on 21 February.In a particularly striking passage, Hain draws a direct parallel of apartheid with the Taliban’s oppression of women’s rights in Afghanistan. “Having struggled long and hard for black and brown cricketers to represent their country like whites did exclusively for nearly a century, I hope that post-apartheid South African cricket will press for similar rights for all women in world cricket,” Hain tells Moseki. “Will South African cricket please raise the plight of Afghan women cricketers in the ICC and express firm solidarity with Afghan women and girls who wish to play?”Hain, who rose to prominence by challenging the South African rugby and cricket tours during the early 70s, reminds Moseki that female participation in sport has been outlawed since the Taliban’s return to power in 2021

A picture

The Spin | ‘Deep, minging, unpleasant’: cricket’s flooding problem is getting worse

ECB has been in touch with 27 clubs so far this storm season as the climate crisis bites. What can game do to stay afloat?The water started flowing into the New Road practice area at about 4pm on Monday afternoon, and just kept on rolling. It flooded the entire ground and half the car park, as well as the nearby racecourse, the rowing club and the public footpath – which is now a popular hang-out space for swans. The head groundsman, Stephen Manfield, a man of a remarkably perky disposition, sits on the balcony of the club’s sports bar watching the fourth flood of the season do its business, the water coming in from the burst banks of the Severn as well as round the back across the fields. For the benefit of Spin readers he pokes his measuring stick into the water – “four-and-a-half feet in the shallow end” – and still rising