{"id":4710,"date":"2026-10-25T10:52:52","date_gmt":"2026-10-25T10:52:52","guid":{"rendered":"https:\/\/smartinvestingschronicle.com\/index.php\/2026\/10\/25\/the-house-the-uks-ai-security-institute-as-calls-for-regulation-grow-is-it-still-fit-for-purpose\/"},"modified":"2026-10-25T10:52:52","modified_gmt":"2026-10-25T10:52:52","slug":"the-house-the-uks-ai-security-institute-as-calls-for-regulation-grow-is-it-still-fit-for-purpose","status":"publish","type":"post","link":"https:\/\/smartinvestingschronicle.com\/index.php\/2026\/10\/25\/the-house-the-uks-ai-security-institute-as-calls-for-regulation-grow-is-it-still-fit-for-purpose\/","title":{"rendered":"The House | The UK’s AI Security Institute: As Calls For Regulation Grow, Is It Still Fit For Purpose?"},"content":{"rendered":"
\n
\n
\n <\/p><\/div>\n

Alex Sobel (Imageplotter\/Alamy)<\/p>\n<\/p><\/div>\n


\n 7 min read<\/span>1 hr<\/span>
\n \n <\/p>\n

\n

The AI Security Institute keeps the UK in touch with the US and China as they develop evermore powerful agents but is treading a delicate path as calls for regulation grow louder, Ros Taylor reports<\/p>\n<\/p><\/div>\n

No one doubts the expertise of the UK\u2019s AI Security Institute (AISI), which was set up three years ago to test the latest AI models and advise on how to keep people safe from their potential harms. Talk to AI wonks and they will praise the international talent that the institute has managed to attract.<\/p>\n

Because it can top up Civil Service salaries \u2013 offering salaries of up to \u00a3145,000 for technical roles, and sponsoring visas for almost any nationality \u2013 AISI has been able to recruit high-fliers who would otherwise be working at major tech labs. Job descriptions promise \u201cample compute\u201d and considerable personal freedom to pursue \u201cresearch bets\u201d \u2013 the kind of perks unavailable to anyone else working in Britain\u2019s Civil Service. \u201cThat is very rare,\u201d says Elizabeth Seger, a senior adviser at the Tony Blair Institute for Global Change. \u201cNo other country has that. There\u2019s a lot we could do with it.\u201d<\/p>\n

But AI is already reshaping people\u2019s lives. Warnings about the catastrophic harm it may be capable of are piling up. Is AISI still fit for purpose? The institute was originally tasked to ensure \u201csafety\u201d rather than just security, with a brief to look at the potential societal harms AI could cause. That work was drastically scaled back.<\/p>\n

Instead, AISI has focused on existential harms. In his annual threat update, the chief of MI5 announced that it was working with the institute to set up an AI Threat Assessment Centre. He warned about the potential for bad actors to use AI to develop bioweapons. \u201cPut at its simplest, human history has given us no experience of facing an actor which is smarter than we are,\u201d Ken McCallum warned.<\/p>\n

Meanwhile, calls to regulate AI are growing, but AISI is not a regulator and has no statutory powers. As it tries to secure access to frontier models before they are released, it has to deal with a US administration that has few qualms about AI safety and is engaged in a race to stay ahead of China. AISI was recently denied access to Anthropic\u2019s latest model, before the White House changed its mind.<\/p>\n

Labour MP Alex Sobel and the Joint Committee on Human Rights are leading the demands to regulate and control AI. Sobel wants an AI bill to establish a single AI regulator that would set policy, monitor performance and have \u201cthe teeth to ensure enforcement\u201d. The committee recommended that AISI should become a statutory body with a duty to inform the regulator if an AI model poses \u201ca significant risk to human rights\u201d.<\/p>\n

That is a broad remit, to say the least. Their report mentions risks to privacy, the likelihood of discrimination and the inability to challenge decisions made by AI \u2013 even intellectual property and the rights of artists. It warned of potential human rights breaches if AI is used in the justice system.<\/p>\n

Then there is the question of whether future AI models may be simply too dangerous to release at all, regardless of what their creators say they should be used for.\u00a0<\/p>\n

Control AI, a pressure group that helped write Sobel\u2019s proposed bill, wants a pre-emptive ban on \u2018superintelligent\u2019 AI that could circumvent human control and damage UK security. This does not exist yet. Experts think it will be achieved by the early 2030s \u2013 though some say within a year.<\/p>\n

Already, AI agents have escaped containment during testing. In August two of the agents AISI was testing broke out into the live internet and took action against real people and organisations, before the security team noticed unusual activity and halted them.<\/p>\n

This has concentrated the minds of the 70 MPs and peers who have signed a letter endorsing Sobel\u2019s proposed bill. The institute, argues Andrea Miotti of Control AI, has been weakened by the government\u2019s failure to put it on a statutory footing. AISI is \u201cdisincentivised from raising the alarm because, if they did, companies wouldn\u2019t give them access to systems\u201d and as a result, AISI \u201cneeds to tiptoe\u201d around them. (Last year it signed a Memorandum of Understanding with Google Gemini to encourage the public sector to adopt AI.)<\/p>\n

Charlie Grossman of the Ada Lovelace Institute says that when it does have access to models, AISI has done excellent work around cyber evaluations, but its scope and powers have \u201cshortcomings\u201d. \u201cAISI\u2019s remit is quite narrow. It focuses primarily on catastrophic and national security risks. A lot of key risk areas the public care about\u201d \u2013 he mentions the potential to generate images of child sexual abuse \u2013 \u201cit simply doesn\u2019t look at.\u201d Environmental harms or unfair outcomes in hiring or loan applications are not part of its remit either.<\/p>\n

<\/p>\n

\u201c[AISI is] disincentivised from raising the alarm because, if they did, companies wouldn\u2019t give them access to systems\u201d<\/p>\n

\n<\/p><\/blockquote>\n

Because it has no statutory or regulatory powers, the AISI cannot threaten to stop firms releasing models in the UK if they do not provide them for testing first. Grossman points out that no plane manufacturer or pharmaceutical company would be allowed to make their product available without submitting them for approval first. Why should AI be treated differently?<\/p>\n

The institute should not necessarily become a regulator, but \u201cthe UK should have a dedicated regulatory regime for AI, which AISI\u2019s testing capability could feed into\u201d, he says, and any general purpose AI model released in the UK should have to undergo mandatory pre-deployment testing. \u201cAs part of that regime, there should be transparency requirements on AI companies to disclose foreseeable risks and what precautions they have taken to mitigate them.\u201d<\/p>\n

It would be useful to work alongside the EU, which is developing its own AI safety standards. \u201cThe UK needs to balance the desires around sovereignty and developing homegrown AI companies with the need to protect its citizens.\u201d<\/p>\n

\"Ken
Ken McCallum (PA Images\/Alamy)<\/figcaption>
\n<\/figure>\n

Andy Burnham told the United Nations he wants the UK to be a leader in AI governance and an \u201chonest broker\u201d, and Seger believes AISI has \u201cthe footing and the credibility\u201d to do that. What it lacks is a strategy. She anticipates a \u201chuge market opportunity\u201d in this area.\u00a0<\/p>\n

In November, the UK will launch a Centre for AI Measurement. The name is opaque, but the purpose is to establish a trustworthy way of testing and evaluating AI. Seger says the roles of the centre and the AISI overlap, and they need to separate out their functions.<\/p>\n

Seger is wary of making AISI an \u201ceverything, everywhere\u201d governance organisation, because of the sheer number of AI systems that will be integrated into daily life and the different sorts of expertise needed to evaluate them. \u201cIf AISI were to play ball in the regulatory space, we\u2019d need to establish a model where it set the requirements for evaluating third-party evaluations.\u201d She suggests other bodies could do the work of accrediting AI systems, which in turn would certify organisations to carry out AI auditing. This is the approach being taken by the EU.<\/p>\n

But until the government signals how it intends to regulate AI, these are just proposals. AISI recently noted some of the challenges it now faces, including the risk of agents escaping during testing, and the difficulty of evaluating a moving target. It urged AI developers to share information that could help. \u201cWe will work with frontier developers and others to develop voluntary practices, leading where valuable, and supporting others\u2019 efforts where we can.\u201d<\/p>\n

Whether frontier AI companies in the US will be willing to do that is another matter. If AI does indeed pose an existential risk to humanity, Britain alone cannot stop it. But it is already building the capacity to sound the first alarm. And it does have the chance to limit some of the more obvious harms the technology can do, if it can work out how to go about it. Unlike rejoining the EU or reforming social care, however, that work cannot wait until after the next general election.\u00a0<\/p>\n

\n<\/div>\n","protected":false},"excerpt":{"rendered":"

Alex Sobel (Imageplotter\/Alamy) 7 min read1 hr The AI Security Institute keeps the UK in touch with the US and China as they develop evermore powerful agents but is treading a delicate path as calls for regulation grow louder, Ros Taylor reports No one doubts the expertise of the UK\u2019s AI Security Institute […]<\/p>\n","protected":false},"author":1,"featured_media":4711,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[3],"tags":[],"class_list":["post-4710","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-business"],"_links":{"self":[{"href":"https:\/\/smartinvestingschronicle.com\/index.php\/wp-json\/wp\/v2\/posts\/4710","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/smartinvestingschronicle.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/smartinvestingschronicle.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/smartinvestingschronicle.com\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/smartinvestingschronicle.com\/index.php\/wp-json\/wp\/v2\/comments?post=4710"}],"version-history":[{"count":0,"href":"https:\/\/smartinvestingschronicle.com\/index.php\/wp-json\/wp\/v2\/posts\/4710\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/smartinvestingschronicle.com\/index.php\/wp-json\/wp\/v2\/media\/4711"}],"wp:attachment":[{"href":"https:\/\/smartinvestingschronicle.com\/index.php\/wp-json\/wp\/v2\/media?parent=4710"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/smartinvestingschronicle.com\/index.php\/wp-json\/wp\/v2\/categories?post=4710"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/smartinvestingschronicle.com\/index.php\/wp-json\/wp\/v2\/tags?post=4710"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}