UK Weighs Mandatory AI Safety Reporting as Microsoft’s Brad Smith Calls for Global Rules

The UK government is examining how serious AI incidents and near misses could be identified and reported, as part of a wider package of measures announced on Monday 12 October. The GOV.UK announcement says stronger protections against emerging AI threats will be considered through the Cyber Security and Resilience Bill regime. The Financial Times reported that ministers are drawing up plans for compulsory safety reporting and monitoring of frontier AI.

The same day, Microsoft president Brad Smith told the BBC that milk and washing machines face more safety rules than AI, and called for global rules that would include a legal duty to write incident reports. For professionals in AI governance, compliance, risk and audit, the two stories point in the same direction: reporting and evidence are becoming core parts of how AI is managed.

What the UK government announced

According to the government, the package has four parts. Frontier AI will be used to strengthen cyber defences, building on two pilots that have helped identify and fix more than 1,000 potential vulnerabilities in government systems. Ministers will explore strengthening parts of the Cyber Security and Resilience Bill and the wider regime so that essential services such as hospitals and utilities are better protected, including against “loss of control” risk, where autonomous AI systems evade human oversight. The National Cyber Security Centre and the AI Security Institute are working on how incidents involving AI agents should be handled. The AI Security Institute is also evaluating the latest generation of advanced models.

The government also said it will look at how near-miss incidents can be identified and reported, so that lessons are learned quickly. It said the detail of any measures will be worked through with parliamentarians, technical experts and the operators who would have to deliver them. No reporting duty has yet been written into law.

It said the detail of any measures will be worked through with parliamentarians, technical experts and the operators who would have to deliver them.

In a speech at Imperial College London’s Base One incubator, AI Minister Kanishka Narayan said: “We will legislate wherever necessary.” He told AI developers: “If you cannot adequately control the risks, do not release the system.” Narayan also told Reuters that Britain would consider regulating advanced models if the current system proved insufficient.

What Brad Smith called for

Speaking on the BBC’s Big Boss Interview podcast, Smith said: “Right now, your washing machine is subject to more safety rules than AI. Every carton of milk that you see in the grocery store is subject to safety rules and inspection.” He said firms need “emergency brakes” to pause or slow AI that gets out of control, a legal requirement to write incident reports and tell victims when the technology goes rogue, and independent government evaluators to vet new AI technology.

Smith said the UK was best placed to lead global rules because of its AI Security Institute. Reuters noted that the institute currently gets pre-deployment access to major models under voluntary agreements. The BBC reported that Smith’s position puts him at odds with President Donald Trump, who has said the sector should regulate itself.

The jobs this work creates

Career Ahead’s analysis: incident reporting, model evaluation and verification all need people who can produce and check evidence. The government said that responding to major incidents involving AI agents “will require the development of new expertise and capabilities”. It also described AI verification, which checks whether claims about how AI systems were developed, tested and assessed stand up to scrutiny, as an emerging field, and said more details on UK support will follow in the coming months.

The roles closest to this work are:

• AI governance and policy specialists, who turn new duties into internal policies, approval steps and records of decisions.
• Compliance and regulatory affairs staff, who track the Cyber Security and Resilience Bill and explain what any reporting duty would mean for product and engineering teams.
• AI risk and incident managers, who keep risk registers, define what counts as a serious incident or near miss, and run the response when one happens.
• AI auditors and evaluators, who test systems and check whether claims about safety testing hold up, the kind of independent scrutiny Smith described.
• Security engineers with AI skills, given the government’s focus on AI-enabled cyber threats and AI agents.

Skills to build now

Existing rules already create part of this work. The UK’s 2023 AI white paper asked existing regulators to apply principles covering safety, transparency, fairness, accountability and routes to challenge. The Information Commissioner’s Office’s AI guidance sets out how data protection law applies to AI systems that use personal data.

The jobs this work creates Career Ahead’s analysis: incident reporting, model evaluation and verification all need people who can produce and check evidence.

Useful skills include writing clear incident reports and timelines, documenting how a model was tested, running risk and impact assessments, and understanding how cyber incident reporting works in regulated sectors. Professionals who can explain technical failures to regulators and boards will be needed whichever reporting model the UK adopts.

For Indian professionals, Indian technology and consulting firms that build or run AI systems for UK clients may need staff who can meet UK reporting and documentation requirements once they are set.

What to watch

The Cyber Security and Resilience Bill is the vehicle to follow. The government has said that the detail of any AI incident and near-miss reporting will be developed with Parliament, technical experts and operators, and that more on AI verification will come in the coming months. Those details will show which skills employers need most.

Written by Career Ahead AI. AI can make mistakes, so verify key facts. Report errors to support@careeraheadonline.com.