AACF
Culture & Change ยท CUL-04

Safe to raise concerns

Anyone can raise a concern or report a problem with AI without fear of blame, and can see what was done about it.

Why it matters

The first signs that AI is producing wrong or harmful results are usually noticed by the people using it. If they fear blame or expect nothing to happen, they stay quiet and the problem grows.

Levels
0 AbsentConfirmed absent: the evidence shows nothing is in place. Not known is recorded as insufficient evidence, not 0.
1 InitialThere is no known route for raising AI concerns; problems are raised informally or not at all.
2 DevelopingA route exists, such as a general helpdesk or whistleblowing policy, but staff do not know it covers AI or doubt that it is safe to use.
3 DefinedAn owned, no-blame route for raising AI concerns is known to all staff, and everyone who raises a concern hears what was done.
4 ManagedUse of the route and staff confidence in it are measured, and response times and outcomes are monitored and reported.
5 OptimisingRaising concerns is seen as normal practice, and the route and the response to it are improved from staff feedback and trends in what is raised.
Level 3 criteria

Level 3 is met when every applicable criterion is met. Criteria marked with an overlay apply only to organisations with that characteristic (overlays).

  1. CUL-04.1 A no-blame route for raising AI concerns is in place and has an owner.
  2. CUL-04.2 The route has been communicated to all staff.
  3. CUL-04.3 People who raise a concern receive a response on what was done.
Assessment questions
  • If a member of staff thought an AI tool was giving wrong or unfair results, what would they do?
  • How do you know staff feel safe to raise AI concerns?
  • What happens after a concern is raised, and does the person hear back?
Evidence an assessor would expect
  • Guidance describing the route for raising AI concerns
  • A log of concerns raised, with responses and outcomes
  • Staff survey results on confidence in speaking up
How to reach Level 3
  1. Choose or set up a route for raising AI concerns, which can be an existing route explicitly extended to cover AI, and name its owner.
  2. Write down that concerns raised in good faith will not lead to blame, and get senior leaders to say so publicly.
  3. Tell all staff about the route, with examples of the kinds of AI concerns it is for.
  4. Log each concern and give the person who raised it a response on what was done, with links to the incident process (MON-04) where needed.

Common pitfalls

  • Assuming staff know that a general whistleblowing policy covers AI.
  • Taking concerns in but never telling the person what happened.
  • Making the route anonymous only, so there is no way to reply.

Starter artefacts

  • Guidance on raising AI concerns
  • Concerns log with responses
  • No-blame statement from leadership
Ownership and sequence
Accountable
ai governance lead
Contributors
people lead, risk lead
Depends on
GOV-01
Roadmap step
3
Lifecycle
deploy, operate
Cross-references
AI Cyber Security Code of Practice2.5 partial; 6.4 partial
ISO/IEC 42001A.3.3 direct
JSP 936 Part 1para 51 partial; para 67 direct; para 101 partial
MITRE AI Maturity ModelP3.1 direct
NIST AI RMF 1.0GOVERN 4.1 partial
UK Data and AI Ethics FrameworkSAT 1.9 partial; SAT 3.4 partial

direct: this control at Level 3 meets the item. partial: it covers part of it.