MGMT ACGet notified

Module 10: AI for Leaders & Professionals

10.9

AI Output Verification Checklist

Check AI output in proportion to what is at stake before it leaves your desk under your name.

Set the stakes of the output in front of you, run the checks for that level and no fewer, and tell the person who receives it what you checked. Quick for a draft, thorough for claims, numbers and decisions.

The failure patterns are named in a standard, the NIST Generative AI Profile (NIST, 2024). Mixed research: one field experiment found people using AI on a task beyond its reach got the right answer less often (Dell'Acqua et al., 2026). The four-level ladder is practice, not research.

When to use it

Use it when:

Skip it when:

The idea

Generative tools write fluent text whether or not it is true. The NIST profile for generative AI names this risk confabulation: confident statements, sources or figures that are wrong or invented (NIST, 2024). The same profile also flags the human side, people trusting automated output more than it deserves. Research shows why that trust is costly. In a field experiment with consultants, people who used AI on a task chosen to lie just beyond its reach were less likely to reach a correct answer than people working without it, while on tasks within its reach they did better (Dell'Acqua et al., 2026). You cannot tell from the text which kind of task you had.

The ladder on this page is practice, not research. It spends effort where an error would cost most: a quick read for drafts, tracing every claim and figure when they matter, and an independent reviewer for decisions and anything external. Its limit is that it catches errors you look for. Section 3 trains your eye for the ones that slip past.

First step: Set the Stakes Level

Pick the highest level that applies. If it is between two levels, choose the higher one.

Strong answer: "Recommendation memo on the new rota, with two studies and a legal reference, going to the management group for a decision. Level 4: it feeds a decision that affects staff."

Level The output is Examples
1. Internal draft Raw material you will rework yourself Brainstorm lists, first drafts, cleaned-up notes
2. Shared work Read and acted on by others inside the organization Status mails, internal memos, summaries for colleagues
3. Claims and numbers Contains facts, figures, citations, legal or technical specifics Market overviews, reports, anything with statistics or references
4. Decisions and external Feeds a decision, reaches customers, authorities or the public, or concerns people Board material, published text, customer answers, anything in hiring or assessment

The output, and who receives it:

Level (1 to 4), and why:

Example

Illustrative example: the role, the organization and all numbers are made up.

An HR specialist in a Norwegian municipality uses an approved AI tool to draft a recommendation on a new rota for home care staff, citing two studies and a section of the working hours rules.

Section 1: it goes to the management group for a decision that affects staff: level 4.

Section 2: the quick read passes. At level 3, one study is real but covers hospital nurses, so the claim is narrowed to "in hospital settings". Recomputing the overtime saving finds an arithmetic slip, and the figure drops. One claim about absence cannot be traced and is marked unverified.

Section 3: stale fact found: the legal reference points to a section that has since been amended. Smoothed uncertainty found and corrected.

Section 4: about 25 minutes of checking turns a confident, wrong memo into a correct and more modest one. The HR legal adviser reviews it before the meeting, and the cover note says what was checked.

Fill it in and keep your answers

This page shows the first step. The whole template is in the MGMT AC app for iPhone, which opens soon. Your answers stay on your own device.

Tell me when it opens