Skip to content
Notes on AIE035Act 3 — Steering & Trust

Red Flags

E035 · by — AI Strategist, Practitioner & Educator · Founder, AI Center of Excellence

Teach fast signals that outputs may be unreliable.

Full Explanation

AI errors don't announce themselves. The common assumption is that unreliable output feels off — hedged, awkward, structurally strange. That assumption is wrong. Current models produce uniformly fluent, confident prose whether they are right or wrong. Confident tone, correct formatting, and plausible-sounding detail appear in accurate answers and completely fabricated ones alike. These are not signals — they are just the output.

The one pattern that does signal elevated risk is unverifiable specificity. Specific numbers, named reports, exact dates, citations to specific sources — these are the elements where errors travel furthest, because they look identical to correct claims and the only way to catch them is to check the source. The practical filter is simple: before using AI output, scan for specific claims first. If you find them and cannot verify them quickly, that is your actual red flag. Not how it sounds. How specific it gets.

---

Transcript

Read every word ↓

The more precise the answer of AI model sounds, the more careful you should be. Most people start with one assumption. AI is smart. So, when an answer includes specific numbers, named reports, exact years, it feels like confirmation. It doesn't just sound fluent or clear, it sounds verified. As if the model looked it up, checked the sources, and now it's reporting back to you. This is how we interpret things with humans. If someone says 72% according to McKinsey report from 2024, we assume that they did the work.

They re-looked the facts and they read this report. But with AI, that assumption breaks. Because the model is not retrieving facts, it is generating text that fits the pattern of a correct answer. And if the pattern of the correct answer normally includes numbers, dates, citations, specific names, the model uses it and produces it in the output, whether they are correct or not. And this creates a reversal. The thing that looks like evidence is often the place where errors hide. A number can be wrong, a report can be misnamed, a citation can point to something that doesn't exist.

And because it looks so precise, it's harder for us to question it. Now imagine this. You take that answer and you use it in a meeting, in a presentation, in a discussion. You repeat the exact number, you reference the report, you sound confident. And then the number is wrong. At that moment, your entire point collapses, not just the number, everything around it. Because your argument depends on it being true. And that's the real risk. Not that AI makes mistakes, but that precise mistakes carry the highest cost.

So the risk is not evenly distributed. General statements are usually low-risk, but specific claims. That's why mistakes become expensive. So here's the shift. Don't read AI answers as a whole. Scan first for precision. If you find numbers, name sources, exact figures, specific claims, ask yourself, can I verify it quickly? If not, that's your signal. Not how it sounds and not how confident it is, but how specific it gets. Because with AI, precision is not a proof. It is often the highest risk part of the answer.

This was a note on AI. Thank you for watching and I'll see you in the next one. Bye.

Related AI Concepts

Resources

No dedicated resources for this episode yet.

Browse the resource library →

Newsletter

Found this useful?

Join the newsletter. You get one e-mail when something new and useful is out: a video, a guide, a tool. No spam, no schedule, and you can leave with one click.

Alexey Makarov

Alexey Makarov

AI Strategist, Practitioner & Educator. Founder & Global Lead of the AI Center of Excellence at SEFE. Creator of the Unreasonable AI YouTube channel. Based in Berlin.

About Alexey →