E3OECD AILit — Engaging with AI, Competency 3

Can We Trust AI?

AI Isn't Perfect

AI can be impressively good — it writes essays, drafts emails, summarizes meetings, and produces images that look real. But it also makes mistakes, hallucinates facts with complete confidence, and can be used to create convincing fake content. The most dangerous part is that AI doesn’t sound unsure when it’s wrong: a made-up citation, a deepfaked voice, a fabricated quote — all come out smooth and polished. Learning when to trust AI, and when to slow down and verify, is now a survival skill. This mission is about that instinct.

Fake Content Isn’t New — But It’s Cheaper Now

The problem of fake content isn’t new. Photos have been doctored since the 1800s — Stalin famously had rivals airbrushed out of official images. What changed is the cost: faking a convincing photo used to take a skilled forger hours. Faking a convincing photo today takes a few clicks in any free app.

AI made this leap in two stages. First, image generators like Stable Diffusion and Midjourney learned to produce realistic scenes from a text prompt. Next, text generators like ChatGPT learned to imitate almost any writing style — news articles, legal briefs, love letters, code. Together they mean that anyone with a browser can now produce fake content that would have required a professional studio a decade ago.

The deeper issue is that AI isn’t lying on purpose — it doesn’t understand anything. Models generate by predicting what a plausible next word or pixel would be, based on their training data. When a language model cites a study that doesn’t exist, it isn’t being sneaky. It’s just producing the most statistically likely continuation of your prompt, and a real-looking citation is highly likely. We call this hallucination, and it happens even in the best models. Knowing this changes how you read AI output: not as reporting, but as confident-sounding prediction.

Compare

Toggle between the two versions.

The Chatuchak Weekend Market sprawls across 35 acres and over 15,000 stalls. I got lost twice before noon, bought a bonsai for 450 baht, and ate som tam from a stall that has no sign but always has a line. The best vendors don’t advertise — you find them by following the locals.

When to Trust AI

Trust more when: the task is well-defined, there’s lots of good training data, and you can verify the output yourself. A classifier sorting product reviews, a grammar checker, a translation between two common languages — these are areas AI has seen millions of examples and the stakes of a single error are low.

Trust less when: the output is hard to verify, the topic changes quickly, or the stakes are high. Medical advice, legal interpretation, financial decisions, real-time news — all are places AI can sound authoritative while being flatly wrong. If an AI tells you a specific drug dosage, look it up from a trusted source before acting.

Always verify when AI: cites a specific fact (date, name, number), references a study or paper, writes about current events, or advises on anything safety-critical. A good habit: ask AI to give you its sources, then open those sources. If the link doesn’t exist, or the source doesn’t say what the AI claimed, you’ve caught a hallucination.

The same logic applies to AI-generated content. When you see a photo online, ask: is this from a known publisher? Is there a verified source? If your friend shares a video that shocks you, pause before sharing — check another source first. A minute of verification prevents an hour of regret.

Deepfakes deserve their own note. Today’s synthetic video is good enough to fool a casual viewer in a quick scroll. Signs that sometimes give it away: mismatched lighting on the face, odd teeth or hair that look “painted on”, weird blinking, audio slightly out of sync with lips. But deepfakes are improving fast, and these tells fade with each model generation. The safest signal isn’t any visual cue — it’s where the clip came from. A dramatic video with no clear publisher is almost always worth a double-check.

Quick Check

Pick the best answer.

When checking if a video might be a deepfake, which signal is most reliable today?

Select your answer

Spot the AI-Generated Content

In each round, one description is AI-generated and one is real. Can you tell which is fake?

Round 1/5
Critical Thinking is Your Superpower
The best approach is to treat AI as a helpful tool, not an authority. It’s great at first drafts, brainstorming, and grunt work — it’s much worse at final facts. Cross-check names, dates, numbers, and sources before you act on them or share them with others. A rule that holds up in almost every case: if an AI claim matters, ask it — what’s your source? — then open that source yourself. The more confident the AI sounds, the more important it is to verify.

Why This Matters

Knowing when to trust AI isn’t just a solo skill — it’s becoming a civic one. Elections, health advice, financial scams, school arguments — all now happen in a world where AI-generated content is everywhere. The person next to you in class, the video in your feed, the article your aunt forwarded — any of them might be AI. That’s not reason to panic; it’s reason to slow down.

The instinct to verify is a small habit with big payoff. Once it’s automatic, you become harder to fool and more useful to the people around you — the friend who checks a suspicious forward, the student who catches a made-up citation, the family member who doesn’t forward the scam.

In the next mission, “AI and Your Privacy”, we’ll flip the question: instead of what AI can do to you, we’ll look at what AI knows about you — and what your apps are quietly collecting every day.

Check Your Understanding

1. What is an AI 'hallucination'?
2. When should you be most careful with AI outputs?
3. What is deepfake technology?
4. What is the best way to use AI responsibly?

Answer all questions. You need 70% to pass.