M1OECD AILit — Managing AI, Competency 1

When to Use AI (and When Not To)

AI Is a Tool, Not a Solution for Everything

AI excels at processing large amounts of data, recognizing patterns, and automating repetitive tasks. But it struggles with nuance, empathy, ethical judgment, and creative vision. Knowing when AI adds value — and when a human is better — is a critical management skill.

The tricky part is that the line keeps moving. Five years ago, AI couldn’t draft a decent email, couldn’t summarize a document, and wrote code that barely ran. Today it does all of those at some level — sometimes better than a beginner, sometimes worse than an expert, and sometimes wrong with full confidence in a way you wouldn’t notice unless you already knew the answer. So the useful question isn’t “can AI do this?” anymore. It’s “for this specific task, with these specific stakes, who should be the one to decide?

This mission is about building the judgment to answer that question well. You won’t end up with a rulebook — because there isn’t one — but you will end up with a short set of questions you can run through in 10 seconds before reaching for a tool. That’s the real skill: choosing fast, and choosing right more often than not.

The Long Argument Over What Machines Should Do

The question “what should machines do, and what should stay with humans?” is older than AI. It goes back to the Industrial Revolution, when steam engines replaced weavers and the weavers pushed back — sometimes peacefully, sometimes by smashing the looms. The debate has cycled through every technology since: typewriters replaced scribes, computers replaced clerks, email replaced the mailroom. Each time, the worry was whether something valuable was being lost along with the tedious work.

What mostly happened, over 200 years of this pattern, was boring: the machine handled the mechanical part, the human moved up to the judgment part. Weavers became pattern designers. Typists became executive assistants. Bank tellers became customer advisors. The roles evolved rather than disappeared, and the work that stayed human was usually the work that required reading a person, a situation, or a trade-off.

AI broke this pattern in one specific way: it’s the first tool that can do parts of the judgment work itself. Draft an email. Summarize a debate. Suggest a hiring shortlist. Flag a suspicious transaction. Explain a legal clause. Things that were clearly “human judgment” 10 years ago are now things a model can do passably well — sometimes better, sometimes worse, sometimes catastrophically wrong in ways the person delegating wouldn’t catch.

The old rule — machines for mechanical, humans for judgment — isn’t the right rule anymore. The new question is subtler: for this specific task, with these specific stakes and this specific risk of AI being wrong, who should decide? The answer isn’t the same every time. This mission is about building the judgment to answer it well — because the person at the keyboard is now the only filter between AI speed and AI failures.

Pick Your Move

Each option shows its trade-off after you choose.

You’re at your desk and feel a sudden, unusual tightness in your chest. It doesn’t go away after 10 minutes. What’s the best move?

Your best friend’s 30th birthday is in three weeks. You’re hosting and need to pick a theme, food, playlist, and activities. What’s the best approach?

You’re about to sign a freelance contract worth roughly $20,000 USD. It’s 12 pages, uses legal language you half-understand, and the client wants it signed by Friday. What’s the smart move?

Task Sorter

Click a task, then click the column where it belongs: AI, Human, or Both together.

Sort 10,000 emails by priority
Write a heartfelt condolence letter
Translate a technical manual
Judge an art competition
Summarize a 50-page report
Diagnose a rare disease
Mediate a workplace conflict
Detect credit card fraud
Create a brand identity
Analyze customer feedback trends
Schedule 200 meetings with constraints
Review legal contracts for risks

The Decision Framework: Four Questions Before You Reach for AI

Experienced AI users don’t ask “can I use AI for this?” — they ask four more specific questions. Once you internalize them, the answer arrives in seconds.

1. What are the stakes if it’s wrong? Low stakes = AI is usually fine. Sorting emails, drafting internal notes, brainstorming, translating a casual message — if AI misfires, you notice and fix it with no real cost. High stakes = slow down. Medical advice, legal commitments, financial decisions, anything involving safety or irreversible consequences — the cost of AI being wrong can be severe. Higher stakes justify more human oversight.

2. Is the decision reversible? Reversible = try AI first. Picking a restaurant, drafting a first version, trying a new recipe — you can undo or iterate, so the cost of a bad suggestion is low. Irreversible = human involvement goes up. Signing a contract, publishing a public statement, administering a medication, sending a message you can’t unsend. Even if the stakes feel moderate, irreversibility raises the bar for letting AI drive.

3. How well can I verify the output? If you can quickly check AI’s work — is the translation right, does the code run, does the summary match the article — AI is a speed-up. If you can’t verify without being an expert in the topic, AI becomes a risk. Asking AI to interpret a medical study in a field you don’t understand is dangerous, because you have no way to catch its errors. The rule: don’t use AI for tasks where you can’t smell a wrong answer.

4. Is the task inside or outside AI’s known strengths? AI is well-documented to be strong at: pattern recognition on structured data, summarizing long texts, generating variations, translating between common languages, drafting boilerplate, and routine code. AI is well-documented to be weak at: math (unless you ask it to reason step-by-step), nuanced judgment in specialized fields, anything requiring current real-world information it wasn’t trained on, and tasks where the model has strong incentives to please rather than challenge you. Staying inside the strength zone saves time; stretching outside it creates risk.

Put together, these questions give you a cheap triage system. Low stakes + reversible + easy to verify + inside AI’s strengths? Use AI without hesitation. High stakes + irreversible + hard to verify + outside known strengths? Either skip AI or use it only as a thinking aid with heavy human review. Most tasks sit in the middle — and for those, the honest answer is usually “AI first pass, human review.” Not a rule, but a starting bias that errs on the side of catching AI mistakes before they become yours.
Human-in-the-Loop
The most effective AI systems keep humans involved for oversight, quality control, and final decisions. AI handles the heavy lifting — generating options, scanning data, drafting first versions. Humans handle the judgment calls — reading the room, weighing trade-offs, taking responsibility for the outcome. The point isn’t to supervise AI out of distrust. It’s to use two very different kinds of intelligence in sequence: AI for speed and volume, humans for context and consequence. The workflows that hold up over time almost always have both.

From “Should I Use AI?” to “How Do I Use AI at Work?”

The decision framework is personal. But most AI use isn’t solo — it happens at work, in teams, with deadlines, deliverables, and colleagues whose expectations you have to meet. Once you’ve decided when AI fits a task, you immediately hit the next question: how do you actually integrate it into a real workflow?

That’s a different set of challenges. Individual AI use is forgiving — if your prompt is bad, you iterate. At work, outputs get reviewed, shipped, sent to clients, or used in decisions that affect other people. You can’t iterate your way out of a low-quality report to your manager or a customer email that missed a key detail. The stakes aren’t dramatic, but they’re real — and your reputation is in the mix.

On top of that, workplaces have their own dynamics. Some teams embrace AI eagerly; others are skeptical. Some bosses want to see AI savings; others want to see human craftsmanship. Some companies have explicit AI policies; most don’t. Navigating all of that — and figuring out when AI-assisted work is OK to ship as your own, when to disclose, and when to lean in — is the next layer of skill.

In the next mission, “AI in the Real Workplace,” we’ll work through how AI actually shows up in jobs: customer support, analysis, writing, coding, meetings. The framing shifts from should I? to how do I, and still do it well?

Check Your Understanding

1. Which task is AI best suited for?
2. What does 'Human-in-the-Loop' mean?
3. When is AI overkill?
4. Why should humans stay involved in AI-assisted medical diagnosis?

Answer all questions. You need 70% to pass.