Module 2 of 4Lesson 5 of 5~12 min
Checking and iterating with discernment
A polished AI answer can still be wrong, and it is often the PM who pays for it in front of the team or a customer. This lesson gives you a way to judge an AI response and to fix your prompt in a targeted way, so each attempt improves on the last instead of going in circles.
Lesson objective
By the end of this lesson, you will be able to evaluate an AI output on three levels (content, process, behavior) against explicit criteria, and fix the prompt with a targeted change rather than a random rewording.
Topics covered
- evaluating AI output
- prompt iteration
- fact-checking AI
- critical thinking with AI
- AI discernment
In the glossary
Where it fits
Delegate, describe, verify
How do you get a reliable result from generative AI, and know when not to trust it?
Lessons in this module
- Choosing what to hand over to AI
- Understanding what an LLM does when you prompt it
- Describing the task in a structured prompt
- Four techniques that change the result
- Checking and iterating with discernment (this lesson)
What you will learn in this module
This lesson is part of the course Prompting for Product Managers: delegate, describe, verify
- Decide, for a task in your product cycle, whether to hand it to AI, in which mode (automation, augmentation, agent), and what you keep.
- Explain how an LLM behaves (prediction, dated knowledge, working memory, instruction following) to anticipate its mistakes and pick the right fix.
- Write a prompt that describes the deliverable, the process and the quality bar, with context, delimited data and examples when needed.
- Evaluate an AI output (content, process, behavior) against explicit criteria, then improve it through targeted iterations.
Related courses
- AI & ProductivityAdvancedRegular practice: you already use the tools or work on this topic.
Build reliable Claude Skills for your product work
2 hr 30 min
- AI & FundamentalsAll levelsNo prerequisites: accessible to everyone.
Choosing and using AI tools at work
1 hr 40 min
- AI & FundamentalsAll levelsNo prerequisites: accessible to everyone.
Understand what LLMs do well, and where they fail
2 hr