What the model knows, since when, and what tools add
An AI assistant does not know everything, nor necessarily anything recent, which changes how far you can trust a factual answer. This lesson helps you work out, for a given question, whether the model can answer alone, needs web search or a document you provide, and how to check the result.
Lesson objective
By the end of this lesson, you will be able to say, for a given question, whether the model can answer from memory, whether you need to turn on web search or whether you must provide a document, and to choose the matching check.
Topics covered
- knowledge cutoff
- AI web search
- what an LLM knows
- giving AI a document
Where it fits
What the model knows, and what it sees
What does the model know on its own, what do tools add, and what does it retain from our conversation?
Lessons in this module
- What the model knows, since when, and what tools add (this lesson)
- The context window, a powerful but uneven working memory
What you will learn in this module
This lesson is part of the course Understand what LLMs do well, and where they fail
- Locate what the model knows (training data, knowledge cutoff, uneven coverage) and what web search, provided documents and connectors change.
- Explain the context window as working memory (limit, degradation over long contexts, no memory across conversations without a dedicated feature) and derive working rules from it.
Related courses
- AI & ProductivityAdvancedRegular practice: you already use the tools or work on this topic.
Build reliable Claude Skills for your product work
2 hr 30 min
- AI & FundamentalsAll levelsNo prerequisites: accessible to everyone.
Choosing and using AI tools at work
1 hr 40 min
- AI & FundamentalsJuniorSome basics are useful: introductory knowledge of the topic.
Prompting for Product Managers: delegate, describe, verify
2 hr 45 min