Assemble the agent dossier of a real case

Lesson objective

By the end of this lesson, you will be able to assemble the agent dossier of a real case in your product (decision, workflow, tool cards, loop, control matrix, injection mitigations, trace and evaluation), self-assess it and plan how to apply it over 7 and 30 days.

Where it fits

Your agent dossier

How do I assemble the agent dossier of a real case in my product and apply it over the next 30 days?

Lessons in this module

1. Assemble the agent dossier of a real case (this lesson)

What you will learn in the course

This lesson is part of the course Design reliable agents and tool calling

• Decide, with explicit criteria, whether a use case calls for a single call, a workflow or an agent, and choose the right pattern.
• Write tool cards the model uses well (name, description, parameters, return, errors, idempotency, risk level).
• Specify an agent's loop (goal, context, stop conditions, budgets, error handling) and judge whether an orchestrator and subagents are warranted.
• Place human approval points and an agent's permissions according to the blast radius of each action.
• Identify prompt-injection paths through tool outputs and specify structural mitigations that do not rely on the prompt alone.
• Specify the trace of a run and the evaluation of an agent (task success, trajectory, cost, latency, consistency over several trials).

Related courses

• Build an AI assistant for your productAdvanced · ~3 hr
• Design a RAG architecture that fits your productAdvanced · ~3 hr 30 min
• Evaluate an AI feature: test sets, metrics and LLM judgesAdvanced · ~3 hr