Module
Module 3 of 6Lesson 2 of 2~18 min

Improper output handling, excessive agency and unbounded consumption

Lesson 2 of the module "Data that leaks, actions that go wrong" in the course "Secure an AI product: prompt injection, guardrails and the AI Act".

Take this lesson: your first course is freeSee the full syllabus

Lesson objective

By the end of this lesson, you will be able to match each model output with its consumer and the control that makes it safe, reduce the functionality, rights and autonomy of an AI feature to what is needed, and specify the limits that bound its consumption.

Where it fits

Data that leaks, actions that go wrong

How does an attack get data out or trigger actions, and where do you cut it off?

Lessons in this module

  1. Data exfiltration and the lethal trifecta
  2. Improper output handling, excessive agency and unbounded consumption (this lesson)

What you will learn in the course

This lesson is part of the course Secure an AI product: prompt injection, guardrails and the AI Act

  • Map the attack surface of an AI product and its risks with the OWASP Top 10 for LLM Applications 2025, in a prioritized risk register.
  • Analyze a product's direct and indirect prompt injection paths, system prompt leakage and data exfiltration (lethal trifecta).
  • Specify layered guardrails (input, output, rights, human approval, isolation, limits) with testable criteria and their cost.
  • Plan red teaming, abuse monitoring and incident response for an AI feature.
  • Qualify a product under the AI Act (role, risk level, prohibited practices, transparency, timeline) and connect this analysis with the GDPR.

Related courses