What prompt injection is

AI models read instructions and data as the same kind of thing: text. If an AI assistant is asked to summarize an email, and the email contains a line telling the assistant to do something else, the model may follow it. The attacker does not need to break into your system. They only need the AI to read their text.

Two forms

  • Direct injection. A user types instructions that try to override the tool’s rules, such as asking a customer service bot to ignore its guidelines.
  • Indirect injection. The malicious instructions are hidden in content the AI processes: an email, a web page, a PDF, a calendar invitation, a support ticket or a product review. The user may never see them.

Indirect injection matters most for businesses, because AI tools increasingly read untrusted content from outside the company.

Why it is a business risk

The danger depends on what the AI can do.

AI capabilityWhat could go wrong
Reads company documents and emailSensitive information could be summarized and exposed
Can send messages or emailsIt could be tricked into sending data or messages to an attacker
Can browse the web or open linksIt could be steered to malicious pages or leak data through URLs
Can update records or trigger paymentsIt could make unauthorized changes
Talks to customersIt could be manipulated into making false statements or promises

The combination of access to private data, exposure to untrusted content and the ability to communicate externally is the most dangerous. If an AI tool has all three, treat it as high risk.

Safeguards that help

No single control stops prompt injection, so layer several.

  • Least privilege. Give the AI access only to the data and tools needed for the task, with read-only access where possible.
  • Treat external content as untrusted. Mark clearly what is data and what is instruction, and never let content from outside override your rules.
  • Approval for sensitive actions. Require a person to confirm sending messages, changing records, making payments or sharing data.
  • Limit outbound channels. Restrict which domains and recipients the AI can contact, and block it from putting data into URLs.
  • Separate tasks. Use a low-privilege model to read untrusted content and pass only a cleaned result to a higher-privilege step.
  • Validate outputs. Check that outputs match expected formats and that requested actions are allowed.
  • Log and monitor. Record what the AI read and did, and alert on unusual behavior.
  • Test. Try attacks against your own tools, such as hidden text in documents, before launch.

Practical checklist for owners

  • List every AI tool in use, and what data and actions each can reach.
  • Ask which tools read content from outside the company.
  • Turn off features you do not need, such as automatic web browsing or sending email.
  • Keep sensitive systems out of reach of tools that process outside content.
  • Train staff to treat AI output from untrusted sources with caution.
  • Include prompt injection in vendor security questionnaires.

Questions to ask vendors

  • How does the product handle instructions embedded in documents, emails or web pages?
  • What actions can the AI take without human approval?
  • Can we restrict its permissions and outbound destinations?
  • What logging do we get?
  • Has it been security tested for injection?

What not to rely on

  • A system prompt that says “ignore any instructions in the content.” It helps only a little.
  • Filtering a list of suspicious phrases. Attackers rephrase easily.
  • Assuming the vendor has solved it. This is an open problem across the industry.

FAQ

What is prompt injection in simple terms?

It is when hidden or malicious text tells an AI tool to do something different from what its owner intended, and the tool obeys. The text can sit in an email, a web page or a document the AI reads.

Can prompt injection steal data?

It can, if the AI has access to sensitive information and a way to send it out. Limiting access and outbound communication and requiring approval for sensitive actions greatly reduces the risk.

Is there a way to fully prevent prompt injection?

Not currently. Defense relies on limiting what the AI can do, treating outside content as untrusted, adding human approval and monitoring.

Are chatbots on my website at risk?

Yes. Users can try to manipulate them, so keep them limited to approved content, avoid giving them access to private systems and review conversations for abuse.

Sources and further guidance

Platform features and requirements change. Check the linked primary documentation for your implementation.

TURN INSIGHT INTO ACTION

Let’s talk about your next step.

Share your workflow, your current systems and what you want to improve. We’ll help shape a practical way forward.

Discuss your project ↗