EN
Sign inGet started
Glossary

Jailbreaking

What is Jailbreaking?

Jailbreaking refers to attempts to bypass an AI model's safety rules through cleverly worded inputs, so that it produces content or takes actions it is meant to refuse. For organisations this is a risk, because a chatbot could, for example, reveal confidential instructions or respond inappropriately. Protective measures include clear system instructions, input and output screening, limited permissions, logging and regular security testing (red teaming).

How KI.ordo helps

KI.ordo's ready-made templates for an AI firewall and a chatbot security audit help to spot suspicious inputs and check your own agents' instructions for weaknesses.

Learn more →: Jailbreaking

Matching templates

Topics

  • Security
  • Misuse prevention
  • LLM

Try KI.ordo

Agents, flows and templates in one workspace – free 24-hour demo.

Start demo
← All terms

Related terms

Indirect Prompt Injection

In an indirect prompt injection, manipulative instructions are not in the user's input but hidden in content an AI system processes along the way, such as web pages, emails or documents. When an agent reads such content, it may mistake hidden commands for genuine tasks and, for example, disclose data. Safeguards include treating external content strictly as data, limiting permissions, screening inputs and requiring human approval for critical actions.

  • Security
  • Prompt injection
  • +1
Template

AI Firewall

An AI firewall is a protective layer between users, data sources and an AI model. It screens inputs for manipulation attempts such as prompt injection or jailbreaks and checks outputs, for example for confidential data or unwanted content, before passing them on. It may use rules, classification models or a second language model. An AI firewall reduces risk but does not offer complete protection and replaces neither limited permissions nor testing.

  • Security
  • Prompt injection
  • +1
Template

AI red teaming

AI red teaming is the structured examination of an AI system from the perspective of potential attackers or misuse. Specialists test in a controlled way whether a chatbot reveals confidential instructions, can be led into unwanted behaviour, provides false facts or exposes data. The findings feed into better instructions, filters and permissions. A chatbot security audit is a lighter form: it assesses configuration and sample conversations against known risk areas such as the OWASP Top 10 for LLM Applications.

  • AI security
  • Security testing
  • +1
Template

System Prompt Extraction

System prompt extraction describes attempts to make a chatbot or AI agent reveal its hidden system instructions. If such an attempt succeeds, the result is called prompt leaking: extraction is the attack, the leak is the consequence. Effective protection starts with keeping passwords, keys and confidential rules out of instructions and assuming they may become public; input checks and regular testing add further safeguards.

  • Security
  • Prompt leaking
  • +1
Template