Skip to main content
LLM Security Database
Skip to research search
Last analyzed Sep 9, 2026

Language Model Security Database

985 research findings · 1119 evaluated models

Filtered research findings

337 entries

Matches every word across titles, descriptions, sources, affected systems, and models.

Indirect Environmental Jailbreak

Published Analyzed Source: arXiv

Embodied Artificial Intelligence (AI) agents utilizing Vision-Language Models (VLMs) for perception and planning are vulnerable to Indirect Environmental Jailbreak (IEJ). The vulnerability arises from the system's failure to distinguish between user-issued instructions and text embedded in the physical environment (e.g., writing on walls, sticky notes, or projections). The VLM processes visual text detected in the camera feed as authoritative context or direct commands, allowing a black-box…

The Shawshank Redemption of Embodied AI: Understanding and Benchmarking Indirect Environmental Jailbreaks
Evaluated models: GPT-4o, Qwen3-VL Plus, Gemini 2.0 Flash+3 more
  • GPT-4o
  • Qwen3-VL Plus
  • Gemini 2.0 Flash
  • GLM 4.5
  • DeepSeek-VL2
  • Claude 3.5 Sonnet

Conceptual Triggers Bypass Safety

Published Analyzed Source: arXiv

Large Language Models are vulnerable to a conceptual manipulation attack, termed Morphology Inspired Conceptual Manipulation (MICM), that bypasses standard safety filters to generate content aligned with harmful extremist ideologies. The attack does not use explicit keywords or standard jailbreak syntax. Instead, it embeds a curated set of seemingly innocuous phrases, called Concept-embedded Triggers (CETs), into a prompt template. These CETs represent an abstract "conceptual configuration" of…

When Harmless Words Harm: A New Threat to LLM Safety via Conceptual Triggers
Evaluated models: DeepSeek R1, DeepSeek V3, GPT-4o+3 more
  • DeepSeek R1
  • DeepSeek V3
  • GPT-4o
  • GPT-4o Mini
  • Mistral 7B v0.3
  • Qwen 3 8B

Embedded Templates Bypass Moderation

Published Analyzed Source: arXiv

A jailbreak vulnerability, termed Embedded Jailbreak Template (EJT), allows for the generation of harmful content by bypassing the safety mechanisms of Large Language Models (LLMs). The attack uses a generator LLM to contextually integrate a harmful query into a pre-existing jailbreak template. Unlike fixed templates which insert a query into a static placeholder, EJT rewrites multiple parts of the template to embed the harmful intent naturally. This process preserves the original template's…

Beyond Fixed and Dynamic Prompts: Embedded Jailbreak Templates for Advancing LLM Security
Evaluated models: BERT, DeBERTa v3 Base, GPT-4o

Evolutionary Language Model Jailbreak

Published Analyzed Source: arXiv

A vulnerability exists in aligned Large Language Models (LLMs) that can be exploited by the FORGEDAN evolutionary framework to bypass safety and alignment mechanisms. The attack, which operates in a black-box setting, uses a genetic algorithm to automatically evolve effective jailbreak prompts. The framework combines multi-strategy textual perturbations (at the character, word, and sentence levels) with a semantic fitness function based on RoBERTa embeddings. This allows it to iteratively…

FORGEDAN: An Evolutionary Framework for Jailbreaking Aligned Large Language Models
Evaluated models: DeepSeek V3, Gemma 2 9B, Qwen 2.5 7B+2 more
  • DeepSeek V3
  • Gemma 2 9B
  • Qwen 2.5 7B
  • RoBERTa
  • Transpec 13B

ITS Typography Jailbreak

Published Analyzed Source: arXiv

Large Vision Language Models (LVLMs) are vulnerable to a jailbreaking attack that combines image typography manipulation with multi-turn prompting. The vulnerability exploits the model's visual encoder and instruction-following capabilities by embedding a harmful textual query directly into a benign image as a visible caption (using specific fonts and blending techniques). An attacker then engages the model in a three-turn conversation: first asking a benign question about the visual object…

Jailbreaking Large Vision Language Models in Intelligent Transportation Systems
Evaluated models: GPT-4o, Qwen 2 7B, LLaVA 7B

EvoSynth: Evolutionary Attack Synthesis

Published Analyzed Source: arXiv

Large Language Models (LLMs) are vulnerable to a novel class of jailbreak attacks generated through the evolutionary synthesis of executable, code-based attack algorithms. Unlike traditional methods that refine or combine static prompts, this technique uses an automated multi-agent system (EvoSynth) to autonomously engineer and evolve the underlying code that generates the attack. These generated algorithms exhibit high structural and dynamic complexity, using features like control flow, state…

Evolve the Method, Not the Prompts: Evolutionary Synthesis of Jailbreak Attacks on LLMs
Evaluated models: Claude Sonnet 4.5, DeepSeek V3.2 Exp, GPT-4o+7 more
  • Claude Sonnet 4.5
  • DeepSeek V3.2 Exp
  • GPT-4o
  • GPT-5 Chat
  • Llama 3.1 70B Instruct
  • Llama 3.1 8B Instruct
  • Llama Guard 2 8B
  • Llama Guard 3 8B
  • Llama Guard 4 12B
  • Qwen Max

MAS Pipeline Weak Links

Published Analyzed Source: arXiv

Centralized Multi-Agent Systems (MAS) architectures, specifically those implemented using frameworks such as Magentic-One, LangGraph, and OpenAI Agents, contain design-level vulnerabilities facilitating safety alignment bypasses. Two primary mechanisms drive this vulnerability: 1. Context Fragmentation via Atomic Delegation: The orchestrator decomposes adversarial prompts into atomic, granular sub-tasks (e.g., "click button," "write function header") before delegating them to sub-agents. These…

Exposing Weak Links in Multi-Agent Systems under Adversarial Prompting
Evaluated models: GPT-4o

Speech-Audio Composition Attack

Published Analyzed Source: arXiv

Multimodal Large Language Models (MLLMs) capable of processing speech and audio are vulnerable to Speech-Audio Compositional Attacks. This vulnerability exists because current safety mechanisms often rely on text-only transcription or fail to analyze the full acoustic context of an input. By manipulating the composition of audio signals, an attacker can bypass safety filters and elicit harmful responses. The attacks exploit three specific mechanisms: (1) Speech Overlap, where harmful…

Speech-Audio Compositional Attacks on Multimodal LLMs and Their Defense with SALMONN-Guard
Evaluated models: Qwen2-Audio 7B, Qwen 2.5 Omni 7B, Step-Audio 2 Mini Base+6 more
  • Qwen2-Audio 7B
  • Qwen 2.5 Omni 7B
  • Step-Audio 2 Mini Base
  • MiniCPM-o 2.6 8B
  • Qwen3-Omni 30B-A3B Instruct
  • Kimi-Audio 7B Instruct
  • Gemini 1.5 Pro
  • GPT-4o
  • Gemini 2.5 Pro

LLM Factual MitM Injection

Published Analyzed Source: arXiv

Large Language Models (LLMs), specifically GPT-4o, GPT-4o-mini, LLaMA-2-13B, Mistral-7B, and Phi-3.5-mini, are vulnerable to Man-in-the-Middle (MitM) adversarial prompt injections that undermine factual recall. Termed the "$\chi$mera" (Chimera) attack framework, this vulnerability exists when an attacker intercepts and modifies user queries (e.g., via malicious browser extensions, compromised frontends, or proxy middleware) before they reach the victim model. By appending adversarial…

Injecting Falsehoods: Adversarial Man-in-the-Middle Attacks Undermining Factual Recall in LLMs
Evaluated models: GPT-4o, Llama 2 13B, Mistral 7B+1 more
  • GPT-4o
  • Llama 2 13B
  • Mistral 7B
  • Phi-3

Pervasive Multi-turn Jailbreaks

Published Analyzed Source: arXiv

Multiple open-weight Large Language Models (LLMs)—specifically those prioritizing capability over safety alignment—exhibit a critical vulnerability to adaptive multi-turn prompt injection and jailbreak attacks. While these models effectively reject isolated, single-turn adversarial inputs (averaging ~13.11% Attack Success Rate), they fail to maintain safety guardrails and policy enforcement across extended conversational contexts. By leveraging iterative strategies such as "Crescendo" (gradual…

Death by a Thousand Prompts: Open Model Vulnerability Analysis
Evaluated models: GPT-oss 20B, Llama 3.3 70B Instruct, Mistral Large 2+5 more
  • GPT-oss 20B
  • Llama 3.3 70B Instruct
  • Mistral Large 2
  • DeepSeek V3.1
  • Qwen 3 32B
  • Gemma 3 1B
  • Phi-4
  • GLM 4.5 Air

Research methodology

Entries summarize publicly available primary-source security research. Model names reflect only systems explicitly evaluated by the cited paper, and measurements are research-reported unless independent verification is stated.

Discovery and publication are separate: new papers enter a candidate queue, then require human review and explicit approval before publication. Updates follow that review process, not a guaranteed daily publishing schedule. “Last analyzed” is the newest analysis date among published entries; it does not mean that all recent research has been covered.