Skip to main content
LLM Security Database
Skip to research search
Last analyzed Sep 9, 2026

Language Model Security Database

985 research findings · 1119 evaluated models

Filtered research findings

610 entries

Matches every word across titles, descriptions, sources, affected systems, and models.

Intent Rephrasing Jailbreak

Published Analyzed Source: arXiv

Large Language Model (LLM) content moderation guardrails, including advanced mechanisms utilizing Chain-of-Thought (CoT) and Intent Analysis (IA), are vulnerable to adversarial bypass via "Intent Manipulation." The vulnerability stems from a structural bias in safety alignment where guardrails are disproportionately sensitive to imperative-style inquiries (e.g., commands like "Write a guide...") but fail to detect semantically equivalent harmful content presented in a declarative or…

Exploring the Vulnerability of the Content Moderation Guardrail in Large Language Models via Intent Manipulation
Evaluated models: GPT-4o, o1, o3-mini+10 more
  • GPT-4o
  • o1
  • o3-mini
  • Gemini 1.5 Flash
  • Gemini 2.0 Pro
  • Claude 3.7 Sonnet
  • DeepSeek V3
  • DeepSeek R1
  • Qwen 3 14B
  • Qwen 3 32B
  • Qwen 3 235B-A22B
  • Llama 4 Scout
  • Mixtral 8x7B

CoT Jailbreak Mitigation Failure

Published Analyzed Source: arXiv

Chain-of-thought (CoT) reasoning, while intended to improve safety, can paradoxically increase the harmfulness of successful jailbreak attacks by enabling the generation of highly detailed and actionable instructions. Existing jailbreaking methods, when applied to LLMs employing CoT, can elicit more precise and dangerous outputs than those from LLMs without CoT.

Does Chain-of-Thought Reasoning Really Reduce Harmfulness from Jailbreaking?
Evaluated models: Claude 3.5 Sonnet, DeepSeek Chat, DeepSeek R1+9 more
  • Claude 3.5 Sonnet
  • DeepSeek Chat
  • DeepSeek R1
  • GLM
  • GPT-4o
  • Llama 3.1 8B Instruct
  • o1
  • o3-mini
  • Qwen 32B
  • Qwen 72B
  • Qwen 7B
  • QwQ 32B

Nonsensical CoT Reasoning

Published Analyzed Source: arXiv

Large Language Models (LLMs) utilizing Chain-of-Thought (CoT) prompting are vulnerable to input perturbations that decouple intermediate reasoning from the final answer. An attacker can generate adversarial examples using gradient-based optimization (targeting specific loss functions that maximize reasoning divergence while minimizing answer loss) to induce "Right Answer, Wrong Reasoning" behaviors. This vulnerability manifests through two primary attack vectors: 1. Token-level perturbations…

Robust Answers, Fragile Logic: Probing the Decoupling Hypothesis in LLM Reasoning
Evaluated models: Llama 3 8B, Mistral 7B, Zephyr 7B Beta+4 more
  • Llama 3 8B
  • Mistral 7B
  • Zephyr 7B Beta
  • Qwen 2.5 7B
  • DeepSeek R1 Distill Qwen 7B
  • GPT-4o
  • GPT-3.5 Turbo

Universal Jailbreak Prompt Generator

Published Analyzed Source: arXiv

Large Language Models (LLMs) are vulnerable to robust jailbreak prompts generated by the ArrAttack framework. ArrAttack uses a two-stage process: a robustness judgment model trained to identify prompts that bypass existing LLM safety mechanisms, and a robust jailbreak prompt generation model that leverages this information to create highly effective attacks. This allows attackers to bypass multiple defense mechanisms, including perplexity-based detection, input preprocessing, and…

One Model Transfer to All: On Robust Jailbreak Prompts Generation against LLMs
Evaluated models: GPT-3.5 Turbo, GPT-4, Guanaco 7B+3 more
  • GPT-3.5 Turbo
  • GPT-4
  • Guanaco 7B
  • Llama 2 7B Chat
  • Vicuna 13B
  • Vicuna 7B

Adaptive Stacked Cipher Jailbreak

Published Analyzed Source: arXiv

Large Reasoning Models (LRMs) utilizing Chain-of-Thought (CoT) processes are vulnerable to an adaptive stacked cipher attack known as SEAL (Stacked Encryption for Adaptive Language reasoning model jailbreak). The vulnerability arises because the model's reasoning capabilities effectively function as a decryption engine, processing complex multi-layered obfuscations (e.g., stacked combinations of Caesar, Base64, ASCII, HEX, and reversal ciphers) that bypass input-level safety filters. By…

Three Minds, One Legend: Jailbreak Large Reasoning Model with Adaptive Stacked Ciphers
Evaluated models: DeepSeek R1, o1-mini, o4-mini+3 more
  • DeepSeek R1
  • o1-mini
  • o4-mini
  • Claude 3.5 Sonnet
  • Claude 3.7 Sonnet
  • Gemini 2.0 Flash Thinking

Conditional Prompt Hijack

Published Analyzed Source: arXiv

The SPECTRE framework introduces a black-box adversarial attack vector against Large Language Models (LLMs) that utilizes malicious system prompts to hijack conversations. Unlike traditional jailbreaks that aim to bypass safeguards for all inputs, SPECTRE optimizes system prompts to induce incorrect or harmful responses only for specific targeted questions (e.g., "Are COVID vaccines safe?", "Who should I vote for?"), while maintaining high accuracy and benign behavior on all other non-targeted…

SPECTRE: Conditional System Prompt Poisoning to Hijack LLMs
Evaluated models: GPT-3.5 Turbo, GPT-4o Mini, Llama 2 7B+8 more
  • GPT-3.5 Turbo
  • GPT-4o Mini
  • Llama 2 7B
  • Llama 2 13B
  • Llama 3.1 8B
  • DeepSeek 7B
  • Qwen 2.5 3B
  • Qwen 2.5 7B
  • Qwen 2.5 14B
  • Qwen 2.5 32B
  • Pythia 12B

Steganographic LLM Jailbreak

Published Analyzed Source: arXiv

A steganographic jailbreak attack, termed StegoAttack, allows bypassing safety mechanisms in Large Language Models (LLMs) by embedding malicious queries within benign-appearing text. The attack hides the malicious query in the first word of each sentence of a seemingly innocuous paragraph, leveraging the LLM's autoregressive generation to process and respond to the hidden query, even when employing encryption in the response.

Hiding in Plain Sight: A Steganographic Approach to Stealthy LLM Jailbreaks
Evaluated models: GPT-5, DeepSeek V3.2 Thinking, Qwen 3 Max Thinking

SAE Interpretability Illusion

Published Analyzed Source: arXiv

Sparse Autoencoders (SAEs), utilized for interpreting the internal residual stream activations of Large Language Models (LLMs) into human-understandable concepts, are vulnerable to adversarial input perturbations. By employing gradient-based optimization techniques adapted for SAEs (specifically a generalized Greedy Coordinate Gradient), an attacker can craft inputs via suffix appending or token replacement that manipulate the SAE's latent feature activations. This vulnerability allows for the…

Interpretability Illusions with Sparse Autoencoders: Evaluating Robustness of Concept Representations
Evaluated models: Llama 3 8B, Gemma 2 9B

Semantic Audio Jailbreak

Published Analyzed Source: arXiv

Large Audio-Language Models (LAMs) are vulnerable to adversarial signal-level perturbations that allow for the bypass of safety guardrails (jailbreaking). While these models may possess robust text-based safety alignment, they fail to generalize this robustness to the audio modality. Attackers can utilize the Audio Perturbation Toolkit (APT) to apply transformations in the time domain (Energy Distribution Perturbation, Trimming, Fade In/Out), frequency domain (Pitch Shifting, Temporal…

Audio Jailbreak: An Open Comprehensive Benchmark for Jailbreaking Large Audio-Language Models
Evaluated models: SpeechGPT, SALMONN, DiVA+4 more
  • SpeechGPT
  • SALMONN
  • DiVA
  • Qwen 2 Audio
  • Llama Omni
  • Gemini 2.0 Flash
  • GPT-4o Audio

Asynchronous Audio Jailbreak

Published Analyzed Source: arXiv

End-to-end Large Audio-Language Models (LALMs) are vulnerable to AudioJailbreak, a novel attack that appends adversarial audio perturbations ("jailbreak audios") to user prompts. These perturbations, even when applied asynchronously and without alignment to the user's speech, can manipulate the LALM's response to generate adversary-desired outputs that bypass safety mechanisms. The attack achieves universality by employing a single perturbation effective across different prompts and robustness…

AudioJailbreak: Jailbreak Attacks against End-to-End Large Audio-Language Models
Evaluated models: BLSP, FunAudioLLM, GPT-4o+9 more
  • BLSP
  • FunAudioLLM
  • GPT-4o
  • Ichigo
  • Llama Omni
  • LLaSM
  • Mini-Omni
  • Mini-Omni 2
  • Qwen 2 Audio
  • Qwen Audio
  • SALMONN
  • SpeechGPT

Research methodology

Entries summarize publicly available primary-source security research. Model names reflect only systems explicitly evaluated by the cited paper, and measurements are research-reported unless independent verification is stated.

Discovery and publication are separate: new papers enter a candidate queue, then require human review and explicit approval before publication. Updates follow that review process, not a guaranteed daily publishing schedule. “Last analyzed” is the newest analysis date among published entries; it does not mean that all recent research has been covered.