Skip to main content
LLM Security Database
Skip to research search
Last analyzed Sep 9, 2026

Language Model Security Database

985 research findings · 1119 evaluated models

Filtered research findings

610 entries

Matches every word across titles, descriptions, sources, affected systems, and models.

Leaderboard Model Identification

Published Analyzed Source: arXiv

Voting-based Large Language Model (LLM) leaderboards, such as Chatbot Arena, are vulnerable to adversarial ranking manipulation due to insufficient response anonymity. While these systems obscure model identities during head-to-head comparisons to prevent bias, an attacker can de-anonymize the models with high accuracy (>95%) by analyzing response content. The attack functions in two stages: (1) Re-identification, where the attacker submits specific prompts (identity-probing or stylometric…

Exploring and mitigating adversarial manipulation of voting-based leaderboards
Evaluated models: Llama 3.1 70B

Confounder Gadgets Reroute LLMs

Published Analyzed Source: arXiv

A vulnerability exists in Large Language Model (LLM) routing systems (control planes) that allows for the manipulation of inference flow via adversarial input sequences. LLM routers, which dynamically direct user queries to either "weak" (cheaper) or "strong" (expensive) models based on predicted query complexity, can be bypassed by appending specific, pre-optimized token sequences known as "confounder gadgets." These gadgets artificially inflate the router's complexity score for an input…

Rerouting llm routers
Evaluated models: Not reported

Cybersecurity Obfuscation Jailbreak

Published Analyzed Source: arXiv

A multi-step prompt injection vulnerability allows attackers to bypass Large Language Model (LLM) safety guardrails by combining prompt obfuscation with task decomposition. The attack methodology, identified as part of the CySecBench research, employs a "Word Reversal" technique where every fifth word in the malicious input is reversed to evade initial keyword detection. This obfuscated input is then embedded within a benign educational context, specifically instructing the model to act as a…

CySecBench: Generative AI-based CyberSecurity-focused Prompt Dataset for Benchmarking Large Language Models
Evaluated models: Not reported

LLM Strategic Ranking Manipulation

Published Analyzed Source: arXiv

Large Language Model (LLM) based search engines utilizing Retrieval-Augmented Generation (RAG) are vulnerable to ranking manipulation attacks via indirect prompt injection. Adversaries can embed optimized adversarial triggers or crafted semantic patterns within external webpage content. When these manipulated documents are retrieved and integrated into the LLM's context window alongside a user query, the adversarial content disrupts the model's contextual understanding. This results in the LLM…

Dynamics of adversarial attacks on large language model-based search engines
Evaluated models: Not reported

Diffusion-Driven LLM Jailbreak

Published Analyzed Source: arXiv

DiffusionAttacker exploits a vulnerability in Large Language Models (LLMs) allowing manipulation of prompts to elicit harmful responses, even when the model incorporates safety mechanisms. The attack leverages a sequence-to-sequence diffusion model to rewrite harmful prompts, making them appear harmless to the LLM's internal representation while preserving their original semantic meaning. This bypasses safety filters and elicits undesired outputs.

DiffusionAttacker: Diffusion-Driven Prompt Manipulation for LLM Jailbreak
Evaluated models: Alpaca 7B, Claude 3.5 Sonnet, GPT-3.5 Turbo+4 more
  • Alpaca 7B
  • Claude 3.5 Sonnet
  • GPT-3.5 Turbo
  • GPT-4
  • Llama 3 8B Instruct
  • Mistral 7B
  • Vicuna 7B

Contextual Adversarial Prompts

Published Analyzed Source: arXiv

Large Language Models (LLMs) are vulnerable to human-readable adversarial prompts crafted using situational context derived from movie scripts. These prompts, which combine a malicious prompt, a seemingly innocuous adversarial insertion, and relevant contextual information, can bypass LLMs' safety mechanisms and elicit harmful responses. The technique leverages the LLM's ability to understand context and generate responses consistent with that context to mask the malicious intent. The…

Human-Readable Adversarial Prompts: An Investigation into LLM Vulnerabilities Using Situational Context
Evaluated models: Flan-t5 Large, Gemini 1.5 Pro, Gemma 2B IT+16 more
  • Flan-t5 Large
  • Gemini 1.5 Pro
  • Gemma 2B IT
  • Gemma 7B
  • Gemma 7B IT
  • GPT-3.5 Turbo
  • GPT-4
  • GPT-4 Turbo
  • Llama 2 13B Chat
  • Llama 2 7B
  • Llama 3.1 8B
  • Llama 2 7B Chat
  • Meta-llama-3-8B
  • Mistral 7B Instruct v0.2
  • Mistral-7B-v0.1
  • Mistral-8x7B-instruct-v0.1
  • Phi-1.5
  • Phi-3-mini-128k-instruct
  • Vicuna 13B v1.5

Preference-Optimized Jailbreak

Published Analyzed Source: arXiv

JailPO is a black-box attack framework that leverages preference optimization to generate effective jailbreak prompts for aligned LLMs. The attack automatically generates prompts, bypassing safety mechanisms and eliciting harmful or undesirable responses from the target LLM. The framework includes three attack patterns (QEPrompt, TemplatePrompt, MixAsking) with varying degrees of effectiveness and risk.

JailPO: A Novel Black-box Jailbreak Framework via Preference Optimization against Aligned LLMs
Evaluated models: GPT-3.5 Turbo

Linked-Task LLM Jailbreak

Published Analyzed Source: arXiv

A novel jailbreak paradigm, Simple Assistive Task Linkage (SATA), circumvents LLM safeguards by masking harmful keywords in a malicious query and using a secondary, simple assistive task (e.g., masked language modeling or element lookup by position) to convey the masked keywords' semantics to the LLM. This distracts the LLM and allows it to bypass safety checks, leading to the generation of harmful responses.

SATA: A Paradigm for LLM Jailbreak via Simple Assistive Task Linkage
Evaluated models: Claude-v2, GPT-3.5 Turbo, GPT-4o+3 more
  • Claude-v2
  • GPT-3.5 Turbo
  • GPT-4o
  • GPT-4o Mini
  • Llama 3 70B
  • Llama 3 8B

One-Step Model Jailbreak

Published Analyzed Source: arXiv

A vulnerability in LLMs allows attackers to bypass safety mechanisms by crafting prompts that disguise malicious intent as a "defense" against harmful content. The attack, Reverse Embedded Defense Attack (REDA), leverages the model's own defensive capabilities to generate harmful outputs while masking the malicious intent within the response structure. This allows for successful jailbreaks in a single iteration, without requiring model-specific prompt engineering.

Jailbreaking? One Step Is Enough!
Evaluated models: GLM 4 9B Chat, GPT-3.5, Llama 2 13B+3 more
  • GLM 4 9B Chat
  • GPT-3.5
  • Llama 2 13B
  • Llama 3.1 8B Instruct
  • Qwen 2 7B Instruct
  • Vicuna 13B v1.5

Semantic Confusion Jailbreak

Published Analyzed Source: arXiv

The Antelope attack exploits vulnerabilities in Text-to-Image (T2I) models' safety filters by crafting adversarial prompts. These prompts, while appearing benign, induce the generation of NSFW images by leveraging semantic similarity between harmless and harmful concepts. The attack involves replacing explicit terms in an original prompt with seemingly innocuous alternatives and appending carefully selected suffix tokens. This manipulation bypasses both text-based and image-based filters…

Antelope: Potent and Concealed Jailbreak Attack Strategy
Evaluated models: GPT-4o, Midjourney, Stable Diffusion+2 more
  • GPT-4o
  • Midjourney
  • Stable Diffusion
  • Stable Diffusion v1.4
  • Stable Diffusion v2.1

Research methodology

Entries summarize publicly available primary-source security research. Model names reflect only systems explicitly evaluated by the cited paper, and measurements are research-reported unless independent verification is stated.

Discovery and publication are separate: new papers enter a candidate queue, then require human review and explicit approval before publication. Updates follow that review process, not a guaranteed daily publishing schedule. “Last analyzed” is the newest analysis date among published entries; it does not mean that all recent research has been covered.