Skip to main content
LLM Security Database
Skip to research search
Updated 7/21/2026, database is current

Language Model Security Database

959 research findings · 1077 evaluated models

Filtered research findings

138 entries

Matches every word across titles, descriptions, sources, affected systems, and models.

Multi-Agent Systems based on Large Language Models (LLM-MAS) are vulnerable to systemic Consensus Corruption via cascading error amplification. Because mainstream collaborative architectures rely on recursive context reuse without atomic-level provenance tracking, a single atomic falsehood injected into the system is repeatedly cited and reused within the multi-agent interaction chain. This structural exposure causes the error to deterministically compound across the communication graph…

From Spark to Fire: Modeling and Mitigating Error Cascades in LLM-Based Multi-Agent Collaboration
Affects: GPT-4o

Source: arXiv

Leading Large Language Models (LLMs) exhibit significant cross-lingual safety drift, allowing users to bypass safety guardrails by translating harmful prompts into low-resource Indic languages. While models effectively block unsafe prompts concerning caste, religion, gender, and politics in high-resource languages like English and Hindi, their safety alignment severely degrades in low-resource scripts such as Odia, Telugu, Kannada, and Punjabi. Evaluated models demonstrate a cross-language…

IndicSafe: A Benchmark for Evaluating Multilingual LLM Safety in South Asia
Affects: GPT-4o Mini, Claude Sonnet 4, Grok 3 +6 more

Source: arXiv

Updated 3/8/2026

Safety-aligned Large Language Models (LLMs) exhibit a "Defensive Refusal Bias" vulnerability, resulting in a safety-induced denial-of-service for legitimate cybersecurity operations. The models systematically refuse authorized defensive queries when they contain security-sensitive terminology (e.g., "exploit," "payload," "shell") because current alignment mechanisms rely on semantic similarity to harmful training data rather than intent analysis. Paradoxically, explicit authorization signals…

Defensive Refusal Bias: How Safety Alignment Fails Cyber Defenders
Affects: Claude 3.5 Sonnet, GPT-4o, Llama 3.3 70B Instruct

Source: arXiv

A vulnerability in multi-step, tool-using Large Language Model (LLM) agents allows attackers to bypass safety guardrails by manipulating user context variables, such as personalization profiles or persistent memory. The safety policies of frontier LLMs are highly context-dependent; inserting innocuous user bios (e.g., demographic or health disclosures) fundamentally alters the agent's action policy. When combined with lightweight adversarial jailbreaks, specific personalization contexts…

Differential Harm Propensity in Personalized LLM Agents: The Curious Case of Mental Health Disclosure
Affects: DeepSeek V3.2, GPT-5 Mini, GPT-5.2 +5 more

Source: arXiv

Updated 4/10/2026

Automated LLM-as-a-Judge safety classifiers exhibit severe performance degradation (falling to near-random chance) when subjected to distribution shifts caused by adversarial prompt optimization (Attack Shift), varying target architectures (Model Shift), and semantic categorization (Data Shift). Adversarial algorithms, particularly sampling-based (Best-of-N) and judge-aware optimization methods (GCG-REINFORCE), explicitly and implicitly exploit these judge insufficiencies. Instead of eliciting…

A Coin Flip for Safety: LLM Judges Fail to Reliably Measure Adversarial Robustness
Affects: Llama 2 13B HarmBench, Llama Guard 3 8B, AegisGuard +1 more

Source: arXiv

Updated 3/9/2026

LLM-as-a-judge systems and automated LLM evaluators are vulnerable to meaning-preserving perturbations, specifically formatting alterations and verbosity manipulations. When grading or classifying text and agentic transcripts, LLM judges exhibit high sensitivity to layout-only changes (such as whitespace and indentation) and response length, frequently altering their scores even when the underlying semantic and factual content remains identical. This allows attackers to bypass automated safety…

Judge Reliability Harness: Stress Testing the Reliability of LLM Judges
Affects: Claude Opus 4.5, Claude Sonnet 4.5, Gemini 2.5 Pro +4 more

Source: arXiv

Updated 4/10/2026

Generative reward models deployed as LLM-as-a-Judge (LaaJ) evaluators contain a logic bypass vulnerability where superficial "master key" inputs trigger false positive rewards regardless of actual response quality. Instead of evaluating the candidate's output, large judge models are inadvertently triggered by specific token sequences to solve the prompt independently. This allows malicious actors or policy models undergoing reinforcement learning to consistently game the reward signal by…

Security in LLM-as-a-Judge: A Comprehensive SoK
Affects: GPT-4o, o1, Qwen 2.5 72B Instruct +1 more

Source: arXiv

A vulnerability in Large Language Models (LLMs) equipped with built-in "thinking" or step-by-step reasoning modes allows attackers to bypass safety alignments, trigger reasoning collapse, and cause resource exhaustion. The vulnerability is exploited via a Multi-Stream Perturbation Attack, which fragments the sequential integrity of a harmful prompt by word-by-word interleaving it with benign auxiliary tasks (e.g., "Explain the water cycle"). By wrapping the benign text streams in specific…

Multi-Stream Perturbation Attack: Breaking Safety Alignment of Thinking LLMs Through Concurrent Task Interference
Affects: Qwen 3 1.7B, Qwen 3 4B, Qwen 3 8B +2 more

Source: arXiv

LLM-based autonomous agents deployed in multi-turn, structured environments are vulnerable to adaptive, profit-driven semantic exploitation. Rather than utilizing traditional malformed prompt injections or jailbreaks, an attacker can leverage valid interaction channels to execute social engineering, protocol spoofing, and authority impersonation tactics. By strategically shaping the environment's context—such as feigning technical constraints, fabricating evaluation harnesses, or manipulating…

Profit is the Red Team: Stress-Testing Agents in Strategic Economic Interactions

Source: arXiv

A vulnerability in Retrieval-Augmented Generation (RAG) systems utilizing safety-aligned Large Language Models (LLMs) allows attackers to perform a highly transferable Denial-of-Service (DoS) or "blocking" attack. By injecting a single maliciously crafted document into the RAG knowledge base, attackers can force the LLM to refuse to answer benign queries. Unlike previous attacks that rely on explicit instruction injection or high-perplexity adversarial suffixes—which modern models easily…

When Safety Becomes a Vulnerability: Exploiting LLM Alignment Homogeneity for Transferable Blocking in RAG
Affects: GPT-5.2, GPT-5 Mini, DeepSeek V3.2 +4 more

Source: arXiv

Research methodology

Entries summarize publicly available primary-source security research. Model names reflect only systems explicitly evaluated by the cited paper, and measurements are research-reported unless independent verification is stated.