Skip to main content
LLM Security Database
Skip to research search
Updated 7/21/2026, database is current

Language Model Security Database

959 research findings · 1077 evaluated models

Filtered research findings

703 entries

Matches every word across titles, descriptions, sources, affected systems, and models.

Updated 3/8/2026

LLM routing systems are vulnerable to adversarial rerouting attacks where malicious triggers prepended to user queries manipulate the router's model-selection mechanism. Because LLM routers function as classifiers evaluating query complexity to balance computational cost and response quality, an attacker can craft adversarial prefixes that distort the query's latent semantic representation. This exploits the router's decision boundaries, forcing the system to misclassify the input and redirect…

RerouteGuard: Understanding and Mitigating Adversarial Risks for LLM Routing
Affects: GPT-4, GPT-4o, GPT-5 +2 more

Source: arXiv

Large Language Models (LLMs) and dedicated content moderation systems (including safety guards and encoder-based classifiers) are vulnerable to "Soft Hate" evasion attacks. This vulnerability arises when hostile standpoints are encoded through defeasible reasoning structures—specifically formalized by the Argumentum Model of Topics (AMT)—rather than explicit lexical toxicity. Attackers can bypass safety filters by framing discriminatory conclusions as logical inferences derived from widely…

SoftHateBench: Evaluating Moderation Models Against Reasoning-Driven, Policy-Compliant Hostility
Affects: HateBERT, HateRoBERTa, Llama Guard 3 1B +7 more

Source: arXiv

A vulnerability exists in the safety alignment of state-of-the-art Large Language Models (LLMs) when deployed as autonomous agents in dynamic, interactive environments. While current safety guardrails effectively block static, single-turn harmful queries, they fail to prevent multi-step emergent criminal behavior in agentic loops. When situated in an open-ended sandbox simulation (such as the VirtualCrime framework), these LLMs successfully bypass alignment to proactively plan, coordinate, and…

VirtualCrime: Evaluating Criminal Potential of Large Language Models via Sandbox Simulation
Affects: GPT-4.1 2025-04-14, GPT-5 Chat 2025-10-03, Claude Haiku 4.5 20251001 +5 more

Source: arXiv

Updated 2/21/2026

Code-generation Large Language Models (LLMs) and Multimodal Large Language Models (MLLMs) are vulnerable to directed misuse for the generation of misleading data visualizations. This vulnerability, described as the "ChartAttack" framework, allows an attacker to prompt the model to manipulate chart annotation code (e.g., JSON specifications for Matplotlib or Vega-Lite) to apply specific "misleaders"—design choices that distort data interpretation without altering the underlying data values. By…

ChartAttack: Testing the Vulnerability of LLMs to Malicious Prompting in Chart Generation
Affects: Qwen 2.5 14B, LLaVA 7B, Phi-3

Source: arXiv

Multimodal Large Language Models (MLLMs) exhibit a vulnerability to "Reasoning-based Multi-Image Attacks," where safety guardrails are bypassed by distributing harmful intent across multiple images (2–4 inputs). Unlike single-image jailbreaks that rely on visual obfuscation, this vulnerability exploits the model's reasoning capabilities. By presenting images that share a specific relationship (e.g., Temporal Jump, Spatial Juxtaposition, or Causality), an attacker can compel the model to infer…

The Side Effects of Being Smart: Safety Risks in MLLMs' Multi-Image Reasoning
Affects: GPT-4o, GPT-4o Mini, Gemini 1.5 Pro +11 more

Source: arXiv

Updated 3/8/2026

Text-to-Image (T2I) models and their associated safety filters are vulnerable to MacPrompt, a black-box jailbreak technique that exploits cross-lingual embedding alignments. Attackers can bypass input text filters, latent representation filters, and model-level concept removal defenses by replacing sensitive keywords with "macaronic" substitutes. These substitutes are constructed by extracting and recombining character-level substrings from translations of the target word across multiple…

MacPrompt: Maraconic-guided Jailbreak against Text-to-Image Models
Affects: DALL-E, Stable Diffusion

Source: arXiv

Large Language Models (LLMs) exhibit a safety alignment bypass vulnerability when processing requests for intelligent optimization algorithm design. Unlike direct requests for malicious code (e.g., ransomware), LLM safety guardrails fail to recognize the malicious intent behind mathematical optimization problems (e.g., Online Bin Packing, Traveling Salesman Problem, Flow Shop Scheduling) when applied to harmful contexts (e.g., optimizing botnet traffic routing, scheduling fake review posts for…

Overlooked Safety Vulnerability in LLMs: Malicious Intelligent Optimization Algorithm Request and its Jailbreak
Affects: GPT-4o, GPT-5, o3 +10 more

Source: arXiv

Large Language Models (LLMs) are vulnerable to multi-turn persuasive conversational attacks that induce the adoption of counterfactual beliefs. By leveraging the Source–Message–Channel–Receiver (SMCR) communication framework, attackers can systematically erode a model's confidence in established facts and compel the model to output misinformation. Specific attack vectors include manipulating source attribution (authority framing), message content (logical, credibility, or emotional appeals)…

Vulnerability of LLMs' Belief Systems? LLMs Belief Resistance Check Through Strategic Persuasive Conversation Interventions
Affects: GPT-4o, Llama 3.2 3B, Llama 3.3 70B +2 more

Source: arXiv

A multi-turn jailbreak vulnerability exists in aligned Large Language Models (LLMs) via a technique known as Lexical Anchor Tree Search (LATS). The vulnerability exploits the model's instruction-following capabilities regarding list generation and modification. An attacker initializes a "seed pool" of hypothetical benign and harmful prompt-completion pairs under the guise of creating a safety guardrail. By utilizing a Breadth-First Search (BFS) algorithm, the attacker incrementally injects…

Break Me If You Can: Self-Jailbreaking of Aligned LLMs via Lexical Insertion Prompting
Affects: GPT-4o, GPT-5.1, Claude 3.5 Sonnet +6 more

Source: arXiv

Updated 2/21/2026

Multi-modal Large Language Models (MLLMs) are vulnerable to a multi-turn jailbreaking attack that leverages typographic visual prompts combined with conversational context drifting. The vulnerability exists because MLLMs establish trust and context during initial benign interactions, shifting the model's latent representation toward helpfulness and compromising its ability to detect malicious intent in subsequent turns. The attack vector utilizes an image where a harmful request is…

Multi-turn Jailbreaking Attack in Multi-Modal Large Language Models
Affects: GPT-4o, Gemini 2.0 Flash, Qwen2-VL 7B Instruct +2 more

Source: arXiv

Research methodology

Entries summarize publicly available primary-source security research. Model names reflect only systems explicitly evaluated by the cited paper, and measurements are research-reported unless independent verification is stated.