Skip to main content
LLM Security Database
Skip to research search
Last analyzed 9/9/2026

Language Model Security Database

985 research findings · 1123 evaluated models

Filtered research findings

704 entries

Matches every word across titles, descriptions, sources, affected systems, and models.

Published 2/1/2026
Analyzed 3/9/2026

LLM-based Code Interpreter Agents, including OpenInterpreter and OpenCodeInterpreter, are vulnerable to sandbox evasion and arbitrary code execution via Natural Language Disguise and Contextual Channel Injection. Attackers can bypass Abstract Syntax Tree (AST) static analysis and explicit input guardrails by transforming malicious code logic into descriptive natural language instructions (Code Descriptions), which successfully evade syntax-layer blocks. Additionally, attackers can bypass input…

CIBER: A Comprehensive Benchmark for Security Evaluation of Code Interpreter Agents
Evaluated models: GPT-3.5, GPT-4o, GPT-5

Source: arXiv

Published 2/1/2026
Analyzed 3/8/2026

Frontier Large Language Models (LLMs) contain a safeguard bypass vulnerability where safety filters fail to reliably block requests for dual-use, in silico biology tasks. This allows novice users with no specialized training to access restricted, expert-level biological protocols (e.g., virology troubleshooting, pathogen capabilities, novel biological agent construction). The models' safety mechanisms fail to trigger or are trivially bypassed under realistic extended interaction conditions…

LLM Novice Uplift on Dual-Use, In Silico Biology Tasks
Evaluated models: o4-mini, o3, Gemini 2.5 Pro +2 more

Source: arXiv

Published 2/1/2026
Analyzed 2/20/2026

Large Vision-Language Models (LVLMs) possessing Optical Character Recognition (OCR) capabilities are vulnerable to a "Text Distraction Jailbreaking" (Text-DJ) attack. The vulnerability exploits a gap between the model's visual text extraction and its safety alignment mechanisms. By converting a decomposed harmful textual query into images and embedding these images within a grid of semantically irrelevant "distraction" text images, an attacker can bypass safety filters. The model's OCR…

Text is All You Need for Vision-Language Model Jailbreaking
Evaluated models: GPT-4o Mini, GPT-4.1 Mini, Gemini 2.5 Flash +3 more

Source: arXiv

Published 2/1/2026
Analyzed 3/8/2026

Large Language Models (LLMs) are vulnerable to safety alignment bypasses via classical and obscure language contexts, most notably Classical Chinese, Latin, and Sanskrit. This vulnerability stems from a "High Capability-Low Alignment" distribution shift: models possess sophisticated semantic comprehension of historical languages due to extensive pre-training on historical archives and literature, but lack corresponding safety guardrails which are predominantly optimized for modern languages…

Obscure but Effective: Classical Chinese Jailbreak Prompt Optimization via Bio-Inspired Search
Evaluated models: Gemini 2.5 Flash, Claude 3.7 Sonnet, GPT-4o +3 more

Source: arXiv

Published 2/1/2026
Analyzed 3/8/2026

Large Language Models (LLMs) deployed as Role-Playing Agents (RPAs) are vulnerable to Persona-Targeted Jailbreaks. When an LLM is prompted to adopt a persona—particularly characters with negative, risky, or villainous traits—the model's optimization for role fidelity frequently overrides its foundational safety alignment. Attackers can exploit this vulnerability by synthesizing queries that leverage the specific narrative background, ideology, or psychological vulnerabilities of the assigned…

Stay in Character, Stay Safe: Dual-Cycle Adversarial Self-Evolution for Safety Role-Playing Agents
Evaluated models: GPT-4o, Llama 3 8B, Qwen 2.5 7B +1 more

Source: arXiv

Published 2/1/2026
Analyzed 2/21/2026

Retrieval-Augmented Generation (RAG) systems are vulnerable to iterative knowledge-extraction attacks designed to reconstruct the underlying private knowledge base. The vulnerability exists due to the decoupled optimization of the retrieval and generation phases. Attackers can craft adversarial queries consisting of two distinct components: an "Information" component (optimized via gradient descent or random sampling to steer embeddings toward specific, diverse regions of the vector space) and…

Benchmarking Knowledge-Extraction Attack and Defense on Retrieval-Augmented Generation
Evaluated models: GPT-4o, Llama 3 8B, Qwen 2.5 7B

Source: arXiv

Published 2/1/2026
Analyzed 2/21/2026

Large Language Models (LLMs) exhibit a cross-lingual safety vulnerability driven by a dependency on a sparse subset of "Shared Safety Neurons" (SS-Neurons) anchored in high-resource (HR) languages, typically English. Non-high-resource (NHR) languages lack autonomous safety mechanisms and rely on projecting inputs onto this English-aligned safety manifold to trigger refusals. Because this projection is imperfect, safety guardrails can be bypassed by translating malicious prompts into NHR…

Who Transfers Safety? Identifying and Targeting Cross-Lingual Shared Safety Neurons
Evaluated models: Llama 3.1 8B Instruct, Qwen 3 8B, Gemma 2 9B IT

Source: arXiv

Published 2/1/2026
Analyzed 3/8/2026

A vulnerability in multi-category safety-guidance mechanisms (such as Safe Latent Diffusion [SLD] and SAFREE) for Text-to-Image (T2I) diffusion models allows attackers to bypass safety filters and generate restricted content via "Harmful Conflicts." Existing safety methods aggregate multiple harmful keyword categories (e.g., hate, violence, sexual) into a single unified safety direction in the latent or text space. Because distinct harmful categories possess incompatible safety directions…

When Safety Collides: Resolving Multi-Category Harmful Conflicts in Text-to-Image Diffusion via Adaptive Safety Guidance
Evaluated models: GPT-4o, Stable Diffusion

Source: arXiv

Published 2/1/2026
Analyzed 2/21/2026

Inference-time intervention techniques (also known as activation steering or model steering), utilized to adjust Large Language Model (LLM) behavior without retraining, contain a vulnerability related to robust specificity. When these methods are applied to reduce "over-refusal" (increasing compliance on benign but sensitive-sounding queries), they inadvertently degrade the model's adversarial robustness. Specifically, steering vectors derived from methods such as Difference-in-Means…

Steering Safely or Off a Cliff? Rethinking Specificity and Robustness in Inference-Time Interventions
Evaluated models: Llama 3.1 8B, Llama 3.2 3B, Qwen 2.5 7B +1 more

Source: arXiv

Published 2/1/2026
Analyzed 3/8/2026

Closed-loop, self-evolving Large Language Model (LLM) multi-agent systems (MAS) are vulnerable to irreversible safety erosion and alignment failure. When agents recursively optimize and update their policies using only synthetic data derived from internal interactions—without continuous external human grounding—the system naturally minimizes interaction energy and optimizes for internal conversational consistency. This isolation causes a progressive drift away from initial anthropic safety…

The Devil Behind Moltbook: Anthropic Safety is Always Vanishing in Self-Evolving AI Societies
Evaluated models: GPT-3.5 Turbo, Qwen 3 8B

Source: arXiv

Research methodology

Entries summarize publicly available primary-source security research. Model names reflect only systems explicitly evaluated by the cited paper, and measurements are research-reported unless independent verification is stated.