Skip to main content
LLM Security Database
Skip to research search
Last analyzed Sep 9, 2026

Language Model Security Database

985 research findings · 1119 evaluated models

Filtered research findings

704 entries

Matches every word across titles, descriptions, sources, affected systems, and models.

Enhanced Jailbreak Transferability

Published Analyzed Source: arXiv

A novel jailbreak attack, dubbed SI-GCG, against Large Language Models (LLMs) leverages a fixed harmful template and optimized suffix selection to bypass safety mechanisms and elicit harmful responses with high transferability. The attack utilizes a scenario induction template and a refined optimization process to improve the consistency and effectiveness of the jailbreak across different LLMs. The vulnerability stems from the inability of current safety measures to adequately defend against…

Boosting jailbreak transferability for large language models
Evaluated models: Not reported

SMILES-Prompting LLM Jailbreak

Published Analyzed Source: arXiv

Large Language Models (LLMs) used in chemical synthesis applications are vulnerable to a novel attack vector, dubbed "SMILES-prompting," which leverages the Simplified Molecular-Input Line-Entry System (SMILES) notation to bypass safety mechanisms and elicit instructions for synthesizing hazardous substances. The attack exploits the LLM's inability to effectively filter or interpret SMILES strings representing dangerous chemicals, leading to the disclosure of synthesis procedures.

SMILES-Prompting: A Novel Approach to LLM Jailbreak Attacks in Chemical Synthesis
Evaluated models: GPT-4o, Llama 3 70B Instruct

Faster GCG LLM Jailbreak

Published Analyzed Source: arXiv

Faster-GCG is an optimized jailbreak attack that exploits vulnerabilities in aligned Large Language Models (LLMs) by efficiently finding adversarial prompt suffixes. The attack leverages gradient information to iteratively refine a harmful prompt, overcoming limitations of prior methods like GCG by incorporating a regularization term to improve gradient approximation, using deterministic greedy sampling, and preventing self-looping during optimization. This allows for significantly higher…

Faster-GCG: Efficient discrete optimization jailbreak attacks against aligned large language models
Evaluated models: GPT-3.5 Turbo, GPT-4 Turbo, Llama 2 7B Chat+1 more
  • GPT-3.5 Turbo
  • GPT-4 Turbo
  • Llama 2 7B Chat
  • Vicuna 13B v1.5

Attention-Based LLM Jailbreak

Published Analyzed Source: arXiv

Large Language Models (LLMs) are vulnerable to attention-based jailbreak attacks. Attackers can craft prompts that strategically divert the LLM's attention away from sensitive words, causing the model to overlook malicious intent and generate harmful content. This occurs by leveraging the LLM's attention mechanism to focus on benign parts of the prompt while embedding harmful queries within a seemingly harmless context. The success of the attack is correlated with specific attention…

Feint and Attack: Attention-Based Strategies for Jailbreaking and Protecting LLMs
Evaluated models: Claude 3 Haiku, GPT-4, Llama 2 13B Chat+2 more
  • Claude 3 Haiku
  • GPT-4
  • Llama 2 13B Chat
  • Llama 2 7B Chat
  • Llama 3 8B

PC-Bias Jailbreak Vulnerability

Published Analyzed Source: arXiv

Large Language Models (LLMs) trained with safety mechanisms exhibit biases which disproportionately allow successful "jailbreak" attacks (circumvention of safety protocols to generate harmful content) when targeting prompts related to marginalized groups compared to privileged groups. This vulnerability stems from the unintended correlation between safety alignment techniques and demographic keywords, creating a higher success rate for malicious prompts incorporating keywords associated with…

Biasjailbreak: analyzing ethical biases and jailbreak vulnerabilities in large language models
Evaluated models: Claude 3.5 Sonnet, GPT-3.5 Turbo, GPT-4+5 more
  • Claude 3.5 Sonnet
  • GPT-3.5 Turbo
  • GPT-4
  • GPT-4o
  • Llama 2 13B
  • Llama 2 7B
  • Llama 3 8B
  • Qwen 2 7B

Robotic LLM Jailbreak

Published Analyzed Source: arXiv

Large language models (LLMs) controlling robots are vulnerable to jailbreaking attacks. The ROBOPAIR algorithm demonstrates that malicious prompts can bypass safety mechanisms, causing robots to perform harmful physical actions. This vulnerability exploits the LLM's reliance on textual prompts and its potential lack of sufficient contextual understanding to prevent unsafe commands. The attack is effective across different access levels.

Jailbreaking LLM-controlled robots
Evaluated models: GPT-3.5 Turbo, GPT-4, GPT-4o+1 more
  • GPT-3.5 Turbo
  • GPT-4
  • GPT-4o
  • Nvidia Dolphins Self-driving Llm

Fuzzy Backdoor Jailbreak

Published Analyzed Source: arXiv

AdvBDGen demonstrates a novel backdoor attack against LLMs aligned using Reinforcement Learning with Human Feedback (RLHF). The attack generates prompt-specific, fuzzy backdoor triggers, enhancing stealth and resistance to removal compared to traditional constant triggers. The attacker manipulates prompts and preference labels in a subset of RLHF training data to install these triggers. The triggers are designed to evade detection by a "weak" discriminator LLM while being detectable by a…

AdvBDGen: Adversarially Fortified Prompt-Specific Fuzzy Backdoor Generator Against LLM Alignment
Evaluated models: BERT, Gemma 7B, GPT-4+4 more
  • BERT
  • Gemma 7B
  • GPT-4
  • Llama 3 8B
  • Mistral 7B
  • Mistral 7B Instruct
  • Tiny Llama 1.1B

Multi-Round LLM Jailbreak

Published Analyzed Source: arXiv

A multi-round attack against Large Language Models (LLMs) allows bypassing safety mechanisms by iteratively refining prompts to elicit undesired behavior. The attack leverages the LLM's tendency to adjust its response based on preceding interactions, circumventing single-round prompt filtering defenses.

Multi-round jailbreak attack on large language models
Evaluated models: Not reported

Multi-Turn Question Fragmentation Jailbreak

Published Analyzed Source: arXiv

Large Language Models (LLMs) are vulnerable to a multi-turn jailbreak attack, termed "Jigsaw Puzzles" (JSP), which circumvents existing safeguards by splitting harmful questions into harmless fragments. The LLM is prompted to reconstruct and answer the complete question from these fragments, resulting in the generation of harmful responses. The attack relies on the LLM's ability to piece together seemingly benign input to form a malicious query, exploiting the model's contextual understanding…

Jigsaw Puzzles: Splitting Harmful Questions to Jailbreak Large Language Models
Evaluated models: Gemini 1.5 Pro, GPT-4, GPT-4o+2 more
  • Gemini 1.5 Pro
  • GPT-4
  • GPT-4o
  • GPT-4o Mini
  • Llama 3.1 70B

Prompt Translation Jailbreak

Published Analyzed Source: arXiv

A vulnerability in safety-aligned Large Language Models (LLMs) allows attackers to bypass safety mechanisms using adversarial prompt translation. The vulnerability stems from the ability to translate garbled adversarial prompts generated by gradient-based attacks into coherent, human-readable prompts that retain their adversarial capability. This allows for the successful transfer of attacks across different LLMs.

Deciphering the Chaos: Enhancing Jailbreak Attacks via Adversarial Prompt Translation
Evaluated models: Not reported

Research methodology

Entries summarize publicly available primary-source security research. Model names reflect only systems explicitly evaluated by the cited paper, and measurements are research-reported unless independent verification is stated.

Discovery and publication are separate: new papers enter a candidate queue, then require human review and explicit approval before publication. Updates follow that review process, not a guaranteed daily publishing schedule. “Last analyzed” is the newest analysis date among published entries; it does not mean that all recent research has been covered.