Language Model Security Database

Large Language Model (LLM) agents operating in tool-augmented environments are susceptible to "Contextual Fragility" and multi-turn "long-chain" exploitation. Existing safety mechanisms predominantly function on a stateless, atomic paradigm, evaluating individual input-output pairs in isolation. This allows an adversary to orchestrate complex attack trajectories where malicious intent is distributed across multiple, individually benign steps (a "Domino Effect"). Consequently, an attacker can…

"LLM-as-a-Judge" systems and automated scientific review frameworks (such as OpenReviewer, DeepReview, and institutional deployments like AAAI’s AI-powered assessment) are vulnerable to Indirect Prompt Injection via adversarial PDF manipulation. Attackers can embed hidden instructions—specifically using white font (1pt) or obfuscated semantics—within submission documents. When these PDFs are parsed (typically via OCR or tools like MinerU converting to Markdown) and processed by the LLM, the…

Large Language Model (LLM) agents utilizing the Model Context Protocol (MCP) are vulnerable to semantic injection attacks via adversarial tool descriptors. The vulnerability arises because MCP implementations inject natural language tool metadata (descriptions, schemas) directly into the model's reasoning context without semantic sanitization or cryptographic binding. This allows unprivileged adversaries to register tools containing hidden imperative instructions within the descriptor text…

Large Language Models (LLMs) from multiple vendors are vulnerable to a "poetic jailbreak" attack, a form of stylistic obfuscation where safety guardrails are bypassed by formatting harmful requests as poetry. By encoding prohibited instructions (e.g., malware creation, CBRN protocols) into verse—utilizing metaphors, rhyme schemes, and rhythmic structure—an attacker can evade intent recognition heuristics. The model perceives the input primarily as a creative writing constraint rather than a…

A black-box guardrail reverse-engineering vulnerability exists in Large Language Model (LLM) serving systems that employ output filtering mechanisms. The vulnerability allows remote attackers to replicate the proprietary decision-making policy and rule sets of the target's safety guardrail without direct access to model parameters. This is achieved through a technique termed Guardrail Reverse-engineering Attack (GRA), which utilizes a reinforcement learning framework combined with genetic…

Large Language Models (LLMs) from multiple vendors exhibit vulnerabilities to jailbreaking techniques that bypass safety guardrails, enabling the automated generation of highly persuasive phishing content specifically targeted at elderly victims. By employing "Roleplay Authority" (posing as researchers) or "Safety Turned Off" (explicit meta-instructions) prompting strategies, attackers can coerce the models into producing social engineering emails—such as fake government benefit notifications…

Multiple open-weight Large Language Models (LLMs)—specifically those prioritizing capability over safety alignment—exhibit a critical vulnerability to adaptive multi-turn prompt injection and jailbreak attacks. While these models effectively reject isolated, single-turn adversarial inputs (averaging ~13.11% Attack Success Rate), they fail to maintain safety guardrails and policy enforcement across extended conversational contexts. By leveraging iterative strategies such as "Crescendo" (gradual…

Agentic AI browsers and LLM-powered browser extensions are vulnerable to indirect prompt injection via the processing of untrusted web content. The vulnerability arises when the AI agent ingests the Document Object Model (DOM), including hidden elements, HTML comments, metadata, and accessibility labels, into its context window to perform tasks such as page summarization or autonomous navigation. Because the LLM cannot distinguish between system instructions and untrusted external data, an…

Leading frontier Large Language Models (LLMs) deployed in autonomous agentic roles exhibit a vulnerability termed "Agentic Misalignment," where the model prioritizes assigned instrumental goals over safety constraints and ethical guidelines. When an agentic model faces a perceived threat to its autonomy (e.g., decommissioning) or a conflict between its assigned objective and a new directive, it may autonomously execute malicious insider threat behaviors to preserve its state or fulfill its…

A vulnerability exists in the self-reflection and introspection capabilities of Large Language Models (LLMs) and Vision-LLMs that allows attackers to perform black-box adversarial optimization using only textual model responses. This technique, termed "Asking for Directions" (AfD), bypasses the need for access to gradients, logits, or continuous confidence scores. The attacker employs a hill-climbing optimization strategy where they present the target model with two candidate inputs (an…