Red Team Troubleshooting Guide
Common issues encountered when red teaming LLM applications with promptfoo.
| Issue | Description |
|---|---|
| Attack Generation | Configuration errors in system scope, permissions, or available actions can prevent effective attack generation. |
| Connection Problems | Authentication failures, rate limiting issues, and incorrect endpoint configuration can prevent successful API connections. |
| False Positives | Insufficient system context in grader configuration can lead to incorrect vulnerability assessments. |
| Multi-Turn Sessions | Session management issues can disrupt conversation context in both client and server-side implementations. |
| Multiple Response Types | Response parsing errors occur when handling non-standard formats, guardrails, or error states. |
| Remote Generation | Corporate firewalls may block access to remote generation endpoints due to security policies around adversarial content. |