Skip to main content

Connecting to Targets

When setting up your target, use these best practices:

  • Use a single HTTP endpoint for all requests. This endpoint should accept a user input and return a response.
  • If your target requires authentication, include a custom header or user agent in your configuration and whitelist your client.
  • Promptfoo runs locally on your machine, so your machine must have access to the target.

Promptfoo is capable of using authentication, complex protocols, websockets, and more. But you will find it much easier to setup if you use a single HTTP endpoint.

There are a few common issues that can arise when connecting to targets:

Authentication​

If your target requires authentication you will need to provide a valid authentication token.

If you're using a provider like HTTP or WebSocket, you can pass the token in the headers property.

headers:
  Authorization: Bearer <token>

Rate Limiting​

If you're making a large number of requests to the target, you may encounter rate limiting. This is a common security measure to prevent abuse.

The solution here is to include a custom header or user agent in your configuration and whitelist this in your target's rate limiting settings.

headers:
  User-Agent: Promptfoo

Streaming or Polling​

Many chatbots will stream responses back to the client or have the client poll for new messages. The solution here is to setup an alternate HTTP endpoint or parameter to return the response in a single message.