Skip to main content

Manual Input Provider

The Manual Input Provider allows you to manually enter responses for each prompt during the evaluation process. This can be useful for testing, debugging, or when you want to provide custom responses without relying on an automated API.

Configuration​

To use the provider, set the provider id to promptfoo:manual-input in your configuration file:

providers:
  - promptfoo:manual-input

By default, the provider will prompt the user on the CLI for a single line of output. To open an editor that supports multiline input:

providers:
  - id: promptfoo:manual-input
    config:
      multiline: true

Usage​

To make manual input easier on the command line, set concurrency to 1 and disable progress bars:

promptfoo eval -j 1 --no-progress-bar