Skip to main content

Telemetry

promptfoo collects basic anonymous telemetry by default. This telemetry helps us decide how to spend time on development.

An event is recorded when:

  • A command is run (e.g. init, eval, view)
  • An assertion is used (along with the type of assertion, e.g. is-json, similar, llm-rubric)

No additional information is collected. The above list is exhaustive.

To disable telemetry, set the following environment variable:

PROMPTFOO_DISABLE_TELEMETRY=1

Updates​

The CLI checks NPM's package registry for updates. If there is a newer version available, it will display a banner to the user.

To disable, set:

PROMPTFOO_DISABLE_UPDATE=1