Python
For an example of using promptfoo in a Google Colab/Jupyter Notebook, see this notebook.
This notebook shows how to
- Set up & configure Promptfoo
- Set up secrets (such as an OpenAI or Anthropic API key)
- Run an eval of LLM models, prompts and outputs
- Run another eval that includes Python code