Promptfoo 0.60.0: automatic red teaming test generation arrives
In one sentence With version 0.60.0 the open source Promptfoo framework, built to evaluate prompts and LLM applications, adds automatic generation of red teaming tests against harmful outputs, jailbreaks and app hijacking.
Promptfoo is an open source tool (MIT license) for testing LLM-based applications: you define prompts, models and test cases in a configuration file and the tool runs the evaluations.
With version 0.60.0, released on May 25, 2024, Promptfoo adds red teaming: instead of writing attacks by hand, the tool automatically generates test cases that try to make the application produce harmful content, bypass its rules (jailbreak) or be used for purposes other than intended.
The idea is to treat the security of an LLM app the way bugs are treated: with repeatable tests to rerun after every change.
Companies
Promptfoo
Tools
Promptfoo
Tags
Sources