Evaluations
An introduction to the Qualifire evaluations
Evaluations
Evaluation is the fundamental building block for ensuring the integrity of your content. Think of it as a comprehensive test tailored to your specific needs. Familiarizing yourself with Evaluation is crucial, as many other features rely on or integrate with it.
Creating a new Evaluation
The process involves selecting one or more ‘checks’ – criteria you want to examine. The available checks are:
You have the flexibility to create Evaluations manually, choose a template from our library, or simply let our AI assistant handle it for you. The choice is yours!
On the Evaluations page, you can manage all your created Evaluations with ease (edit, duplicate or delete them if necessary).
An Evaluation on its own is just a set of checks, you can harnes those checks in many ways like, experiments for regression tests, while using the studio as part of the prompt engineering phase and of course as a part of you active protection.