Invokes a pre-configured evaluation by its ID. The evaluation configuration (which checks to run, modes, assertions, etc.) is defined in the Qualifire dashboard.
Evaluation invoke request
At least one of input, output, or messages must be provided.
The ID of the pre-configured evaluation to invoke
The input text (e.g., user prompt)
The output text (e.g., LLM response)
Conversation messages for multi-turn evaluation
List of tools available to the LLM
Optional key-value pairs (string values only) to attach to the evaluation invocation