An introduction to Qualifire experiments
Prepare your data set in CSV format, ensuring that it contains the necessary fields for evaluation.
id | question | answer | expectedAnswer |
---|---|---|---|
1 | What is the capital of France? | Paris | Paris |
2 | What is 2 + 2? | 4 | 4 |
3 | Is the Earth flat? | No | No |
4 | Who invented the telephone? | Alexander Graham Bell | Alexander Graham Bell |
id
: A unique identifier for each rowquestion
: The input prompt/question to evaluateanswer
: The actual response/answer to evaluateexpectedAnswer
: The expected/ground truth answer (used for comparison if provided)Navigate to the Experiments page in the Qualifire platform.
Click on the 'Create New Experiment' button.
Upload your CSV file and specify the evaluation criteria and checks you want to apply.
Start the experiment and wait for the evaluation process to complete.