Run a test set

Prerequisites

You need a Test Set and an available team Agent of the type accepted by the execution selector. The current selector offers team-scoped NL-to-SQL Agents.

Create an execution

1. Open Test Sets > Execution Results.
2. Select the create-execution action.
3. Enter a non-empty task name.
4. Search for and select a Test Set.
5. Search for and select an eligible Agent.
6. Submit the task.

Expected result

DataFact creates a task record. The task runs asynchronously and the list reports task-level state.

Important limitations

• The Agent selector does not include private or non-NL-to-SQL Agents in the current workflow.
• Execution does not calculate a score in the web interface.
• The page does not show per-question output or per-question progress.

Errors and recovery

If no Agent is available, create or make available an eligible Agent before retrying. If submission fails, keep the selected IDs and returned error when requesting support.

Related guides

• Track execution progress
• Review execution results