Issues

Issues flag the cause of a test failure, a UI/UX improvement, or an unclear test instruction, and cite exactly where in the run or instructions it occurred. Individual issues are grouped in the background into Issue Groups, shown on the Issues and Overview pages.

​

Individual Issues

Issues are generated per flow run. View them on a flow run directly, or through the occurrences in an issue group. A flow run shows what happened; an issue group shows where similar issues happened across your runs. Each issue has the following properties:

​

Issue Groups

An Issue Group collects individual issues that describe the same underlying problem, even when they occur on different runs, flows, apps, or devices. Grouping is semantic, so issues match on meaning rather than exact wording, and runs in the background: new issues join existing groups automatically, duplicate groups merge, and overly broad groups split. Each group falls into one of three categories:

• Critical: App bugs responsible for test failures. Any group that contains a critical issue.
• UI/UX: Visual, usability, and performance improvements that didn’t fail the test.
• Instruction: Instructions the agent found ambiguous, contradictory, or impossible on the current build. These point to the test, not your app.

A group shows:

• Occurrences: The total times the problem has been seen.
• Affected flows, apps, devices, and builds: The places where it occurs.
• Severity breakdown: The count of critical, major, and minor issues in the group.
• First and last seen: The times when the problem started and when it last occurred.
• Evidence: The runs where it occurred, each with a screenshot from the exact action.

​

Triage

Every group has a status. Use the status toggle on the Issues page to filter by New, Dismissed, Closed, or All. Statuses are shared across your workspace.

​

Next Steps

• Learn how flows are reviewed
• Get notified when runs complete
• Track performance metrics on every run