Skip to main content
When Ito finds a test result that needs attention, it assigns one of four actionable severity levels based on the impact on users and your application. Severity is set by the AI agent during analysis and reflects the real-world consequence of the result.

​
The four actionable levels

Severe issues that block core functionality or break key user flows. The application is unusable or data integrity is at risk.Examples: A checkout flow that throws an unhandled error, a login screen that rejects valid credentials, a payment form that fails to submit.Critical bugs should be fixed before the PR merges.
Major issues that impact important features or significantly degrade the user experience, but do not completely block the application.Examples: A search feature that returns no results for valid queries, a settings page that saves changes silently without applying them, a modal that cannot be dismissed.High bugs typically warrant a fix before shipping.
Noticeable issues that affect usability but do not block core functionality. Users can still accomplish their goals but the experience is degraded.Examples: Incorrect copy on a success message, a form field that accepts invalid input without an error message, a page element that renders misaligned on a specific viewport.Medium bugs can often be fixed in a follow-up PR.
Minor issues or edge cases with limited impact on users. Often cosmetic or only triggered in rare conditions.Examples: A truncated label in a dropdown, an inconsistent hover state, a tooltip with outdated text.Low bugs are tracked for awareness but are typically low priority.

​
Additional Findings

Additional Findings are issues that appear unrelated to your current PR. They are shown separately so you can review them without treating them as failures introduced by the current change. Additional Findings have the same set of 4 severity levels as the main test failures. Customers tend to fix high severity Additional Findings they confirm, file tickets for mid-level findings, and ignore minor/low severity Additional findings.

​
Severity in the dashboard

Severity levels appear throughout the Ito dashboard:
  • Statistics panel: The dashboard shows total bug counts broken down by the four actionable severity levels: Critical, High, Medium, and Minor.
  • PR list: Each PR row shows the pass, fail, and Additional Findings counts from its latest test run.
  • Test case detail: Individual test cases display their severity level alongside the bug description and code analysis.
The statistics panel also shows a bug detection rate: the percentage of tested PRs where at least one bug was found.
  • Test Cases — Where severity is assigned and displayed
  • Test Runs — The run that produces the test cases