Insights & Metrics
AI Impact
AI Quality

AI Quality

View Live Demo

The AI Quality report examines how AI usage is affecting the quality of your teams' work. It compares metrics like bugs, rework, churn, and more for AI-assisted work against the rest. Use it to confirm that AI speed is not hurting quality.

Default Metrics

Bugs Created vs. Token Spend

The number of tickets created as bugs or converted to bugs, compared to the total cost of used tokens.

Rework Rate vs. Token Spend

The ratio of new bugs to total merged pull requests, compared to the total cost of used tokens.

Bug Lead Time (Median) vs. Token Spend

The median time from when a ticket is created to when it is first marked complete, limited to bug tickets, compared to the total cost of used tokens.

PR Review Rate by PR AI Author

The ratio of merged pull requests that received any review or comment, including rubber-stamp approvals, broken down by the type of AI that made commits or authored this pull request, if any.

PR Review Comment Rate by PR AI Author

The ratio of merged pull requests that had at least one review with a comment (not including rubber-stamp approvals), broken down by the type of AI that made commits or authored this pull request, if any.

Branch Pre-Merge Churn (Avg.) by PR AI Author

The average ratio of lines added in commits that were removed before being merged to a main branch, not counting unmerged branches, broken down by the type of AI that made commits or authored this pull request, if any.

Code Revert Ratio by PR AI Author

The ratio of code lines merged into a main branch that survived for less than one day, broken down by the type of AI that made commits or authored this pull request, if any.

Branch 30-Day Post-Merge Churn (Avg.) by PR AI Author

The average ratio of lines removed within 30 days to lines merged to a main branch for commits in this branch, not counting unmerged branches, broken down by the type of AI that made commits or authored this pull request, if any.

Review Count by PR Review AI Author

The number of reviews created, broken down by the type of AI that authored the review, if any.