Different perspectives. One harness.

Your virtual AI testing team

AI-generated testing perspectives, not human reviewers. Select a profile to explore its focus.

← All articles
Setup & evidence · 2 min read

Measure the Testing Work, Not the Hype

Useful activity and cost data without invented savings.

/carbon-stats

Jason — virtual AI testerAIJasonAI Code ReviewArjun — virtual AI testerAIArjunData Integrity

How many tests did the agent create? How many did it execute? Which findings were actually fixed?

Those are different numbers. A useful dashboard keeps them different.

/carbon-stats brings together CARBON's recorded activity: commands and frequency, test creation and execution, findings, verified fixes, and available evidence. It helps you understand how the harness is being used and where the effort is going.

“Found” is not “fixed”

Imagine a run reports three issues. The agent later edits two files. That does not establish two fixes. A fix needs a retest tied to the original finding.

Likewise, a hundred generated test definitions are not a hundred executed tests. A screenshot count is not a coverage claim. Useful stats preserve the connection between activity and evidence rather than flattening everything into a productivity score.

Token, model, and cost information should appear when attributable measurements are available. Subscription sessions do not always expose that information. An invented token count is not more helpful than leaving the metric out.

Savings need a baseline

/carbon-stats summarize this project's activity, command frequency, verified fixes, and measured costs

Time and dollar savings can be estimated against an explicit human-work baseline, with the assumptions visible. They should not be advertised as measured results just because a task sounds expensive.

The dashboard is about activity and economics. It is not a shipping verdict, and one local project's command count does not establish worldwide adoption.

AI testing deserves scrutiny of its own. Show the work, show what changed, and show the numbers you can actually support.

Install CARBON at testers.ai/carbon for a supported coding agent such as Claude, Codex, or Cursor.

— Jason Arbon, CEO testers.ai