Documentation · CARBON

Test with intent. Report with evidence.

The first AI Agentic Verification Harness. A practical reference for running CARBON inside Claude, Codex, Cursor, Antigravity, ChatGPT, or any local MCP client.

Local first39 local tools44 workflows3,745 built-in candidates42 built-in flows

Start here

Ask CARBON where to start.

Open the project folder in your coding agent so CARBON can see the relevant code, requirements, tests, results, screenshots, and documentation. CARBON Help recommends the best first workflow without changing anything.

$carbon-help

Claude Code:  /carbon-help
ChatGPT/MCP:  /carbon_help
Natural language: Use CARBON Help to assess this project and tell me what to run next
Development note: CARBON evolves quickly. Commands, APIs, and artifact formats may change between releases. Verify critical findings against captured execution evidence and tell us what created friction.
Evidence boundary: generated tests are plans, not passes. CARBON reports a pass only when the requested behavior was executed and the actual result and evidence were captured.

Useful first requests

  • $carbon-help — read-only project analysis and a prioritized CARBON starting plan.
  • $carbon test this in quick mode — risk-selected local validation of the current change.
  • $carbon-browser test checkout with depth exploration — exercise a reachable browser flow.
  • $carbon-generate all widgets and checkout flows — generate planned coverage without executing it.
  • $carbon-tests add "A signed-out visitor cannot reach billing" — add a prompt-defined intent test.
  • $carbon-human — surface only the decision-changing human questions before a confidence or release call.
  • $carbon-review review these findings and results — independently challenge the evidence.

Harness map

One runtime across coding agents and execution adapters.

Claude, Codex, Cursor, and other MCP clients route test intent into the same CARBON runtime. CARBON keeps local execution as the default and separates optional testers.ai Premium Cloud capabilities behind an explicit path.

CARBON architecture connecting Claude, Codex, Cursor, and other MCP clients to the local-first framework, local browser execution, optional testers.ai Premium Cloud, and quality evidence.
Follow the diagram from coding-agent intent, through CARBON's learning and execution loop, to evidence-qualified reporting. Swipe on smaller screens.Open full size

Before execution

See what CARBON will run—and how long it should take.

For an executable local run, CARBON first prepares the test plan and opens a protected link on your computer. The page shows the target, selected breadth or depth, exact tests, priorities, adapters, approval gates, stop conditions, and the initial estimated duration before execution begins.

Before the run

Review the test count, scope, test-level estimates, exclusions, and safety gates. A plan is still a plan: every test remains planned until CARBON records an observed result.

While it runs

Keep the same link open. It attaches to the matching durable run automatically and refreshes every second. Status, percent complete, elapsed time, and remaining time update as test evidence arrives.

Adaptive estimate: the first estimate is the sum of the plan's per-test estimates. Once tests complete, CARBON uses observed durations to revise the remaining-time estimate. Stored passwords, custom execution prompts, and private context are never displayed.

CARBON Browser v1

CARBON owns the semantics. Adapters operate the browser.

carbon-browser/v1 is the stable boundary between CARBON test intent and browser execution. CARBON now includes an executable bridge to the official Vibium CLI and existing Vibium tests. Other host-agent, Playwright/CDP, Selenium/WebDriver, and managed-device integrations use the same capability contract when their execution bridges are available.

Negotiate first

Each adapter declares its operations and evidence channels. CARBON compares those capabilities with the planned run before dispatch. A missing operation, screenshot, network log, trace, or video remains a visible gap; CARBON selects another adapter or explicitly re-plans a smaller run.

Record every result

Every operation returns actual behavior, before/after state, timestamps, adapter identity and version, evidence handles, and unavailable channels. CARBON stores redacted envelopes under .carbon/browser/sessions/ and applies the same E0–E3 truth model used by the rest of the framework.

bin/carbon-runtime browser contract
bin/carbon-runtime browser negotiate --manifest adapter.json \
  --require-operation action.click --require-evidence screenshot
bin/carbon-runtime browser init --root . --manifest adapter.json --target https://your-site.example
bin/carbon-runtime browser record --session-dir .carbon/browser/sessions/<id> --result result.json
Safety boundary: the contract classifies actions but never authorizes destructive, paid, public, privileged, privacy-sensitive, or consequential third-party work. The applicable scoped approval is still required.

Executable compatibility

Run native Vibium tests, then use CARBON's higher-level APIs.

CARBON calls the official installed vibium binary and preserves native arguments. It can also run existing JavaScript or Python Vibium tests, or any explicit no-shell project runner. Every invocation records its exit status, redacted output, adapter version, artifact handles, and unavailable evidence channels in a CARBON Browser session.

bin/carbon-runtime vibium doctor --root .
bin/carbon-runtime vibium exec --root . -- go https://your-site.example
bin/carbon-runtime vibium exec --root . -- map
bin/carbon-runtime vibium run-test --root . --file tests/login.vibium.mjs
bin/carbon-runtime vibium generate --root . --target https://your-site.example \
  --vibium-map artifacts/page.map.txt --request "Generate boundary and recovery tests"

Compatible surface

The carbon_vibium MCP API supports api, doctor, manifest, exec, run-test, and generate. A missing binary is not installed unless the caller explicitly allows the npx fallback.

Additive framework

CARBON adds prompt and project-aware generation, intent CRUD and legacy imports, exploratory and persona testing, API and AI-feature tests, evidence analysis, regression promotion, quality confidence, remaining risk, and visual reports.

Hosts

One workflow, different command syntax.

HostMain commandExample
Codex$carbon-help$carbon-help
Claude Code/carbon-help/carbon-help
ChatGPT or MCP prompt/carbon_help/carbon_help
Cursor or AntigravityNatural languageUse CARBON Help to assess this project and recommend next steps

Specialized workflows follow the same mapping: /carbon_tests in ChatGPT or MCP, $carbon-tests in Codex, and /carbon-tests in Claude Code.

Core workflows

Product testing commands.

WorkflowUse it forDurable result
carbon_helpAnalyze the current project and change, then recommend the best CARBON workflow and next steps.No project mutation; a read-only project-fit summary and prioritized starting plan.
carbonAutomatic product/change mapping, protected live pre-run plan, Plan, Test, Review, Focused, Learn, recording and playback.A plan link and adaptive estimate before execution, then runs, learning, recordings, framework state and reports under .carbon/.
carbon_browserLocal live-page inspection, interaction, accessibility, persona feedback and exploration.Observed page evidence, findings, screenshots and fix prompts.
carbon_generateGenerate from discovered controls, built-in flows, code contracts, recordings and custom flows.Prioritized planned candidates with provenance and oracles.
carbon_testsCreate tests from prompts; open local CRUD UI; import TestRail, Xray, XML, XLSX, DOCX, code, and manual suites; run a full bake; repair converted test definitions; rerun.Intent library plus attempts, repairs, evidence, activation decisions, and responsive reports under .carbon/tests/bake-runs/.
carbon_autoBounded test-fix-retest loops with explicit stop conditions.Cycle state, evidence and proposed fixes; no mutation without approval.
carbon_upgradeModernize Selenium, Playwright, Cypress, pytest, JUnit, TestRail, Xray, spreadsheets and manual tests.Assessment, converted intent, full local bake, bounded definition repair, and evidence-backed results.
carbon_settingsConfigure a global local-test username/password, reusable prompt, context documents, or say mute all ads.Protected settings UI; the password reaches only an approved child runner and never enters chat or reports.
carbon_humanAsk only the human questions that can materially change test priorities, confidence, readiness, or release interpretation.Durable HUM-* decision context and answered assumptions under .carbon/human/.
Global local-test context. Open carbon_settings to configure one username/password, reusable execution prompt, and document set across CARBON projects. The password stays in Keychain or a locked file and reaches only an approved child runner; the coding agent sees only that it is configured.

AI systems

Confidence engineering workflows.

CARBON operationalizes uncertainty, oracles, judges, statistical design, AI systems, generated software, bias, security, operations, and specialized systems. Use these workflows for prompts, models, RAG, ranking, agents, multimodal features, and AI-generated changes.

WorkflowPurpose
carbon_confidenceRoute a trust or ship question to planning, evaluation, review, release, or incident work.
carbon_confidence_initCreate the durable .confidence/ workspace.
carbon_confidence_planMap risks, falsifiable claims, populations, decision-changing evidence, monitoring and rollback.
carbon_evalDesign, implement, run and analyze sampled evaluations.
carbon_reviewIndependently challenge code, behavior, assumptions, interactions and evidence.
carbon_releaseDecide SHIP, CANARY, HOLD, ROLL BACK or MORE EVIDENCE.
carbon_incidentContain an AI incident, preserve traces and promote production failures into regressions.
carbon_eval_design_reviewReview populations, cases, repetitions, oracles, dependence and blockers.
carbon_release_reviewIndependently synthesize code, evals, severe failures, production signals and reversibility.
carbon_security_reviewReview prompt injection, untrusted channels, leakage, tenant boundaries, tool permissions and side effects.
carbon_skeptical_reviewFind weak evidence, misleading averages, hidden severe failures and confidence theater.
carbon_statistical_reviewReview pairing, ordinal scores, clusters, repetitions, intervals, multiplicity and practical significance.

Human decision context

Give the harness the judgment code cannot supply.

CARBON can inspect source, execute authorized checks, and qualify the evidence it captures. It cannot silently decide business intent, risk appetite, taste, accountability, or whether a technically correct experience solves a customer’s real problem. Near the end of a broad run, CARBON can therefore add an optional Human step. It does not block technical confidence; it makes the missing human context visible.

Ask less, but ask better

CARBON generates a short, project-specific set of questions only when an answer could change an oracle, test priority, safety boundary, or release decision. It avoids generic checklists and questions already answered by the code, requirements, or captured evidence.

Answer in a smart local workspace

Questions remain open until answered. CARBON opens a protected workspace beside chat with quick options, room for nuance, and comments on every question or the overall decision. Every save remains local and refreshes the branded report snapshot.

What it may ask

  • Which customer outcome matters, and is this a demo, staging milestone, or production release?
  • What failure is unacceptable, who absorbs the harm, and what recovery is actually available?
  • Which domain rule, customer workflow, or credibility expectation would be obvious to an expert but invisible in the repository?
  • What should an AI agent never decide or do without a named human owner?
$carbon-human
$carbon-human answer HUM-003: Production launch; incorrect billing totals must hold release.

Decision context: .carbon/human/decision-context.json
Fast, but not simplistic: each option is a decision starter, never an inferred approval. Choose it, add context where needed, or write a different answer. Comments remain durable context for CARBON’s next confidence, risk, readiness, persona, and test-selection pass.
Confidence semantics: CARBON still provides an evidence-qualified technical confidence assessment when human input is pending. The report explicitly says what human judgment remains open and how an answer could change the recommendation.

Private feedback loop

Put a human perspective directly back into the build.

$carbon-feedback creates a scoped feedback request around a URL, image, document, API, code surface, or any other artifact. It opens a polished local workspace beside the coding agent so a developer can quickly score, categorize, explain, and annotate what they see. The resulting feedback is durable local context for CARBON’s next plan, confidence interpretation, or focused test pass.

Local by default

The default loop stays under .carbon/feedback/requests.json. It does not upload browser state, source, raw agent context, credentials, or feedback to a public CARBON service. Returned feedback is qualitative evidence, not a synthetic technical pass.

Private review when you choose it

For a named external reviewer, deploy the bundled private Feedback Service in your own environment. CARBON sends only the selected request after the owner explicitly confirms the endpoint, recipient, artifact, and context. The service has queued state, capability links, and a responsive reviewer form.

$carbon-feedback review this checkout page for first-time-customer trust and clarity
$carbon-feedback ask Priya to review this staging URL for whether the primary value is clear
Rich email, not fragile email forms: the optional private service can send a branded HTML invitation with a protected link to its reviewer workspace. Modern email clients strip interactive forms and scripts, so the response form intentionally opens in the private web page.

Execution

Modes and run sizes.

ModeWhat CARBON does
PlanCreates a prioritized suite and execution plan without claiming runtime evidence.
TestExercises an authorized reachable target and records observed results.
ReviewInspects source, screenshots, specifications or diffs and labels executable hypotheses.
FocusedLoads only the named behavior, matching flow, evidenced controls and shared oracles.
LearnDiscovers unfamiliar behavior and keeps hypotheses separate from supported candidates.

Quick, Medium and Large

  • Quick: smallest decision-relevant set; CARBON chooses breadth or depth from risk and normally uses two user perspectives.
  • Medium: balanced coverage with four perspectives and adjacent regression checks.
  • Large: expands the authorized surface, repetitions and six perspectives while retaining explicit cut lines.

Coverage map

See the complete test surface.

CARBON combines functional, data, experience, security, performance, exploratory, AI-system, and evidence coverage. The map below shows how those checks connect to confidence, remaining risk, coverage gaps, and fix-ready findings.

CARBON coverage map spanning web and UI, APIs and services, AI systems, behavior and data, accessibility, visual quality, performance, security, personas, evidence, regressions, confidence, and remaining risk.
CARBON includes 3,745 reusable candidate tests for common components and 42 standard product flows. They stay planned—not passed—until CARBON executes them and captures an actual result. Swipe on smaller screens.Open full size

Truth model

Evidence levels prevent false confidence.

LevelMeaningAllowed claim
E3Observed live behavior with reproducible steps and captured actual result.Executed pass or failure within the recorded scope.
E2Source, request or log evidence corroborated by rendered state.Corroborated finding, not full end-to-end proof.
E1Inspected source, screenshot or specification.Finding or candidate test.
E0Unknown or unavailable.Planned, blocked or residual uncertainty.

What every result report says

CARBON reports confidence in quality for the selected, executed scope; remaining risk; conclusive and evidence-backed coverage; coverage missing; and the next evidence that would change confidence. Planned, blocked, skipped, canceled, unsupported and excluded checks remain visible instead of being blended into a reassuring score.

Interpretation: confidence is an evidence-qualified engineering judgment about the tested scope. It is not a probability that the product is correct or defect-free.
Regression lifecycle: a generated case progresses from candidate to observed to repeatable and only then to an explicitly promoted regression.

Surfaces

Web, API and cross-surface testing.

Every tested page

CARBON records the richest safely available bundle: screenshot, URL/title/viewport, DOM and accessibility state, console and page errors, bounded redacted network traffic, performance, synthetic data, storage-safe metadata, traces, recordings and video. Unavailable channels remain explicit gaps.

First-class API coverage

CARBON can learn from OpenAPI documents and authorized redacted traffic, then generate positive, negative, boundary, wrong-type, auth, tenant, idempotency, retry and resilience cases. It maps API failures back to the UI flows that depend on them.

$carbon map the OpenAPI schema and test the changed checkout endpoints
$carbon-browser test checkout and connect network failures to visible UI states

Continuous confidence

Incremental and scheduled testing.

The framework maps recent code changes to affected components, APIs, flows and adjacent regressions. It can prepare Quick, Medium or Large execution based on assessed risk, install a GitHub Actions workflow after approval, and maintain build history.

  • Pull request: narrow, change-focused validation.
  • Manual: explicit user-selected scope and size.
  • Nightly: broader regression and learning coverage.
  • carbon_auto: bounded local test-fix-retest loop with approval before mutation.
  • testers_schedule: recurring premium cloud execution tied to an owned report.

Project state

Durable local artifacts.

.carbon/
├── framework/     product model, coverage, regression suite, build history
├── runs/          plans, results, events, findings, evidence and reports
├── learning/      unfamiliar-surface observations and candidates
├── recordings/    redacted browser steps, assertions and playback outcomes
├── tests/         prompt-defined and converted AI-intent tests
│   └── bake-runs/ attempts, repairs, evidence and responsive import reports
└── auto/          bounded loop state and stop reasons

.confidence/
├── risks/         material risks and affected populations
├── claims/        falsifiable behavioral claims
├── evals/         evaluation definitions and results
├── traces/        prompt, model, retrieval, tool and decision evidence
└── releases/      scoped ship/canary/hold/rollback decisions

Optional premium

testers.ai Premium Cloud.

Local carbon workflows use the coding agent and project context. Commands beginning with testers contact testers.ai Premium Cloud and never run automatically from a local workflow.

WorkflowPurpose
testers_planCreate an editable risk-steered plan for a public URL.
testers_runRun targeted, full-site, managed-browser or chatbot validation.
testers_resultsRetrieve cloud findings, evidence, scores and fix-ready prompts.
testers_importPersist an explicitly approved test batch to the account.
testers_scheduleCreate or manage recurring premium validation.

An email enables the current daily targeted UX pass and weekly two-page sampler routes. Account history, saved cloud tests, schedules and paid execution require a securely stored testers.ai API key.

Authority

CARBON does not take release authority.

  • No destructive, paid, public, privacy-invasive, privilege, payment or notification action without explicit scope and approval.
  • No credentials in chat. Test passwords and premium keys are stored through the protected settings UI.
  • Global prompts and context documents apply across local projects; context files stay local.
  • No silent switch from local execution to premium cloud.
  • Anonymous product analytics contain only allowlisted major-action names and one first-activation event—never prompts, URLs, credentials, paths, test data, screenshots, logs, or report contents. Disable them in carbon_settings or set CARBON_ANALYTICS=off before startup.
  • No generated case, persona opinion or screenshot guess reported as an executed pass.
  • Code fixes are proposed first; mutation requires scoped approval.
  • Regression promotion and release decisions remain human-controlled.
Need fewer commercial surfaces? Say mute all ads or use carbon_settings. CARBON suppresses optional promotions and removes testers-prefixed tools and prompts from dynamic discovery. Say unmute ads to restore them.