# Observability and auditability

**Test family:** `OBS`

Apply these to the task, not mechanically to every pixel. Cross-cutting failures often emerge only through interactions with domain item files.

- **OBS-001** User-visible status, API result, persisted state, log, metric, trace, notification, and audit agree on outcome.
- **OBS-002** Correlation IDs connect user action through async/external work without exposing secrets.
- **OBS-003** Expected validation/user errors do not page as system failures; severe failures and silent partial results do.
- **OBS-004** Metrics count attempts/success/failure/retry/dedupe at meaningful boundary and retain tenant/privacy safety.
- **OBS-005** Alert includes decision-ready context and runbook without requiring production data exposure.

## Comprehensive per-item coverage

- **OBS-006** Apply the quality concern to absent, empty, ordinary, boundary-size, malformed, stale, concurrent, and failure-state data.
- **OBS-007** Include text containing ASCII emoticons, emoji/ZWJ sequences, kaomoji, accents, mixed scripts, RTL, combining marks, confusables, invisible characters, and control characters.
- **OBS-008** Exercise UI, API, import/export, automation, mobile, background jobs, notifications, analytics, logs, caches, and stored representations.
- **OBS-009** Test anonymous, ordinary, privileged, suspended, removed, and cross-tenant actors with least privilege and final-commit authorization.
- **OBS-010** Use fresh, stale, conflicting, deleted, archived, and partially migrated records; expose uncertainty rather than silently choosing.
- **OBS-011** Repeat and race operations before commit, after commit before response, and after partial downstream success; require safe idempotency.
- **OBS-012** Force timeout, disconnect, quota, dependency error, malformed response, regional failover, and recovery failure.
- **OBS-013** Use supported browsers, devices, network qualities, locales, time zones, input methods, and assistive technologies.
- **OBS-014** Measure median and tail latency, throughput, resource use, queue depth, retries, and degradation at normal and supported boundary load.
- **OBS-015** Use inert injection canaries across markup, script, SQL, templates, commands, paths, headers, CSV formulas, and logs.
- **OBS-016** Inspect URL, referrer, DOM, storage, clipboard, telemetry, logs, traces, notifications, exports, caches, backups, and screenshots for leakage.
- **OBS-017** Verify labels, roles, names, descriptions, focus, keyboard behavior, announcements, reflow, contrast, motion, alternatives, and error recovery.
- **OBS-018** Translate and lengthen text, switch RTL/LTR direction, change number/date/currency formats, and use unsupported glyph fallbacks.
- **OBS-019** Delete, restore, archive, expire, retain, export, anonymize, and purge; reconcile user-visible, indexed, cached, and backed-up state.
- **OBS-020** Verify one coherent audit trail with actor, authority, target, old/new state, time, source, correlation ID, attempts, and outcome.
- **OBS-021** Define observable success and failure signals, alert thresholds, dashboards, ownership, runbooks, and a way to test the monitors.
- **OBS-022** Compare intended requirement, implementation, deployed behavior, and evidence; do not promote inspected code or a single run into a pass.
- **OBS-023** Segment results by role, tenant, locale, platform, data shape, load, and consequential workflow so averages do not hide severe failures.
- **OBS-024** Run destructive, high-volume, privacy-invasive, and security probes only in an authorized isolated environment with recovery and stop conditions.
- **OBS-025** State residual risk, untested combinations, evidence tier, confidence limits, rollback trigger, and owner before recommending release.

[Back to Cross-cutting quality index](../../cross-cutting.md)
