Seven dimensions. One command. Tell me exactly what is missing.
SysEdge ships two AI audit commands grounded in 19 architecture standards derived from a 114-source literature sweep with adversarial verification. Both commands read their standard descriptions from the graph at runtime — the standards evolve without code changes.
The two commands
One command for test files. One for use case sets.
Evaluates a test file against 7 AS-TEST-UC dimensions. Reads the UC's specification, inspects every assertion in the file, and returns PASS / WARN / FAIL per dimension with exact action items.
- 1Element Inventory — every testid in the UC's main flow must be asserted
- 2Role Visibility — permitted roles accessible, excluded roles denied — both directions mandatory
- 3Happy Path — main success scenario exercised end-to-end with post-condition asserted
- 4Validation & Error Paths — BVA/EP from the spec, API errors intercepted, empty graph state tested
- 5Equivalence Partitions — zero-nodes, single-node, pagination boundary from the specification
- 6Semantic Correctness — labels assert exact ontology text; no internal IDs (pos-, fn-) in assertions
- 7Specification Derivation — every test traces to a named UC step, precondition, or acceptance criterion
Evaluates UC adequacy against 7 AS-REQ dimensions. Reads the use case text and the graph's actor, exception, and scope nodes, then reports gaps in the specification itself — before a single test is written.
- 1Actor Completeness — all actors named, permissions specified per actor
- 2Auth Boundaries — authentication and authorisation preconditions explicit
- 3Exception Coverage — failure flows and edge cases specified alongside the happy path
- 4Ontology Alignment — entity names match the registered ontology, no invented terms
- 5Testability — acceptance criteria are verifiable, not subjective
- 6Scope Definition — out-of-scope explicitly listed; ambiguity resolved
- 7Bidirectional Traceability — UC links to user stories above and to test execution results below
Formbricks — open-source TypeScript
audit-test on the real response.spec.ts
Running audit-test against the Formbricks Playwright file closest to the export feature — apps/web/playwright/api/management/response.spec.ts — against UC-FBK-005 (Export responses to CSV):
None of these are opinion — each FAIL is a specific omission against a named dimension standard. The action items name the exact test class and assertion pattern to write.
Batch and preflight modes
CI-friendly. One command for a full UC set.
Batch mode runs audits sequentially and exits 1 if any FAIL — CI-friendly. Preflight shows which file the command would use without calling the LLM.
Audit freshness tracking
Stale audits are as visible as missing ones.
Every completed audit stamps auditTestLastRun and auditTestResult on the SysUseCase node. The audit-status command shows staleness across an instance:
An instance with 0 audits run is as visible as one with outdated tests. The health check surfaces UC audit and coverage-review stale counts in the DATA QUALITY section.
Research foundation
19 standards. 114 sources. Three confirmed literature gaps filled.
Find every omission before the code ships.
audit-test and coverage-review are included in the SysEdge bootstrap kit. Both commands read their standard descriptions from the graph at runtime — the standards evolve without code changes. Run them in CI. Run them before a session starts. Know exactly what is missing.