Criterion 5

Requirement test results

Ratings 2026-10

At the end of implementation, executable tests check delivered behaviour against requirements or acceptance criteria. Results identify the tested code version and show passed, failed, missing and unverified requirements.

Coverage levels

1. Level 1 Requirement-to-test mapping and some executed behavior-test evidence exist, but their combined result record is incomplete.
2. Level 2 Requirement-linked behavior tests have executions/results; retained tested-code identity or missing/unverified visibility is incomplete.
3. Level 3 Executable requirement-linked results identify tested code and distinguish passed, failed, missing and unverified requirements.

Product ratings

• GitHub Copilot coding agent ?

  The agent can run executable tests, but requirement-linked results for a code version and missing/unverified requirements were not established.

  Read the rating and evidence

• Azure DevOps + Copilot

  With requirement-based suites and associated automated tests configured, executable results roll up to requirements for a build.

  Read the rating and evidence

• Atlassian suite (Confluence, Jira, Rovo Dev) ?

  Rovo acceptance-criteria review is an AI assessment, not executable testing of the implementation.

  Read the rating and evidence

• AWS Kiro

  Optional IDE property-based tests execute against the implementation and reference requirements/tasks.

  Read the rating and evidence

• GitHub Spec Kit ?

  The reviewed core workflow does not establish executable tests mapped to requirements/acceptance criteria with retained results for a code version.

  Read the rating and evidence

• OpenSpec ?

  Requirement-linked executable results for a delivered code version were not established in core.

  Read the rating and evidence

• BMAD Method + Test Architect

  Optional TEA trace maps requirements to tests, but its gate measures coverage; passing tests are separate.

  Read the rating and evidence

• Tessl

  The invoked SDD verification skill actually runs linked tests and reports pass/fail.

  Read the rating and evidence

• Jama Connect

  Requirement-linked test cases have runs, results and history, with automation imports available.

  Read the rating and evidence

• Siemens Polarion

  Requirement-linked test cases and individual records support coverage/results.

  Read the rating and evidence

• Factory.ai (Droid + QA) ?

  QA executes web, CLI or API flows and retains results/evidence.

  Read the rating and evidence

Back to comparison