You can view test reports in the CloudBees Smart Tests web app as soon as you start sending test results to CloudBees Smart Tests using the CloudBees Smart Tests CLI. CloudBees Smart Tests provides a richer view of test results, helping developers triage and quickly fix failures.
For quick access to test results, the CloudBees Smart Tests CLI prints out a link to this page every time you record test results:
In addition, the Test Sessions page shows all of your sessions in one place for easy navigation. No more digging around build logs:
Test Status
CloudBees Smart Tests defines the following statuses. For example, let’s say 100 tests were run, 10 failed, and 3 of them flaked. This means 90 tests passed, but 3 of them passed after a number of retries, and 10 tests kept failing throughout.
-
Success: A test that passed.
-
Failure: A test that failed in all executions.
-
Flake: A test failure that eventually succeeded after a number of retries within the same test session.
-
Skip: A test that was skipped.