Test insights

The CloudBees platform Test insights dashboard provides users with a comprehensive view of all testing metrics in their projects. Software testing is invaluable to improve code quality, performance, and security.

Charts display components, workflows, and runs with and without test suites. An overview table of each test suite contains links to more information.

For any data that is truncated with an ellipsis (…), hover to display the full content. Use the scroll bars (vertical and horizontal), if necessary, to view the full content.

Access and filter test insights charts

Select the time frame of data for analysis for charts in the Test insights dashboard. By default, the last seven days of data are displayed. An option to select a component to filter on is available only if you have not yet selected a specific component.

Select Analytics Test insights.

(Optional) Filter for the chart data you want to display by selecting the following:

Select the FILTER above the charts.
Select one or more Components from the options, if available. If you have already selected a component prior to selecting Test insights, that selection is maintained.

Select a Duration from the following options:

Table 1. **Duration** filter definitions
Duration	Definition
Current week	Current week in the month, Monday to Sunday schedule. For example, if current day is Tuesday, only data from Monday and Tuesday are displayed.
Previous week	Previous week in the month, Monday to Sunday schedule.
Two weeks back	Two weeks prior in the month, Monday to Sunday schedule.
Current month	First day of current month up to current day.
Previous month	First day to last day of previous month.
Two months back	First day to last day of two months prior.
Last 7 days	The past seven days.
Last 30 days	The past 30 days.
Last 90 days	The past 90 days.
Custom range	Select a custom range

Select APPLY.

The data are filtered accordingly and displayed in the test insights charts.

Set a custom date range

To set a custom date range:

Select FILTER.
Select Custom range.
(Optional) Select the to go to a previous month and year.
Select a date for the time frame start.
(Optional) Select the to go to a subsequent month and year.
Select a date for the time frame end.

The custom date range is set accordingly and displayed in blue on the date picker. You can view the analytics data for any desired time frame, as in the example below:

Figure 1. Example Custom range selected.

Components, workflows, and runs information

Get an overview of components, workflows, and workflow runs for the filtered component data in a specified time frame.

The dashboard charts display the following with and without test suites:

Components
Workflows
Workflow runs

Figure 2. Example Components, Workflows, and Workflow runs charts.

Each chart displays the following details (highlighted in the Workflows chart above):

Total number.
A donut chart of those with and without test suites (in percentages).
Numbers of those with and without test suites.

The Components chart also displays the number of associated repositories, and the Workflows chart displays the number of associated branches.

Components chart links

Select a number, or a section of the donut chart, to list the:

Component name
Repository URL
Number of test suites

If you select a section of the donut chart, or the with or without test suites numbers, the data displayed is for only that subset of components.

In the list, perform any of the following:

Select FILTER to filter by with or without test suites.
Search for specific components by entering all or part of any column item into Search.
Select or next to a column heading to sort on that heading.
Select a component name to display its component summary in a new browser tab.
Select a repository URL to display the repository in a new browser tab.

Workflows chart links

Select a number, or a section of the donut chart, to list the:

Workflow name
Component name
Branch name
Number of workflow runs
Number of test suites

If you select a section of the donut chart, or the with or without test suites numbers, the data displayed is for only that subset of workflows.

In the list, perform any of the following:

Select FILTER to filter by with or without test suites.
Search for specific workflows by entering all or part of any column item into Search.
Select or next to a column heading to sort on that heading.
Select a component name to display its component summary in a new browser tab.

Workflow runs chart links

Select a number, or a section of the donut chart, to list the:

Run ID
Workflow name
Component name
Branch name
Run status
Number of test suites

If you select a section of the donut chart, or the with or without test suites numbers, the data displayed is for only that subset of workflow runs.

In the list, perform any of the following:

Select FILTER to filter by with or without test suites.
Search for specific runs by entering all or part of any column item into Search.
Select or next to a column heading to sort on that heading.
Select a run ID to display the run details in a new browser tab.
Select a component name to display the component summary in a new browser tab.

Figure 3. Example Workflow runs list with two filters highlighted.

Access and filter the tests overview

The filterable tests overview lists details of all test suites run. Select from any or all of the following to filter for a specific subset of tests:

Test suite name
Component name
Workflow name
Branch name

To access and filter the tests overview:

Select Analytics Test insights.
(Optional) Select FILTER, and then select one or more of the options.
(Optional) Search for specific test suites by entering all or part of any column item into Search.

The data are filtered accordingly and displayed in Tests overview.

Tests overview details

Tests overview provides details on specific test suite runs, including:

Test suite name
Component
Workflow
Branch
Last run
Total test cases
Average run time
Total runs

Figure 4. Example Tests overview list.

In the list, perform any of the following:

Select or next to a column heading to sort on that heading.
Select an item from the Total test cases column to display the following:
- Test name
- Branch name
- Average test run duration
- Total test runs
- Test failure rate
- Test run activity link
Figure 5. Example test cases list with run activity link highlighted.
Select an item from the Total runs column to display the following:
- Run time
- Run ID: select to display run details in a new browser tab.
- Run status
- Total tests
- Number of failed tests

Test run activity

The following information is listed above the test run activity graph:

Workflow name
Test average run time
Number of total, successful, failed, and skipped runs.

Each bar on the graph represents a workflow run. Select a bar to display the:

Workflow run ID
Run date and time
Run duration

Below the graph is the run ID linking to the run details, and any test output.

Figure 6. Example of selecting a bar on the test run activity graph.

Compare metrics

Use this feature to compare metrics among all organizations (orgs) and sub-organizations (sub-orgs) in the tenant. You can compare metrics within select charts in the analytics dashboards. In the generated list of all orgs/sub-orgs, sort by the org/sub-org name or its status. Select an org to drill down to the component level to display a more fine-grained status list. Hover over a status item to display more information.

You can only compare metrics for charts with the

on the upper right.

In the following example from the Workflows chart on the Software delivery activity dashboard, the workflows are listed for all orgs in the tenant.

To compare metrics on a chart with this feature:

Select Analytics on the left pane, and then select a dashboard (in this example, Software delivery activity).
Select any on the top right of a chart (in this example, Workflows) to display the list of orgs/sub-orgs and their status.

The workflows in the compare metrics list adds up to the total workflows in the workflow chart below.
(Optional) Hover over a status to display more information, usually the legend for a horizontal stacked bar.

Figure 7. Hovering over the Org2 status to display workflow details.
(Optional) Select or next to a column heading to sort on that heading.
(Optional) Select an org to list more details about each sub-org and/or component within that org.

Figure 8. Select Org2 to display the workflow statuses of its sub-orgs.
(Optional) Select a sub-org to list more details about each sub-org and/or component within that sub-org.

Figure 9. Select subOrgA to display the workflow statuses of its components.

The list of the status of all orgs/sub-orgs/components for the specific metric is displayed. In the Workflow example above, selecting on a specific org or sub-org enables you to drill down to information for a specific component.