The CloudBees platform Test insights dashboard provides users with a comprehensive view of all testing metrics in their projects. Software testing is invaluable to improve code quality, performance, and security.
Charts display components, workflows, and runs with and without test suites. An overview table of each test suite contains links to more information.
For any data that is truncated with an ellipsis (… ), hover to display the full content.
Use the scroll bars (vertical and horizontal), if necessary, to view the full content.
|
Access and filter test insights charts
Select the time frame of data for analysis for charts in the Test insights dashboard. By default, the last seven days of data are displayed. An option to select a component to filter on is available only if you have not yet selected a specific component.
-
Select
. -
(Optional) Filter for the chart data you want to display by selecting the following:
-
Select the FILTER above the charts.
-
Select one or more Components from the options, if available. If you have already selected a component prior to selecting Test insights, that selection is maintained.
-
Select a Duration from the following options:
Table 1. Duration filter definitions Duration Definition Current week
Current week in the month, Monday to Sunday schedule. For example, if current day is Tuesday, only data from Monday and Tuesday are displayed.
Previous week
Previous week in the month, Monday to Sunday schedule.
Two weeks back
Two weeks prior in the month, Monday to Sunday schedule.
Current month
First day of current month up to current day.
Previous month
First day to last day of previous month.
Two months back
First day to last day of two months prior.
Last 7 days
The past seven days.
Last 30 days
The past 30 days.
Last 90 days
The past 90 days.
Custom range
-
Select APPLY.
-
The data are filtered accordingly and displayed in the test insights charts.
Set a custom date range
To set a custom date range:
-
Select FILTER.
-
Select Custom range.
-
(Optional) Select the to go to a previous month and year.
-
Select a date for the time frame start.
-
(Optional) Select the to go to a subsequent month and year.
-
Select a date for the time frame end.
The custom date range is set accordingly and displayed in blue on the date picker. You can view the analytics data for any desired time frame, as in the example below:
Components, workflows, and runs information
Get an overview of components, workflows, and workflow runs for the filtered component data in a specified time frame.
The dashboard charts display the following with and without test suites:
-
Components
-
Workflows
-
Workflow runs
Each chart displays the following details (highlighted in the Workflows chart above):
-
Total number.
-
A donut chart of those with and without test suites (in percentages).
-
Numbers of those with and without test suites.
The Components chart also displays the number of associated repositories, and the Workflows chart displays the number of associated branches. |
Components chart links
Select a number, or a section of the donut chart, to list the:
-
Component name
-
Repository URL
-
Number of test suites
If you select a section of the donut chart, or the with or without test suites numbers, the data displayed is for only that subset of components. |
In the list, perform any of the following:
-
Select FILTER to filter by with or without test suites.
-
Search for specific components by entering all or part of any column item into Search.
-
Select or next to a column heading to sort on that heading.
-
Select a component name to display its component summary in a new browser tab.
-
Select a repository URL to display the repository in a new browser tab.
Workflows chart links
Select a number, or a section of the donut chart, to list the:
-
Workflow name
-
Component name
-
Branch name
-
Number of workflow runs
-
Number of test suites
If you select a section of the donut chart, or the with or without test suites numbers, the data displayed is for only that subset of workflows. |
In the list, perform any of the following:
-
Select FILTER to filter by with or without test suites.
-
Search for specific workflows by entering all or part of any column item into Search.
-
Select or next to a column heading to sort on that heading.
-
Select a component name to display its component summary in a new browser tab.
Workflow runs chart links
Select a number, or a section of the donut chart, to list the:
-
Run ID
-
Workflow name
-
Component name
-
Branch name
-
Run status
-
Number of test suites
If you select a section of the donut chart, or the with or without test suites numbers, the data displayed is for only that subset of workflow runs. |
In the list, perform any of the following:
-
Select FILTER to filter by with or without test suites.
-
Search for specific runs by entering all or part of any column item into Search.
-
Select or next to a column heading to sort on that heading.
-
Select a run ID to display the run details in a new browser tab.
-
Select a component name to display the component summary in a new browser tab.
Access and filter the tests overview
The filterable tests overview lists details of all test suites run. Select from any or all of the following to filter for a specific subset of tests:
-
Test suite name
-
Component name
-
Workflow name
-
Branch name
To access and filter the tests overview:
-
Select
. -
(Optional) Select FILTER, and then select one or more of the options.
-
(Optional) Search for specific test suites by entering all or part of any column item into Search.
The data are filtered accordingly and displayed in Tests overview.
Tests overview details
Tests overview provides details on specific test suite runs, including:
-
Test suite name
-
Component
-
Workflow
-
Branch
-
Last run
-
Total test cases
-
Average run time
-
Total runs
In the list, perform any of the following:
-
Select or next to a column heading to sort on that heading.
-
Select an item from the Total test cases column to display the following:
-
Test name
-
Branch name
-
Average test run duration
-
Total test runs
-
Test failure rate
Figure 5. Example test cases list with run activity link highlighted. -
-
Select an item from the Total runs column to display the following:
-
Run time
-
Run ID: select to display run details in a new browser tab.
-
Run status
-
Total tests
-
Number of failed tests
-
Test run activity
The following information is listed above the test run activity graph:
-
Workflow name
-
Test average run time
-
Number of total, successful, failed, and skipped runs.
Each bar on the graph represents a workflow run. Select a bar to display the:
-
Workflow run ID
-
Run date and time
-
Run duration
Below the graph is the run ID linking to the run details, and any test output.
Compare metrics
Use this feature to compare metrics among all organizations (orgs) and sub-organizations (sub-orgs) in the tenant. You can compare metrics within select charts in the analytics dashboards. In the generated list of all orgs/sub-orgs, sort by the org/sub-org name or its status. Select an org to drill down to the component level to display a more fine-grained status list. Hover over a status item to display more information.
You can only compare metrics for charts with the on the upper right. |
In the following example from the Workflows chart on the Software delivery activity dashboard, the workflows are listed for all orgs in the tenant.
To compare metrics on a chart with this feature:
-
Select Analytics on the left pane, and then select a dashboard (in this example, Software delivery activity).
-
Select any on the top right of a chart (in this example, Workflows) to display the list of orgs/sub-orgs and their status.
The workflows in the compare metrics list adds up to the total workflows in the workflow chart below. -
(Optional) Hover over a status to display more information, usually the legend for a horizontal stacked bar.
Figure 7. Hovering over the Org2 status to display workflow details. -
(Optional) Select or next to a column heading to sort on that heading.
-
(Optional) Select an org to list more details about each sub-org and/or component within that org.
Figure 8. Select Org2 to display the workflow statuses of its sub-orgs. -
(Optional) Select a sub-org to list more details about each sub-org and/or component within that sub-org.
Figure 9. Select subOrgA to display the workflow statuses of its components.
The list of the status of all orgs/sub-orgs/components for the specific metric is displayed. In the Workflow example above, selecting on a specific org or sub-org enables you to drill down to information for a specific component.