Productivity

6 minute read

Productivity in CloudBees Release Orchestration SaaS enables users, including both managers and developers, to understand pipeline group performance within a given timeline.

Filtering Productivity

Productivity displays pipeline group performance within a given timeline. You can select a pipeline group to filter the entire dashboard, and then you can select a timeline duration to filter most views.

In addition to filtering by duration, DORA Metrics and Commits Trend allow you to filter by comparing with other groups or by pipeline. You can also filter by the CloudBees Release Orchestration SaaS user (Engineer) in Commits Trend.

You can select the timeline duration to be:

  • 24 hours

  • 48 hours

  • 7 days (default)

  • 1 month

  • 3 months

  • All time

There is no filter for the Current Builds view.

To filter a Productivity view:

  1. From the CloudBees Release Orchestration SaaS Home page, select Value Stream Management  Productivity.

  2. Select a pipeline group from the GROUP options on the upper right of Value Stream Management  Productivity.

  3. Select from the DURATION options on the upper right of a given view.

  4. If applicable, you can select one of the FILTERS options on the upper right of either the Commits Trend or DORA Metrics views. To learn more, refer to DORA metrics or Commits trend.

    • Select Compare with other groups to compare with other pipeline groups.

    • Select Pipeline to view graphs of commits to specific pipelines.

    • Select Engineer to view graphs of commits by specific users.

You are displaying data filtered by your selections.

Productivity dashboard
Figure 1. Productivity views with filters highlighted

In Productivity, the following views are displayed:

Table 1. The Value Stream Management  Productivity dashboard views
View and link to more information Description Filter(s)

Items to do, in progress, and deployed for each JIRA project in the pipeline group

JIRA Task, Epic, Bug and/or Story

Successful, failed, and in-progress commits, builds, and deployments data

Duration

Number of success, failure, rollback, and hotfix deployments for each environment

Duration

Deployment Frequency, Deployment Lead Time, MTTR (mean time to recovery), and Failure Rate

Duration, Compare with other groups, Pipeline

Number of commits by date

Duration, Compare with other groups, Pipeline, Engineer

Current pipeline builds with commits information

None

Meaningful findings from data analysis to provide more insight

Duration

Projects overview

The Projects overview provides, for each project, a doughnut graph of number of issues to do, in progress, and deployed to each environment. The number and percentage of issues completed is also displayed.

You can display All or filter by any combination of:

  • Task

  • Epic

  • Bug

  • Story

Each blue number links to an issue list displaying:

  • Issue ID

  • Issue type

  • Summary

  • Assignee

  • Status

Projects overview
Figure 2. Projects overview with some links to issue details highlighted

Development overview

The Development overview provides the number and percentage of commits, builds, and deployments over a selected period of time, in pie graph format.

  • The commits graph summarizes how many commits went into production and how many are still in progress.

  • The builds graph summarizes successful and failed builds.

  • The deployments graph summarizes percentages of deployments to each environment.

  • The number next to Up arrow Increase or Down arrow Decrease is the percentage and number change from the previous timeframe.

    Development overview
    Figure 3. Development overview with comparison to previous duration highlighted
  • Each blue number links to a summary list for that timeline.

    Builds summary
    Figure 4. Development overview builds summary

Deployments

Deployments summarizes deployments with a bar graph for each environment. Successes, failures, rollbacks, and hotfixes are all displayed for the selected duration.

The number next to Up arrow Increase or Down arrow Decrease is the percentage change in deployment success rate from the previous timeframe.

Deployment
Figure 5. Stage environment deployment with comparison to previous duration highlighted

DORA metrics

DevOps Research and Assessment (DORA) metrics can measure performance of DevOps teams, and CloudBees Release Orchestration SaaS incorporates these metrics into Value Stream Management  Productivity.

The four key DORA metrics are:

  • Deployment frequency

  • Deployment lead time

  • Mean time to recover (MTTR)

  • Failure rate

Accessing and filtering DORA metrics views

You can filter the four DORA Metrics views by duration and by comparing with other groups or by pipeline. Select any number of options, or select ALL, and they are displayed separately on the graphs.

To access and filter DORA Metrics views:

  1. From the CloudBees Release Orchestration SaaS Home page, select Value Stream Management  Productivity.

  2. Select a pipeline group from the GROUP options on the upper right of Value Stream Management  Productivity.

  3. Select from the DURATION options on the upper right of the DORA Metrics view.

  4. (Optional) You can select one of the FILTERS options on the upper right. The default view displays commits from all pipelines and all users within a single pipeline group.

    • Select Compare with other groups to compare commits of the selected pipeline group with other pipeline groups. You can hover on a graph point to view the date range, group name, and number of commits.

      Commits trend filter
      Figure 6. DORA metrics deployment frequency compared with another group
    • Select Pipeline to view graphs of commits to specific pipelines in the group. You can hover on a graph point to view the date range, pipeline name, and number of commits.

  5. Select one of the following views from the top of DORA Metrics:

    • Deployment Frequency

    • Deployment Lead Time

    • MTTR

    • Failure Rate

      The average data for each view in DORA Metrics is listed under the view name.
    Lead time view
    Figure 7. DORA metrics deployment lead time view

You are displaying a DORA Metrics view of data filtered by your selections.

Frequency

The deployment frequency view depicts the total number of commits that finish a CloudBees Release Orchestration SaaS pipeline and go into production over a selected timeframe.

Deployment frequency
Figure 8. DORA metrics deployment frequency view with performance highlighted

Deployment frequency performance, as measured by the number of deployments over time, is displayed as a Star Star rating, as follows:

Table 2. The deployment frequency performance rating in the DORA metrics view
Star rating Name Definition

Star Star Star Star

Elite

> One per day

Star Star Star

High

Once daily to > once weekly

Star Star

Medium

Once weekly to > once monthly

Star

Low

Once monthly to > once every six months

Lead time

The deployment lead time view depicts on average how long it takes for commits finish a CloudBees Release Orchestration SaaS pipeline and go into production.

Deployment lead time
Figure 9. DORA metrics deployment lead time view with performance highlighted

Deployment lead time performance, as measured by the average time it takes for a commit to be deployed, is displayed as a Star Star rating, as follows:

Table 3. The deployment lead time performance rating in the DORA metrics view
Star rating Name Definition

Star Star Star Star

Elite

< One day

Star Star Star

High

One day to < one week

Star Star

Medium

One week to < one month

Star

Low

One month to < six months

MTTR

The mean time to recover (MTTR) view depicts the mean time taken to resolve an issue in production from the time of its creation.

MTTR view
Figure 10. DORA metrics MTTR view with performance highlighted

MTTR performance, as measured by the difference in time it takes between creating a production issue and resolving it, is displayed as a Star Star rating, as follows:

Table 4. The MTTR performance rating in the DORA metrics view
Star rating Name Definition

Star Star Star Star

Elite

< One hour

Star Star Star

High

< One day

Star Star

Medium

< One week

Star

Low

One week to < one month

Failure rate

The deployment failure rate view depicts the total number of production issues compared to the total number of commits deployed to production.

Failure rate
Figure 11. DORA metrics failure rate view with performance highlighted
Table 5. The failure rate performance rating in the DORA metrics view
Star rating Name Definition

Star Star Star Star

Elite

0 - 15%

Star Star Star

High

16% - 30%

Star Star

Medium

31% - 45%

Star

Low

> 45%

Commits trend

The Commits Trend view displays a line graph of the number of commits in a given period of time. You can also compare with other pipeline groups, or filter by either Pipeline or Engineer (user). Select any number of options, or select ALL, and they are displayed separately on the graph.

To filter a Commits Trend view:

  1. From the CloudBees Release Orchestration SaaS Home page, select Value Stream Management  Productivity.

  2. Select a pipeline group from the GROUP options on the upper right of Value Stream Management  Productivity.

  3. Select from the DURATION options on the upper right of the Commits Trend view. You can hover on a graph point to view the date range, pipeline group, and number of commits.

  4. (Optional) You can select one of the FILTERS options on the upper right. The default view displays commits from all pipelines and all users within a single pipeline group.

    Commits trend filter
    Figure 12. Commits trend pipeline filter highlighted
    • Select Compare with other groups to compare commits of the selected pipeline group with other pipeline groups. You can hover on a graph point to view the date range, group name, and number of commits.

      Compare with other groups
      Figure 13. Commits trend view with Compare with other groups filter selected
    • Select Pipeline to view graphs of commits to specific pipelines in the group. You can hover on a graph point to view the date range, pipeline name, and number of commits.

      Filter by pipelines
      Figure 14. Commits trend view with Pipeline filter selected
    • Select Engineer to view graphs of commits by specific users. You can hover on a graph point to view the date range, user name, and number of commits.

      Filter by engineer
      Figure 15. Commits trend view with Engineer filter selected

You are displaying Commits Trend data filtered by your selections.

Current builds

Current builds displays the latest builds deployed in each environment for all pipelines in the selected group. You can select a link to display the commits information for the selected build.

Current builds
Figure 16. Current builds view for multiple environments

Actionable insights

CloudBees Release Orchestration SaaS analyzes your pipeline group data and develops actionable insights. Actionable insights are helpful to determine what actions need to be taken or how one should think about an issue.

There are three types of insights:

  • Approvals

  • Test results

  • Pipeline stages

Select a link to get details of a specific component.

Possible actions
Figure 17. Five actionable insights as analyzed by CloudBees Release Orchestration SaaS