DORA metrics

4 minute read

DevOps Research and Assessment (DORA) metrics can measure the performance of DevOps teams. The CloudBees platform displays each of the four key DORA metrics with an associated percentile performance rating and the percentage change from the previous timeframe.

The four key DORA metrics:

  • Deployment frequency

  • Deployment lead time

  • Change failure rate

  • Mean time to recovery (MTTR)

DORA metrics thresholds are configurable.

Use the following features to access the data on this dashboard:

  • Hover to display the full content for any data that is truncated with an ellipsis (…​).

  • Use scroll bars (vertical and horizontal) to display hidden content.

Access DORA metrics

Filter the four DORA metrics views by duration and by comparing them with other groups or by workflow.

To access and filter DORA metrics views:

  1. Select the next to Analytics on the left pane, select DORA metrics, and then select FILTER.

    Select environment
    Figure 1. Select components, environment, and duration.
    • Select one or more components from the options.

    • Select an environment from the options.

    • Select a Duration from the following options:

      Table 1. Duration filter definitions
      Duration Definition

      Current week

      Current week in the month, Monday to Sunday schedule. For example, if current day is Tuesday, only data from Monday and Tuesday are displayed.

      Previous week

      Previous week in the month, Monday to Sunday schedule.

      Two weeks back

      Two weeks prior in the month, Monday to Sunday schedule.

      Current month

      First day of current month up to current day.

      Previous month

      First day to last day of previous month.

      Two months back

      First day to last day of two months prior.

      Last 7 days

      The past seven days.

      Last 30 days

      The past 30 days.

      Last 90 days

      The past 90 days.

      Custom range

Set a custom date range

To set a custom date range:

  1. Select FILTER.

  2. Select Custom range.

  3. Select dates for the time frame start and end.

The custom date range is set accordingly and displayed in blue on the date picker. You can view the analytics data for any desired time frame, as in the example below:

Custom time frame
Figure 2. Example Custom range selected.

Customize the dashboard

Customize the dashboard to display only the charts and tables that matter the most to you.

Only charts and tables with Delete in the upper-right corner can be edited.

To customize the dashboard:

  1. Select Analytics on the left pane, and then select the dashboard.

  2. Select Vertical ellipsis on the top right of the dashboard.

  3. Select Edit dashboard.

  4. (Optional) Remove a chart or table from the dashboard.

    1. Select Delete next to the chart or table you want to remove.

    2. Select Save.

  5. (Optional) Add back a chart or table to the dashboard.

    1. Select Add chart/table to display a list of the available charts or tables.

    2. Select Add to dashboard next to the item to add.

    3. Select Apply.

  6. (Optional) Rearrange items on the dashboard by dragging them into place.

The dashboard is customized accordingly.

Prerequisites

  1. Specify the kind as kind:deploy in the workflow YAML for your deployment operations, as noted in Manage workflows.

  2. You must have at least one environment defined.

Example data ingestion
Figure 3. Specify the environment on the job level.

Explore Deployment frequency and MTTR

4 key metrics
Figure 4. Explore four key Dora metrics.
  1. Deployment frequency: The reading depicts the average number of successful deployments for the selected component and environment, per day.

    Example of successful deployments
    Figure 5. Example Successful Deployments list.

    Select the Average per day number links to display a list of successful deployments, for the selected Component and Environment.

    Each list includes:

    • Run Id

    • Run start time (UTC)

    • Deployed on (UTC)

    • Lead time

    • Component

    • Workflow

  2. Deployment Lead time: The reading depicts that it takes four minutes and two seconds to deploy from the time the PR is approved.

  3. Change failure rate:The reading tells what percentage the deployments have failed for the selected component(s) and duration to the selected environment.

  4. MTTR: The reading depicts how much time it takes for the failed deployments to resolve.

Deployment frequency and Lead time trend

Example deploy frequency
Figure 6. Example Deployment frequency and Lead time trend charts.

The above graph displays the successful deployments and deployment lead time over weeks when the user selects month duration. If the user selects week duration, it shows the data per day.

Explore Failure rate and MTTR trend

Example failure rate
Figure 7. Example Failure rate and Mean time to recovery trend charts.

The above graph displays the Failure rate and mean time to recovery over weeks.

Compare metrics

Use this feature to compare metrics among all organizations (orgs) and sub-organizations (sub-orgs) in the tenant. You can compare metrics within select charts in the analytics dashboards. In the generated list of all orgs/sub-orgs, sort by the org/sub-org name or its status. Select an org to drill down to the component level to display a more fine-grained status list. Hover over a status item to display more information.

You can only compare metrics for charts with Two arrows on the upper right.

To compare metrics:

  1. Select Analytics on the left pane, and then select a dashboard.

  2. Select any Two arrows on the upper right of a chart to display the list of orgs/sub-orgs and their status.

    The number of items in the compare metrics list equals the total displayed in the chart.
  3. (Optional) Hover over a status to display more information.

  4. (Optional) Select Sort down or Sort up next to a column heading to sort on that heading.

  5. (Optional) Select an org to list more information about each sub-org and/or component within that org.

  6. (Optional) Select a sub-org to list more details about each sub-org and/or component within that sub-org.

The list of the status of all orgs/sub-orgs/components for the specific metric is displayed.