Product Overview

Predictive Test Selection uses large language models (LLMs) to understand your code changes and automatically identify the most relevant tests to run.

By analyzing both source code and test files, CloudBees Smart Tests builds a deep understanding of how your code is structured and how different components relate to one another. Using commit information, it calculates the similarity between changed files and test files to determine which tests are most likely impacted — producing an optimized test execution plan where critical tests are prioritized and redundant ones are safely skipped.

With Predictive Test Selection, CloudBees Smart Tests brings code-aware test execution intelligence to your CI process — helping teams run fewer but relevant tests, gain faster feedback, and ship high-quality software with confidence.

Check out the full Predictive Test Selection page for more info.

The Trends page shows aggregate info about your test sessions, including average test session duration, test session frequency, and how often sessions fail.

Seeing this data over time gives you a picture of how your test suite evolves; for example, perhaps your tests are taking twice as long as they did six months ago, and you need to cut it down! Similarly, perhaps your team’s running tests a lot more often than expected, driving up resource costs. Or maybe you have some broken tests that are driving up the overall failure rate.

CloudBees Smart Tests also surfaces Unhealthy Tests in your test suite so you can fix them and run tests more reliably.

As soon as you start sending test results to CloudBees Smart Tests using the CloudBees Smart Tests CLI, you can view Test results and reports in the CloudBees Smart Tests dashboard. CloudBees Smart Tests provides a richer view of test results, helping developers triage and fix failures more quickly.

For quick access to this page, the CloudBees Smart Tests CLI prints out a link to the results view every time you record results:

In addition, CloudBees Smart Tests shows all of your test runs in one place for easy navigation. No more digging around build logs:

Using duration information from past test runs, CloudBees Smart Tests can automatically create evenly-sized bins of tests for you to run your test suite in parallel. See Test Suite Parallelization

The CloudBees Smart Tests Slack app provides Test Notifications via Slack so developers can immediately take action on the results, whether that’s to triage failures or merge a PR. Developers can create subscriptions to receive personal notifications about test sessions run against their branches/pull requests or other test sessions they care about.

The app sends notifications directly to developers so they don’t have to manually check their email or navigate to their pull request to see if their tests passed.