Getting Started with Automated Performance Regression Testing

Introduction to CyBench Automated Performance Regression Testing

CyBench allows users to set up automated performance regression testing. Assuming you have a private workspace configured on the CyBench UI, all you have to do is start benchmarking a specific project, sending reports to that workspace, and eventually CyBench will start running regression tests without you having to do anything else! You also have the option to configure your own tests, that will run every single time you run a benchmark and send it to CyBench.

In this case, you are integrating CyBench into your CI/CD pipeline. You can specify the degree to what you will allow a performance drop in your benchmarks until CyBench runner halts, stopping your pipeline. You will be able to prevent code deployments with potentially critical impacts to your applications performance.

Prerequisites

• GitHub account/CyBench account
  • The CyBench website uses GitHub for authentication, and allows you to save private reports to the CyBench database. You're also granted a private workspace where your reports will be uploaded to, with the option of making reports public. Essentially, your GitHub account also becomes your CyBench account.
  • In order to setup automated performance regression testing, you must have a private workspace setup where your project's reports and comparison info will all be stored.