Blog Posts Business Management

Continuous Performance Testing is a necessity in the world of DevOps

Blog: NASSCOM Official Blog

In the past, performance testing used to be an option in the software testing process. It was something that you did only when you had spare time and when you felt like. Today, performance testing is more important than ever. It is compulsory.

App users expect more from apps today. The competition is high, and you are competing against others who are not even in your industry. Your apps will be held to the same standards as that of those in other industries. A lot of software are now being supported by third-party components that are deployed over the cloud.

Apart from performance testing, there is now a need for fast, agile developmental process. You must anticipate and respond quickly to the needs of your customers. You must have a faster time to market to beat your competitors.

DevOps is the latest approach to development lifecycle. DevOps involves the use of modern techniques like continuous deployment and continuous integration. DevOps requires automated development, deployment and testing. Every process of the development lifecycle involves some form of automation or the other.

With new techniques that allows for rapid test creation and automation, continuous testing is now possible. Thanks to DevOps, testing can now be completed within hours with no glitch in performance, as opposed to what used to take weeks to accomplish.

Testing is now a fundamental part of the application lifecycle. At the initial development stages, new approaches can be used based on test-driven development. During the integration process, most or even all of the required tests are automated with the use of functional testing solutions. During preproduction, performance and acceptance tests make up the quality assurance phase.

Performance testing is now a compulsory function to ensure that apps can scale reliably and rapidly. It is no longer an optional thing.

DevOps involves the use of continuous performance testing to vastly improve the software development and deployment process.

Why Performance Testing is Needed

Here are the reasons why performance testing is needed:


Reasons Why Load/Stress Testing is Used

Load & stress testing is performed on platforms and applications for the following reasons:

Continuous performance testing involves the deployment and development of low-volume load tests to monitor the performance metrics of API end points, database queries and critical application user flows of systems without over stressing them. Continuous performance tests are continuously deployed to perform check-ins in a DevOps CD/CI pipeline. The tests are scheduled for execution on a daily basis in a production environment or a similar test environment.

Steps for Continuous Testing

Here are three steps that should be taken for operational engineers and developers to kill off old practices and achieve the needed DevOps results.

1) Put DevOps Best Practices in Place

Basic DevOps best practices should begin. All performance and quality assurance teams should be reorganized together under operations. All operation team members should be embedded within the development teams. Operation engineers should begin active partnering by enhancing feedback loops to developers through the use of stories in the backlog for performance issues. Ops engineers should also participate in sprint retros and scrums.

Op engineers should also become skilled at automation by carrying out the isolation, replication and description of environmental variables causing problems. They must also ensure that test harnesses continue to improve. This ensures the efficiency of the product pipeline and all product managers, tech leads, developers and QA engineers gain more insights on what is happening at every stage up to final production.

2) Break up Your Tests

If tests are too large, they should be broken up. You should split your tests into components and run as many tests as you can within 30 minutes to one hour. This should be conducted at the API level so even if you are testing different services at the same time, the services are still independent of each other. Each test should have a goal and should provide specific answers to what-if scenarios.

3) Replace Downstream Services with Mocks

Where possible, replace downstream services with mocks. By doing this, you can easily test different what-if scenarios for dependent services without having to rely on the services to be stable.

As you continue to repeat runs of smaller tests and perform fast, real-time feedback to developers, you will get to the point where you can quickly and easily form hypothesis about how code can be improved and make the improvements quickly. Then, you get into a more Lean-Agile state, where you will be fully equipped to multiply the number of hypotheses that you are trying to derive answers for at any given period of time.


The post Continuous Performance Testing is a necessity in the world of DevOps appeared first on NASSCOM Community |The Official Community of Indian IT Industry.

Leave a Comment

Get the BPI Web Feed

Using the HTML code below, you can display this Business Process Incubator page content with the current filter and sorting inside your web site for FREE.

Copy/Paste this code in your website html code:

<iframe src="" frameborder="0" scrolling="auto" width="100%" height="700">

Customizing your BPI Web Feed

You can click on the Get the BPI Web Feed link on any of our page to create the best possible feed for your site. Here are a few tips to customize your BPI Web Feed.

Customizing the Content Filter
On any page, you can add filter criteria using the MORE FILTERS interface:

Customizing the Content Filter

Customizing the Content Sorting
Clicking on the sorting options will also change the way your BPI Web Feed will be ordered on your site:

Get the BPI Web Feed

Some integration examples