Why Azure DevOps?

So far, a few systems for running Selenium tests in CI/CD environments have been used, among them Jenkins and Azure DevOps. Both are great for running Selenium tests using pipelines.

Advantages of using Jenkins

Jenkins is

• probably the most versatile, flexible and powerful for running automated tests;

• open source and free.

One could either use predefined jobs or write pipelines in Groovy.

Disadvantages of using Jenkins

Significant effort is needed for setting Jenkins up. First, Jenkins has to be installed, ideally on a dedicated computer. Then, the automation code has to be in a repository. Since Jenkins is only focused on the CI/CD process, you have to either use Github as a repository or install a local GIT server.

The automation code should be executed on multiple Jenkins agents, so additional hardware is needed. The agent machines also have to be configured to match your needs. Additionally, Docker has to be installed on the Jenkins agents if tests have to run in containers.

Finally, if in the future, it becomes important to map the automated tests to a test plan, since Jenkins does not have one, you will have to install a test case management system and then find a way of integrating the automated tests with the test plan.

Advantages of using Azure DevOps