Microsoft ADO Test Plan Integration



In Azure DevOps, manually running test cases for every release can quickly become repetitive and time-consuming. You might manage tests using test plans or create individual work items and execute them manually.

With this integration, you can automate those test cases in Leapwork, run them as often as needed, and easily analyze execution reports and results directly in ADO.

Import ADO test cases in Leapwork

Once ADO connection is created, we can import flows as part of test cases in Leapwork. 

1. Right click in the left window.

2. Select Import from ADO.

3. In the import window, select the ADO project you want to import test cases from.

4. Select an Area Path to filter the test cases within the selected project.

5. Click Import.
   Note: Only test cases marked as Planned in ADO, under the Automation Status field, will be imported.

5. Click OK.

6. On left, the test cases are created in project folder Leapwork-ado-sbx. Within the project folder, the structure is defined by the area in ADO.

6. Click to expand a project folder. The ADO imported test cases list appears. The test case filename includes testcase id and test case name.

Sync ADO test cases in Leapwork flow

Important: The option to sync ADO test cases is available starting from release 2024.1.486. If you are using an earlier release, this feature will not be available. Please ensure your Leapwork version is up to date to access this functionality.

When your project is ready to sync, you’ll see a banner at the top of the flows list.

1. Click Review button.

2. Select a project. All projects associated with the ADO sync appear.

1. Click Sync.
   Note: Only test cases marked as Planned or Automated in ADO, under the Automation Status field, will be synced.

2. Once the sync finishes, a confirmation pop-up window appears. Click Ok. 

Important notes when syncing

To bring in new test cases, use the Re-import option in Leapwork.

Import ADO test plan in Leapwork

1. In Run lists, right click.

2. Select Import from ADO.

2. Select a project. All the test plans related to that project appears. Each test plan is created based on the test suite and configuration.  

3. Select a test plan and click Import.
   Note: Only test points marked as Planned or Automated in ADO, under the Automation Status field, will be imported.

4. Click View Details. If there is no test case in a test plan, a message appears - Automated test cases are not available in ADO.
   The information displayed in the ADO Import pop-up window is dynamic based on the result of the importing process:

   • TC Successfully Imported: Imported all suitable test points successfully.

   • Automated TC Not Available: It displays the test cases not imported due to unavailability in ADO or Leapwork.

   • Collision: It displays scenarios where Leapwork already has manually created run lists or folders with the same names in the run list section.

4. Click OK. On the left, run list and configurations appears. Each run list has test cases that you imported in previous steps. Runlist is created on the basis of configuration (Windows 10/11).

5. Right click on a run list and select New schedule.

6. Enter title of the schedule and click Save. The new schedule is created on the left.

7. Right click on the new schedule.

8. Select Run Now.

Publish execution results on ADO

In ADO, you can verify that while execution, test run is in progress or completed as shown below.

1. In ADO, click refresh.

2. Click on a test run.

3. Click Run summary. On right in pie chart, you can see that the result shows that one test case passed and one failed.

4. Click Test Results. You can see that the result shows that one test case passed and one failed.
   Note: Once a test case is run, the status of that test case will be automatically change from Planned to Automate in ADO, under the Automation Status field.

5. Click Progress Report. You can analyze results based on test suits and available filters.

Create bugs from Leapwork to ADO

You can create bugs directly in Leapwork, these bugs will then be reflected in ADO.

1. In Leapwork, click Reporting.

2. Right click on a specific flow with Failure Status.

3. Select Create a bug in ADO.

1. On the Create a bug in ADO pop-up window:

2. Click Create.