Merge pull request #3970 from TimShererWithAquent/us1876202a

Test different configurations [UPDATE]

Author: laurabren

docs/test/media/testing-configurations/add-values-configuration-variable.png

@@ -1,6 +1,6 @@
 ---
 title: Test different configurations
-description: Manual and exploratory testing - test different configurations with Azure DevOps and Team Foundation Server (TFS)
+description: Learn about manual and exploratory testing. You can test different configurations with Azure Test Plans and Team Foundation Server.
 ms.assetid: 750F033E-A39E-4C85-BF85-012629C33DE6
 ms.technology: devops-test
 ms.topic: conceptual
@@ -42,6 +42,45 @@ Then you can:
 <a name="create-configs"></a>
 
 ## Create configurations and variables
+::: moniker range=">=azure-devops-2020"
+
+A test configuration is a combination of configuration variable values.
+Your configuration variables could be, for example, operating system, browser, CPU type, database.
+A configuration might be "Windows 8 + 32-bit CPU" or "Windows 10 + 64-bit CPU."
+
+Create the configuration variables first.
+Then combine multiple variable values to create a configuration.
+
+1. Open the **Configurations** page in the **Test Plans** web portal, select the **+** icon, and select **New configuration variable**.
+
+   ![Screenshot shows the New configuration variable option in New menu.](media/testing-configurations/new-configuration-variable.png)
+
+1. Type a name for the variable, such as **Browser**, and a description.
+   Select **Add new value**, and then add a value.
+   Add as many values as you wish to the configuration variable, and then save it.
+
+   ![Screenshot shows adding values to a new configuration variable.](media/testing-configurations/add-values-configuration-variable.png)
+
+1. Repeat the steps to create any other configuration variables you need.
+   For example, create a configuration variable named **Operating system** with the names of each operating system on which you want to test.
+
+   ![Screenshot shows setting the values for an Operating Systems configuration variable.](media/testing-configurations/operating-system-configuration.png)
+
+1. Select the **+** icon and select  **New test configuration**.
+
+   ![Screenshot shows the New test configuration option in the New menu.](media/testing-configurations/new-test-configuration.png)
+
+1. Type a name for the test configuration and add the configuration variables you created.
+   Choose a value for each variable for this configuration.  
+
+   ![Screenshot shows adding variables to the new test configuration.](media/testing-configurations/add-variables-testing-configuration.png)
+
+   Be sure that **Assign to new test plans** is checked to make this configuration the default for all the new test plans you create.
+
+1. Save your new test configuration.
+::: moniker-end
+
+::: moniker range="<=azure-devops-2019"
 
 A test configuration is a combination of configuration variable 
 values. Your configuration variables could be, for example, 
@@ -82,9 +121,35 @@ multiple variable values to create a configuration.
    configuration for all the new test plans you create.
 
 6. Save your new test configuration. 
+::: moniker-end
 
 <a name="assign-configs"></a>
+
 ## Assign configurations to test plans and suites
+::: moniker range=">=azure-devops-2020"
+
+You can assign configurations to a test suite or an individual test case.
+Configurations assigned to a test suite apply to all tests or suites within it.
+
+1. To assign a configuration to a test suite, in the **Test plans** page, select a plan.
+   In the **Test Suites** area, select a test suite and select **More options** or right-click to open the context menu and then select **Assign configuration**.
+
+   ![Screenshot shows Assign configuration menu option.](media/testing-configurations/assign-configuration-menu-option.png)
+
+   If you add multiple configurations to a test suite, the tests cases are repeated with each of the configurations you have assigned.
+
+   ![Screenshot shows multiple configuration assignment to a test suite.](media/testing-configurations/multiple-configuration-test-suite.png)
+
+1. If necessary, override the default configuration assigned to a test case and assign the configuration you need.
+   Select one or more test cases, open the context menu, and select **Assign configuration**.
+
+   ![Screenshot shows assigning a configuration assigned to a test case.](media/testing-configurations/assign-configuration-test-cases.png)
+
+1. Search for and select the configurations to assign to the test cases.
+
+   ![Screenshot shows setting configurations for a test case.](media/testing-configurations/select-configuration-test-case.png)
+::: moniker-end
+::: moniker range="<=azure-devops-2019"
 
 You can assign configurations to a test plan, a test suite,
 or an individual test case. Configurations assigned to a test plan 
@@ -101,7 +166,7 @@ or test suite apply to all tests or suites within it.
    ![Assigning a configuration to a test suite](media/testing-configurations/testing-configurations-04.png)
 
    If you add multiple configurations to a test plan or suite, 
-   the tests cases are repeated in the plan or suite with the 
+   the tests cases are repeated in the plan or suite with
    each of the configurations you have assigned.
 
    ![Multiple configuration assignment to a test suite](media/testing-configurations/testing-configurations-05.png)
@@ -115,9 +180,25 @@ or test suite apply to all tests or suites within it.
 1. Search for and select the configurations to assign to these test case(s).
 
    ![Setting the required configurations for a test case](media/testing-configurations/testing-configurations-07.png)
+::: moniker-end
 
 <a name="run-configs"></a>
+
 ## Run tests with each configuration
+::: moniker range=">=azure-devops-2020"
+
+Set up a testing platform for a particular configuration, such as testing the app using Google Chrome on Windows 10.
+
+1. Select and run a test that has this configuration assigned.
+
+   ![Screenshot shows a test with a specific configuration and the Run for web application option selected.](media/testing-configurations/run-test-configuration.png)
+
+   As you run the test, a reminder of the configuration appears in the status bar.
+
+   ![Screenshot shows the configuration for this test in the status bar.](media/testing-configurations/configuration-status-bar.png)
+::: moniker-end
+
+::: moniker range="<=azure-devops-2019"
 
 1. Set up a testing platform for a particular configuration, such
    as testing the app using Google Chrome on Windows 10.
@@ -130,9 +211,31 @@ or test suite apply to all tests or suites within it.
    in shown in the status bar of the Test Runner window.
 
    ![The required configuration appears in the Test Runner window](media/testing-configurations/testing-configurations-08.png)
+::: moniker-end
 
 <a name="track-configs"></a>
+
 ## Track test results for each configuration
+::: moniker range=">=azure-devops-2020"
+
+1. Open the **Charts** page for your test suite, select **New**, and select **New test result chart**.
+
+   ![Screenshot shows the New test result chart menu option.](media/testing-configurations/new-test-case-chart-option.png)
+
+1. Choose a type of chart, like a pie chart or bar chart, and then select **Group by** > **Configuration** and choose **OK**.
+
+   ![Screenshot shows choosing a configuration option for group by in the configure chart dialog box.](media/testing-configurations/select-configuration-chart.png)
+
+   A chart is created that can help you track your tests based on configurations.
+   You can pin this chart to your dashboard.
+
+   ![Screenshot shows a bar chart with values for Not run, Passed, and Failed.](media/testing-configurations/configuration-result-chart.png)
+
+If you have a test case that appears in several test suites, you can set the different configurations for each suite.
+The same test case can have different configuration settings in different test suites and test plans.
+::: moniker-end
+
+::: moniker range="<=azure-devops-2019"
 
 1. Open the **Charts** page for your test plan or test suite, choose 
    **New**, and select **New test result chart**.
@@ -151,6 +254,7 @@ or test suite apply to all tests or suites within it.
 
 > If you have a test case that appears in several test plans and test suites, you can set the different configurations for each of these. 
 The same test case can have different configuration settings in different test suites and test plans.
+::: moniker-end
 
 ## Related articles