Using Regression Testing in irVerify

Create regression tests in irVerify

1. Select the Create Test button on the ribbon bar.
    
   
   
2. Select what kind of test you want to create.
   
   
   
   • 1. Assertion Testing - In assertion testing, the user builds criteria that must be true for a test to pass. When run, assertion test data is compared for each assertion and a pass or fail status is assigned accordingly.  This use case is somewhat limited, especially if you have a large entity structure because you will need to create assertions one by one, which can be a bit laborious. We recommend using this for confirming a small amount of data points.
   • 2. Comparison Testing - In comparison testing, the user defines a test scenario that represents the desired outcome of testing. The user also specifies an input test scenario that irVerify compares to the desired outcome. If there are any differences between the expected scenario and the actual scenario, the test fails. In this method, assertion tests are automatically created to compare the expected state of the entity and its data against the test data when the rules are run.
   • 3. Performance Testing - In performance testing, the user defines how many times to run a test, along with an input test scenario and execution parameters. The test reports performance results.
     
     
3.  After selecting an option, it will ask you to select a test case.
   
   
   For Assertion Tests and Performance Tests
   Under Input data state, provide either a Test Scenario or an Entity Data State (an XML or JSON file containing your test data) for these tests. The data should represent the state before the rules have been applied.
   
   
   
   For Comparison Tests
   You need to select two data states:
   Input data state: Provide the state from before the rules have been applied
   Expected data state: Provide the state that was saved after the rules had been run.
   
   
   
   
4. The next screen that appears is your Test Suite.  Multiple tests can be saved in a Test Suite and in any combination of Assertion, Comparison, and Performance Tests.
   
   
   1. Run All Select this option to run Multiple tests at the same time. 
   2. Run - Click here to run a test. 
   3. Execution type - By default, the Test Suite will run by the Apply Rules directive. If you're using an explicit execution model, you can change that to Entity Ruleset and select the Controller ruleset in the Entity rule set field (4).
   5. New and Edit - Use these options to modify or replace your Input Data States and/or your Output Data States.
   6. Test Runner - Your test will appear in the test runner windows at the bottom of the test suite. Test suites can also be saved and reloaded for later use.