Item

Description

Column Headings

Status

A green tick means there are no Differences, a red tick means that Differences have been found, and a yellow warning symbol means the Test Run did not complete.

Date

Date that the Test Run was performed.

Time

Time that the Test Run was performed.

Host

The name of the machine where the Test was run (when the field is blank, this means that the host machine was used to make the Recordings).

Steps

The number of Steps in the Test.

Compares

The number of comparisons made between the Recordings and the actual PROIV Session.

Diffs

The number of Differences found in the comparisons.

Tag

An optional user-defined identifier for the Test Run. This can be applied to runs across many Tests and Suites, providing a way of linking them for reporting purposes.

Time Taken

The elapsed time between starting and ending the Test Run.

Operator

Operator who performed the Test Run.

Buttons

Details

Displays the Comparison Results window. This repeats the information in the History pane, but also provides a considerable amount of useful information about the Test Run results. It is a very important area in PROIV Assure as it enables you to view and handle Differences for a selected Recording and for all the Differences in a Test or Suite, you can also view the Difference Handlers for a selected Recording and change Difference Handling if required, and also investigate the details of any Unused Rules for the selected Recording.

Delete

Deletes the selected Test Run record.

Item

Description

Run Date

Displays the date when the Test or Suite was run.

Run Time

Displays the time when the Test or Suite was run.

Operator

Displays name of the Operator who ran the Test Run

Expected Steps

Displays the number of steps in the Recording.

Actual Steps

Displays the number of Steps in the Test Run. The expected and actual number of steps should match. If they do not match, then you should investigate why there is a disparity. It may be due to the Test Run failing to complete successfully, or that the navigation in the Test Run is data dependent and the values have changed, or Differences may have caused the Test Run to skip steps.

Comparisons

Displays the number of comparisons made between the actual PROIV Session and the Recording.

Tag

Freetext field which enables the entry of terms used to classify the Test Results. The Tag can then be selected in the Results Report window and a report for the results which match that Tag can printed off.

Unhandled Diffs

Displays the number of unhandled Differences encountered when the Test or Suite was run. The values reflect the handling when the Test Run was last run and they do not represent a cumulative total across multiple Test Runs.

Handled Diffs

Displays the number of Differences handled when the Test or Suite was run. The values reflect the handling when the Test Run was last run and they do not represent a cumulative total across multiple Test Runs.

Unused Rules

Displays the number of unused Saved Rules in the Test Run. Unused Saved Rules can occur in instances where an application under test is changed and the Saved Rule is no longer used.   

The values reflect the handling when the Test Run was last run and they do not represent a cumulative total across multiple Test Runs.

Fatal Error

Displays the fatal error information. The field is only displayed if the Test Run fails to complete. This is denoted with a yellow warning triangle against the Test Run.

Test Name

Displays the name of the Test where the Test Run failed. The field is only displayed if the Test Run fails to complete.

Recording

Displays the name of the Recording where the Test Run failed. The field is only displayed if the Test Run fails to complete.

Rec Step

Displays the Step in the Recording where the Test Run failed. The field is only displayed if the Test Run fails to complete.

Column Headings displayed when Contents is clicked

Recording

Displays the name of the Recording.

Run Status

Displays details about the status of Test or Suite Run. A green tick means there are no Differences, a red tick means that Differences have been found, and a yellow warning symbol means the Test Run did not complete.

Unhandled

Displays the number of unhandled Differences encountered when the Test or Suite was run. The values reflect the handling when the Test Run was last run and they do not represent a cumulative total across multiple Test Runs

Handled

Displays the number of Differences handled when the Test or Suite was run. The values reflect the handling when the Test Run was last run and they do not represent a cumulative total across multiple Test Runs.

Unused

Displays the number of unused Saved Rules in the Test Run. Unused Saved Rules can occur in instances where an application under test is changed and the Saved Rule is no longer used.   

The values reflect the handling when the Test Run was last run and they do not represent a cumulative total across multiple Test Runs.

Column Headings displayed when the Differences or All Differences is clicked

Run Step

Displays the Step number in the complete Test Run where the Difference was found.

Rec Step

Displays the Step number in the Recording where the Difference was found.

Test Name

Displays the Test Name in the Recording where the Difference was found.

Recording

Displays the Recording name where the Difference was found.

Comparison Difference

Displays the details of the Difference. The information displayed depends on the type of Difference that is found.

Run Step# Function Name

Displays the Function name that was running when the Difference was found. This information is not displayed for Report functions.

Run Step# Cycle Tag

Displays the Cycle Tag that was running when the Difference was found. This information is not displayed for Report functions.

Buttons

Differences

Click Differences to displays all of the Differences in the Test Run for the selected Recording. You can click the Contents to toggle back to the list of Recordings in the Test or Suite. Click here for more information and screenshots.

Contents

The Contents appears when the Differences has been clicked. It toggles back to the list of Recordings in the Test or Suite.  Click here for more information and screenshots.

All Diffs

Click All Diffs to display all of the Differences in the Test Run, not just the Differences in the selected Recording. Click here for more information and screenshots.

Handlers

Click Handlers to display the number of Differences handled when the Test or Suite was run. The values reflect the handling when the Test Run was last run and they do not represent a cumulative total across multiple Test Runs. Click here for more information and screenshots.

Unused Rules

Displays the number of unused Saved Rules in the Test Run. Unused Saved Rules can occur in instances where an application under test is changed and the Saved Rule is no longer used.   

The values reflect the handling when the Test Run was last run and they do not represent a cumulative total across multiple Test Runs.

Details

Click Details to display the Comparison Details window to handle the Differences. Click here for more information and screenshots.

View

The View appears when the Differences has been clicked. It displays a browser window, which provides a read-only view of the comparison between the Run Recording and the original Recording. This enables you to quickly identify the nature of the difference. Click here for more information and screenshots.

Unhandle All

Click Unhandle All to unhandle all of the Differences Handlers held against the Test Run. If the Recording is used in multiple Tests or Suites, then the handling is removed from them as well. This means that the next time you run the Test Run, the Differences are not handled and may be detected as Differences

This is useful if you want to remove the handling on variations in bulk. The status icons are removed against the Differences and you can choose to handle the Differences again if you require.

Connector

Click Connector to display the Connector Details window. You can amend the connection details if you require. Click here for more information about Connectors.

Comparators

Click Comparators to display the Unused Comparators for this run window, which lists the unused Comparators for the selected Test Run. Click here for more information about Comparators.

Exit

Click OK to close the Comparison Results window.

Item

Description

Test Name

Displays the name of the Test.

Recording

Displays the name of the Recording.

Function

Displays the name of the Function where the difference occurred.

Cycle

Displays the name of the Cycle where the difference occurred.

Difference

Displays the details of the Difference.

Options

Select an appropriate handling option from the radio group.

Unhandled

Select when you want to remove the handling on the Difference.

Ignore

Select to ignore the Difference, it is not reported regardless of the value.

RegEx

Select to use a Regular Expression to handle the Difference.

Saved Rule

Select a Saved Rule. Only appropriate rules that match the Difference are offered in the Rule drop-down list.

AdHoc Rule

Select to create an AdHoc Rule based on PROIV standards (for example, DATE, TIME etc.) and to generate a Regular Expression based on the selected rule.

Fields

Match to Regular Expression

Field appears when the RegEx handling option is selected. Enter a Regular Expression in the Match to Regular Expression field. This entry can be as restrictive or unrestrictive as you require. You could for example, set up a RegEx to allow a new value, but not allow the value in the original Recording.

A250 - Non-Mandatory

Saved Rule Regular Expression

Field appears when the Saved Rule handling option is selected. Select an appropriate Saved Rule from the Rule drop-down list.

AdHoc Rule Regular Expression

Field appears when the AdHoc Rule handling option is selected. Create an appropriate AdHoc Rule to handle the Difference.

Rule

Field appears when the Saved Rule handling option is selected. Select an appropriate Saved Rule to apply to the Difference. Only relevant rules which handle the Difference are displayed in the drop-down list.

Select one of the following rules from the drop-down list:

• Empty - detects the condition where the text is empty and contains no printable characters.

• DATE, DATE4, CDATE, TIME, AlphaPIC, NumericPIC, Numeric - for more information, refer to the PROIV Online Documentation, in particular Help Topic IDs: 520028, 520100, 520094, and 520018.

A32 - Non-Mandatory

Locale

Field appears when the AdHoc Rule handling option is selected, and the field is enabled when the DATE, DATE4 and CDATE rules are selected. You can select the date format for the rule based on one of these locales: Any, USA, Europe, or Japan.

Ignore Case

Field appears when the AdHoc Rule handling option is selected, and the field is enabled when the AlphaPIC rules is selected. Select the check box to ignore the case in the rule and accept upper case, lower case and mixed case.

Mask

Field appears when the AdHoc Rule handling option is selected, and the field is enabled when the CDATE, AlphaPIC, and NumericPIC rules are selected. Enter an appropriate mask to apply to the rule. For more information about masks, refer to the PROIV Online Documentation, in particular Help Topic IDs: 520028, 520100, 520094, and 520018.

A32 - Non-Mandatory

Test Rule

Button appears when Saved Rule or AdHoc Rule option is selected. Click Test Rule to test the rule. It must match both the actual and expected values, otherwise the Regular Expression will fail.

Test Regex

Button appears when Regex option is selected. Click Test Regex to test the Regular Expression. It must match both the actual and expected values, otherwise the Regular Expression will fail.

Buttons

Edit String

Click Edit String to display the Copy all or part of the difference string window. This enables you to copy the details of the Difference to the clipboard and then the contents can be pasted into a text editor such as Notepad, WordPad or Microsoft Word.

OK

Click OK to save the Difference Handling details. The Bulk Difference Handling window appears and you can choose to apply the rule to the other Differences by selecting one of the following options:

Regular Expression Bulk Handling Options

• All Identical Differences for this Run - applies the Regular Expression to all identical Differences against the Test/Suite Run. Click here to see a screenshot example of how this option is applied to identical Differences in a Run.

  

• All Differences Handled by Regular Expression for this Run - applies the Regular Expression to all the Differences that are handled by the Regular Expression against the Test/Suite Run. Click here to see a screenshot example of how this option is applied to Differences in a Run.

  

• All Identical Differences for this Recording - applies the Regular Expression to all identical Differences against the Recording. The screenshot is not included for this option as it works in the same way as the Run but is applied against the Recording only.

• All Differences Handled by Regular Expression for this Recording - applies the Regular Expression to all the Differences that are handled by the Regular Expression against the Recording. The screenshot is not included for this option as it works in the same way as the Run but is applied against the Recording only.

• Don't Apply to Other Differences - does not apply the handling in a bulk way, the handling only applies to the selected Difference.

Saved Rule Bulk Handling Options

• All Identical Differences for this Run - applies the Saved Rule to all identical Differences against the Test/Suite Run. Click here to see a screenshot example of how this option is applied to identical Differences in a Run.

  

• All Differences Handled by Saved Rule for this Run - applies the Saved Rule to all the Differences that are handled by the Regular Expression against the Test/Suite Run. Click here to see a screenshot example of how this option is applied to Differences in a Run.

  

• All Identical Differences for this Recording - applies the Regular Expression to all identical Differences against the Recording. The screenshot is not included for this option as it works in the same way as the Run but is applied against the Recording only.

• All Differences Handled by Saved Rule for this Recording - applies the Regular Expression to all the Differences that are handled by the Regular Expression against the Recording. The screenshot is not included for this option as it works in the same way as the Run but is applied against the Recording only.

• Don't Apply to Other Differences - does not apply the handling in a bulk way, the handling only applies to the selected Difference.

AdHoc Rule Bulk Handling Options

• All Identical Differences for this Run - applies the AdHoc Rule to all identical Differences against the Test/Suite Run. Click here to see a screenshot example of how this option is applied to identical Differences in a Run.

  

• All Differences Handled by AdHoc Rule for this Run - applies the AdHoc Rule to all the Differences that are handled by the AdHoc Rule against the Test/Suite Run. Click here to see a screenshot example of how this option is applied to Differences in a Run.

  

• All Identical Differences for this Recording - applies the AdHoc Rule to all identical Differences against the Recording. The screenshot is not included for this option as it works in the same way as the Run but is applied against the Recording only.

• All Differences Handled by Adhoc Rule for this Recording - applies the Regular Expression to all the Differences that are handled by the Regular Expression against the Recording. The screenshot is not included for this option as it works in the same way as the Run but is applied against the Recording only.

• Don't Apply to Other Differences - does not apply the handling in a bulk way, the handling only applies to the selected Difference.

Cancel

Click Cancel to cancel the Difference Handling process and to close the Comparison Details window.