Tests and Test Suite Overview

Tests are ordered collection of Recordings, which can be run by PROIV Assure. Similarly, Test Suites are ordered Tests, which can also be run. The running of Tests is the main purpose of PROIV Assure and is consequently the central function of the tool.

Note: Throughout the documentation, procedures refer to the running of Tests etc. The same information applies to the running of Test Suites. In the same way, information about Test Runs also applies to when Suites are run.

Test Runs

Running a Test actually moves through the collection of Recordings in order, performing the connection and logon processes to a live PROIV environment. Recordings are made up of Steps, which correspond to the state of the screen after a user interaction (e.g. hitting the RETURN or TAB keys) has occurred.

Note: The important difference between viewing a Test and running a Test is that running a Test drives a connection to a live PROIV Session. Viewing a Test simply replays the Recording without making a connection to a PROIV Session.

At each Step, a comparison is performed on every screen object between the Recording and the actual PROIV Session, and any differences are stored by PROIV Assure. The PROIV Function and Cycle Tag details are logged against the Difference (excluding Report functions).

Note: A single Difference can produce multiple logged results. For example, a difference in a field value is reported for each Step where it is visible.

A Recording can be configured not to make comparisons. This is useful for Recordings which log on to the PROIV Session, or when you want to reach a point in the application where you want the comparison process to begin, and do not want to make comparisons before that point.

Test Runs can fail to complete for a variety of reasons and the run will abort with the appropriate message. You can choose to display the current state of the Live Session in a browser window to help you understand what has happened at that point.

Test Run Results

When a Test Run has completed, a row is added to the History pane. Click here to view a screenshot of the History pane.

An icon appears at the start of the row, these icons mean:

Green tick

No unmanaged Differences have been reported.

Red cross

Unmanaged Differences have been reported. These are differences that have not been handled by PROIV Assure. Click here for more information about Difference Handling.

Yellow warning alarm

Run has failed to complete.

Test Connectors

Connection details contain all the information required to connect to a PROIV Live Session, they can be configured in a variety of permutations against Tests and Suites:

Click here to see a screenshot for further explanation.

Click here to see a screenshot for further explanation. The Connector Details window appears when you run a Test or Suite in this scenario. Click here to see a screenshot for further explanation.

Click here to see a screenshot for further explanation.

Test Comparisons

When a Test is run, a default set of comparisons are performed against the Recording and the PROIV Session. You can choose to turn off particular comparisons and save this set of comparators to a Saved Comparator Group. If a Saved Comparator Group is attached to a Test, it will override the default comparators. However, it is important to note that if a Recording in a Test is flagged not to compare, then this is obeyed and will take precedence over any group attached to the Test.

You can delete Test Run result sets individually from the Suites and Tests view, by using the Delete icon. In addition, you can delete results for a selection of Tests and Suites, or all the Tests and Suites, or for a range of Test Run dates by using the Deleting Test Run Results functionality in the Admin section.

Section links:

Tests View provides a description of the PROIV Assure Console with the Tests view enabled.

Test Results Overview provides a screenshot overview of how to view and handle Test results.

Adding a Test explains how to add a Test.

Adding a Recording to a Test describes how to add a Recording to a Test.

Adding a Recording to a Test Demo is a software simulation which shows how to add a Recording to a Test.

Deleting a Suite, Test or Recording explains how to delete a Suite, Test or Recording.

Removing a Recording from a Test explains how to remove a Recording from a Test.

Viewing a Recording describes how to view a Recording.

Running a Test explains how to run a Test or Suite.

Running and Viewing Tests provides an explanation of how to run and view and Tests and Suites.

Handling Differences in a Test Run explains how to handle any differences found as a result of a Test Run.

Baseline Overview explains how to use the Baseline functionality.

Comment on this topic

Topic ID: 780010