Assertion

LoadTest Assertions

icon-options-dialog LoadTest Max Errors Assertion

Max_Errors_Assertion_Dialog

The Max Errors Assertion checks that the total number of errors for a specified TestStep does not exceed a specified value. It has the following settings:

Option Description
Name Name of the assertion
Max Absolute Errors Absolute maximum allowed number of errors for the specified TestStep
Max Relative Errors Relative maximum allowed number of errors for the specified TestStep, for example 0.2 will assert that at most 20% of the runs for the specified TestStep result in an error
TestStep Target step to assert. Selecting "- Any -" will assert all steps, selecting "- Total -" will assert the total number of errors for the entire TestCase run

icon-options-dialog LoadTest Step Average Assertion

TestStep_Average_Assertion_Dialog

The Step Average Assertion checks that a steps average does not go over a specified value. It has the following settings:

Option Description
Name Name of the assertion
Minmum Requests Minimum number of runs that must have been executed before applying this assertion. Use this for avoiding assertion errors during start up of a LoadTest
Max Average Maximum allowed average. If the actual average is higher, an assertion error is logged to the LoadTest log
Max Errors Maximum number of errors to allow before cancelling the LoadTest
Sample Interval Sample interval
TestStep Target step to assert. Selecting "- Any -" will assert all steps, selecting "- Total -" will assert the total average for the entire TestCase run

icon-options-dialog LoadTest Step TPS Assertion

TestStep_Average_Assertion_Dialog

The Step TPS Assertion checks that a steps TPS does not go below a specified value. It has the following settings:

Option Description
Name Name of the assertion
Minimum Requests Minimum number of runs that must have been executed before applying this assertion. Use this for avoiding assertion errors during start up of a LoadTest
Minimum TPS Minimum required TPS. If the actual TPS is lower, an assertion error is logged to the LoadTest log
Max Errors Maximum number of errors to allow before cancelling the LoadTest
TestStep Target step to assert. Selecting "- Any -" will assert all steps, selecting "- Total -" will assert the total TPS for the entire TestCase run

icon-options-dialog LoadTest Step Maximum Assertion

Max_Errors_Assertion_Dialog

The Step Maximum assertion checks that a steps max time does not exceed a specified value. It has the following settings:

Option Description
Name Name of the assertion
Minimum Requests Minimum number of runs that must have been executed before applying this assertion. Use this for avoiding assertion errors during startup of a LoadTest
Max Time Maximum allowed step time. If this time is exceeded, an assertion error is logged to the LoadTest log
Max Errors Maximum number of errors to allow before cancelling the LoadTest
TestStep Target step to assert. Selecting "- Any -" will assert all steps, selecting "- Total -" will assert the total time taken for the entire TestCase run

icon-options-dialog LoadTest Step Status Assertion

TestStep_TPS_Assertion_Dialog

The Step Status Assertion checks that a step has not failed with an error, for example a Request steps or a Groovy script step. It has the following settings:

Option Description
Name Name of the assertion
Minimum Requests Minimum number of runs that must have been executed before applying this assertion. Use this for avoiding assertion errors during start up of a LoadTest
Max Errors Maximum number of errors to allow before cancelling the LoadTest
TestStep Target step to assert. Selecting "- Any -" will assert all steps