The included loadtestrunner.bat/.sh file (available in the /bin folder) can be used to run LoadTests from the command line which can be used for surveillance testing and maximizing local testing. The runner will run each specified LoadTest in turn, but be careful not to run LoadTests with an indefinite test limit.

The following arguments are available:

  • e : The endpoint to use when invoking test requests, overrides the endpoint set in the project file
  • h : The host:port to use when invoking test requests, overrides only the host part of the endpoint set in the project file
  • s : The TestSuite to run, used to narrow down the tests to run
  • c : The TestCase to run, used to narrow down the tests to run
  • l : The LoadTest to run, used to narrow down which LoadTests to run
  • m : Overrides the limit value set for the specified LoadTest(s)
  • n : Overrides the thread-count value set for the specified LoadTest(s)
  • u : The username to use in any authentications, overrides any username set for any TestRequests
  • p : The password to use in any authentications, overrides any password set for any TestRequests
  • d : The domain to use in any authentications, overrides any domain set for any TestRequests
  • r : Turns on exporting of a LoadTest statistics summary report (see below)
  • f : Specifies the root folder to which test results should be exported (see below)
  • w : Sets the WSS password type, either Text or Digest
  • t : Sets the soapui-settings.xml file to use, required if you have custom proxy, ssl, http, etc settingx : Sets project password for decryption if project is encrypted
  • x : Sets project password for decryption if project is encrypted
  • v : Sets password for soapui-settings.xml file
  • D : Sets system property with name=value
  • G : Sets global property with name=value
  • P : Sets project property with name=value
  • S : Saves the project after running the tests
  • R : Selects which report to generate for the executed LoadTest(s), the report is saved as specified with the -F option to the folder specified with the -f option. (ReadyAPI only)
  • F : Sets the format of the report specified with the -R option, for Printable reports this is one of PDF, XLS, HTML, RTF, CSV, TXT, and XML. Note: to specify multiple report formats in the same command use this syntax "-FPDF -FHTML" without the quotes. For Data Export this is either XML or CSV (ReadyAPI only)
  • o : Opens the generated report in a browser (ReadyAPI only)
  • E : Sets which environment to use (ReadyAPI only)

So for example running

loadtestrunner.bat -ehttp://localhost:8080/services/MyService c:\projects\my-soapui-project.xml

will run all the LoadTests defined in the my-soapui-project.xml file against the specified service-endpoint.

Running large number of threads

See the article Threads for information about running more than 200 threads.

TestEngine: An Optimized Test Runner

Execute tests from SoupUI Open Source or SoupUI Pro in parallel to speed up your API Testing.

  • Scale Based on Your Business Needs:

    Dynamically run larger regression tests alongside smaller tests with custom configuration parameters.

  • Job Queuing:

    Execute tests as they arrive, staggering test runs and avoiding bottlenecks at peak times.

  • Supports Multiple Environments:

    Use TestEngine on Docker, VMS, Mac, Windows or Linux.