soapui runner results not available in the statisics pane

Free for all.

soapui runner results not available in the statisics pane

Postby alibaba82 » 20 Oct 2011 01:25

Hello,
I have a simple test setup with 2 soapui runner and one webpage runner. During a load test, all the runners show that the test is running. However, only the webpage runner's results can be seen in the statistics panel. soapUI runner show no activity. Looks like a bug.

I am running this test locally.

Here is a screenshot taken during the test.
bug.JPG
bug.JPG (187.66 KiB) Viewed 2997 times
alibaba82
soapui pro users
soapui pro users
 
Posts: 875
Joined: 18 Apr 2007 23:00

Re: soapui runner results not available in the statisics pan

Postby kongar » 20 Oct 2011 15:12

I am facing the exact same problem. Does anyone know if previous versions of loadUI have the same problem? This seems like a pretty major bug as I can't get any meaningful statistics from using loadUI as a stress testing tool for web services.
kongar
User
 
Posts: 8
Joined: 16 Sep 2011 21:53

Re: soapui runner results not available in the statisics pan

Postby SmartBear Support » 20 Oct 2011 16:10

Hi,

We've had multiple reports of this recently. It's currently under investigation, I'll report back when I have some news!

Regards,
Dain
SmartBear Software
SmartBear Support
Administrator
Administrator
 
Posts: 6702
Joined: 16 Feb 2009 10:53

Re: soapui runner results not available in the statisics pan

Postby SmartBear Support » 20 Oct 2011 16:24

Hi,

Actually, it looks like the soapUI Runner is not getting executed correctly. As you can see from the screen shot, all the requests are being discarded. I'm not sure why this is though, it might be a bug in the soapUI Runner. Using the demo pro project included with soapUI, against the included MockService, I am unable to reproduce this (requests are completing normally).

Regards,
Dain
SmartBear Software
SmartBear Support
Administrator
Administrator
 
Posts: 6702
Joined: 16 Feb 2009 10:53

Re: soapui runner results not available in the statisics pan

Postby kongar » 20 Oct 2011 18:42

Sorry to hijack the thread but did you try retrieving the BPS statistic? I have the following project, and as you can see, I am not getting anything back.

LoadUI Project.jpg
LoadUI Project.jpg (269.19 KiB) Viewed 2975 times


Strangely enough, I can get TPS just fine. Here is the statistic report. Again note that BPS is 0.

Statistics.jpg
Statistics.jpg (81.1 KiB) Viewed 2975 times


Can you please try to recreate this? Thanks!
kongar
User
 
Posts: 8
Joined: 16 Sep 2011 21:53

Re: soapui runner results not available in the statisics pan

Postby alibaba82 » 21 Oct 2011 02:38

This is working now for me. Weird thing is I made no changes. Came back the next day and it just started to work. Maybe loadui needed some rest :)
alibaba82
soapui pro users
soapui pro users
 
Posts: 875
Joined: 18 Apr 2007 23:00

Re: soapui runner results not available in the statisics pan

Postby SmartBear Support » 21 Oct 2011 09:23

Hi,

Regarding BPS, it seems that the soapUI Runner does not expose the response size parameter needed to calculate the BPS statistic. This will be fixed in a coming version of loadUI!

Regards,
Dain
SmartBear Software
SmartBear Support
Administrator
Administrator
 
Posts: 6702
Joined: 16 Feb 2009 10:53

Re: soapui runner results not available in the statisics pan

Postby kongar » 21 Oct 2011 14:05

Thanks, Dain! I'm glad you were able to verify what I was seeing. Do you know when the next version will be coming out? It would be awesome if I can get BPS statistic with the load testing that I'm doing now but that's probably too much to hope for.
kongar
User
 
Posts: 8
Joined: 16 Sep 2011 21:53

Re: soapui runner results not available in the statisics pan

Postby SmartBear Support » 24 Oct 2011 08:50

Hi,

The next major version of loadUI isn't being released for a while, but I've included this fix in the maintenence branch, available in the latest nightly build. The BPS statistic should work now, please try it and be sure to either first uninstall your current installation of loadUI, or to install the nightly build into a separate directory (do not overwrite the existing one).

Regards,
Dain
SmartBear Software
SmartBear Support
Administrator
Administrator
 
Posts: 6702
Joined: 16 Feb 2009 10:53

Re: soapui runner results not available in the statisics pan

Postby kongar » 25 Oct 2011 14:55

Thanks for the help! I really appreciate it. I'll download and start using it for my stress testing.
kongar
User
 
Posts: 8
Joined: 16 Sep 2011 21:53


Return to LoadUI