Current time: 11-19-2019, 10:56 AM Hello There, Guest! (LoginRegister)

Poll: What would you like to see implemented next?
Compare multiple tests against each other
Zoom in on waterfall
Simpler optimization results
Custom Headers and Cookies
Commenting on tests
Add more optimization checks
Improve the documentation
Something else (comment below)
[Show Results]
Note: This is a public poll, other users will be able to see what you voted for.
Post Reply 
 
Thread Rating:
  • 1 Vote(s) - 4 Average
  • 1
  • 2
  • 3
  • 4
  • 5
What do you want to see next?
03-27-2013, 12:22 AM
Post: #70
RE: What do you want to see next?
(03-26-2013 09:37 AM)echorink Wrote:  Great work. Some suggestions on the stat's:

1. With multiple runs, the main results page states:
"Performance Results (Median Run)"
The results appear (?) to be arithmetic means, not median values. Perhaps change the title?

The results are the values from the run that had the median load time (floor() in the case of an even number of tests). It isn't the median for each value independently.

Quote:2. I see that there is an attempt to select one of the (10) test results that represents the "mean", but how is this determined? On what result (or aggregation) is this result selected? Perhaps provide a doc explaining the method?

It picks the median from the load time (though you can modify the metric used through a query param if you want). It gets a little less "correct" in the case of an even number of runs in which case it picks the run that is on the faster side of the technical median.

Quote:3. If "Visually Complete" is available across all runs, promote that up to this summary...averaged.

4. For the timings, it would be nice to get further statistics here, though I'm not sure how to determine these, or what type of distributions these all are. For example:
- mean, median, std. dev, variance, etc...conformant to the expected distribution. For last mile, all things being equal, distributions are relatively 'normal' due to the wide range of independent variables. The problem, though, is that 10 trials is probably insufficient to overcome the variance...erg.

If you access it through the XML or json api then you get averages and standard deviations for all of the metrics.

Quote:5. For the 'static values' (bytes, request #, Dom Elements), it might be nice to get a range.

Below the table you can click "plot full results" which will plot out all of the metrics across all of the runs. Not quite the same but it gives you a quick way to check the variability.
Visit this user's website Find all posts by this user
Quote this message in a reply
Post Reply 


Messages In This Thread
What do you want to see next? - pmeenan - 07-15-2009, 08:08 AM
RE: What do you want to see next? - gobezu - 07-15-2009, 02:00 PM
RE: What do you want to see next? - p83822 - 12-11-2009, 06:47 PM
RE: What do you want to see next? - p83822 - 12-12-2009, 01:00 AM
RE: What do you want to see next? - p83822 - 03-11-2010, 07:22 AM
RE: What do you want to see next? - grep - 04-09-2010, 05:25 PM
RE: What do you want to see next? - ruddh - 06-15-2010, 07:07 AM
RE: What do you want to see next? - ruddh - 06-15-2010, 11:13 PM
RE: What do you want to see next? - p83822 - 06-17-2010, 03:50 PM
RE: What do you want to see next? - Geebee - 01-04-2011, 04:31 AM
RE: What do you want to see next? - vincej - 02-14-2012, 02:27 PM
RE: What do you want to see next? - ME512 - 03-10-2012, 05:29 AM
RE: What do you want to see next? - pganti - 03-08-2013, 08:58 AM
RE: What do you want to see next? - vovone - 03-19-2013, 03:14 AM
RE: What do you want to see next? - pmeenan - 03-27-2013 12:22 AM
RE: What do you want to see next? - hal - 10-02-2013, 06:07 AM
RE: What do you want to see next? - pganti - 04-18-2014, 04:17 AM
RE: What do you want to see next? - pruel - 08-12-2015, 04:04 AM
RE: What do you want to see next? - aurora - 01-20-2016, 07:48 PM
RE: What do you want to see next? - auduny - 01-13-2017, 05:51 PM
RE: What do you want to see next? - samear - 09-02-2017, 09:11 AM
RE: What do you want to see next? - pmeyer - 09-22-2017, 10:38 AM

Forum Jump:


User(s) browsing this thread: 4 Guest(s)