Optimal Number of Test Runs

12042012, 04:48 AM
Post: #3




RE: Optimal Number of Test Runs
Yeah, > 1 is absolutely critical if you are looking at the times. If you are just looking at how the page is constructed (requests, waterfall, caching, etc) then 1 works ok for a quick snapshot.
I usually do 9 instead of 10 because the times are from the median run and median makes more sense for an odd number of samples. Depending on the page, even 9 may not be enough. If you click on the "plot full results" link below the data table you can see what the distribution of the times looks like for all of the runs and where the median run times were. Eyeballing that should give you better confidence if you are looking at a representative result or a page that has wildly variable performance. 

« Next Oldest  Next Newest »

Messages In This Thread 
Optimal Number of Test Runs  rviscomi  12012012, 07:34 AM
RE: Optimal Number of Test Runs  rviscomi  12042012, 02:38 AM
RE: Optimal Number of Test Runs  pmeenan  12042012 04:48 AM
RE: Optimal Number of Test Runs  rviscomi  12042012, 05:27 AM
RE: Optimal Number of Test Runs  pmeenan  12042012, 05:29 AM
RE: Optimal Number of Test Runs  JasonHofmann  12042012, 10:26 AM
RE: Optimal Number of Test Runs  pmeenan  12112012, 07:10 AM
RE: Optimal Number of Test Runs  JasonHofmann  12112012, 08:00 AM
RE: Optimal Number of Test Runs  pmeenan  12112012, 10:47 AM

User(s) browsing this thread: 1 Guest(s)