WebPagetest Forums
How to statistically compare 2 tests? - Printable Version

+- WebPagetest Forums (https://www.webpagetest.org/forums)
+-- Forum: Web Performance (/forumdisplay.php?fid=3)
+--- Forum: Testing Tools/Services (/forumdisplay.php?fid=6)
+--- Thread: How to statistically compare 2 tests? (/showthread.php?tid=14906)



How to statistically compare 2 tests? - mertens - 05-24-2017 09:26 PM

I have 2 domains with identical content and server, but a different networking setup (Cloudflare Argo, for those who are curious). I would like to statistically compare the 2 to decide if there is a statistically significant difference between the performance of both sites.

When I click "Plot Full Results" on the summary tab, I see "Statistical Comparison Against". But I can only select the test itself to compare to, not others tests that I have previously run.

Is there a way to compare 2 different test results?

Thank you in advance!


RE: How to statistically compare 2 tests? - pmeenan - 05-25-2017 03:51 AM

The plot page takes a comma-delimited list of test IDs like the filmstrip view for comparing (allows for labeling with -l:blah too).