MyBB Internal: One or more warnings occured. Please contact your administrator for assistance.
How to use WPT to evaluate builds when times vary on same code?
Current time: 09-23-2020, 04:36 AM Hello There, Guest! (LoginRegister)

Post Reply 
 
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
How to use WPT to evaluate builds when times vary on same code?
07-28-2012, 02:45 AM
Post: #1
How to use WPT to evaluate builds when times vary on same code?
Hiya

I hope this in the right forum. Apologies if not...

I'm hoping you might be able to help us...as we are becoming loyal WPT servants we are trying to use it in our QA process to ensure every single build is faster than the previous one.

However what we are finding is that we are getting such different results at different times on the same code that we cant rely on the comparisons against the new code. Is it really faster/slower?

We are wondering what to do? should we run our own instance of WPT? should we be using this differently? how do others ensure that every version of their code is faster than the previous one?

We use the filmstrip and record the average time that the page shows the main content:

Here's an example:

Old 1: http://www.webpagetest.org/result/120726_V4_KY3/ - average 1.86
New 1: http://www.webpagetest.org/result/120726_HD_DKR/ - average 2.17

Old 2: http://www.webpagetest.org/result/120727_3E_98J/ - average 2.47
New 2: http://www.webpagetest.org/result/120727_R0_C0N/ - average 1.88

Old 1 and Old 2 are identical code at different times, but with dramatically different results.

All advice very gratefully received Smile
Find all posts by this user
Quote this message in a reply
Post Reply 


Messages In This Thread
How to use WPT to evaluate builds when times vary on same code? - chrisn - 07-28-2012 02:45 AM

Forum Jump:


User(s) browsing this thread: 1 Guest(s)