Current time: 08-07-2020, 05:50 AM Hello There, Guest! (LoginRegister)

Post Reply 
 
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
How to use WPT to evaluate builds when times vary on same code?
07-28-2012, 06:33 AM
Post: #2
RE: How to use WPT to evaluate builds when times vary on same code?
Looks like there are a couple of things going on:

1 - You have 3rd-party content on the page (analytics, twitter, facebook, ads). You will want to block all of those or stub them out. Granted, most of them load after onload so if you focus on the load time and not fully loaded it won't be as big of an issue.

2 - Dynatrace adds quite a bit of overhead and I wouldn't be surprised if it added some variability. You should try the same tests on the regular Dulles agents.

3 - Make sure you only look at "successful" tests (result of 0 or 99999). Some of the load time outliers were error runs.

4 - The page seems to behave quite differently with timing variations (sometimes the after-onload requests look like they are getting loaded before onload). If your lazy-load/async logic uses a timeout it could be introducing variability when it fires before onload.

5 - The TTFB seems to vary by ~100ms. Depending on how tight you're looking to get that could be a problem.

If you click the "plot full results" link below the data table you can see all of the metrics for all of the runs to see how they line up. You want to have ALL of the metrics consistent (requests and bytes are absolutely critical for starters).

A private instance will give you a little more control over things like the DNS time (you can hard-code the hosts file to eliminate it) and network variabilities but you need the page to be absolutely consistent between tests first.
Visit this user's website Find all posts by this user
Quote this message in a reply
Post Reply 


Messages In This Thread
RE: How to use WPT to evaluate builds when times vary on same code? - pmeenan - 07-28-2012 06:33 AM

Forum Jump:


User(s) browsing this thread: 1 Guest(s)