WebPagetest Forums
Performance Metric Improvements July 22 - Printable Version

+- WebPagetest Forums (https://www.webpagetest.org/forums)
+-- Forum: WebPagetest (/forumdisplay.php?fid=7)
+--- Forum: General Discussion (/forumdisplay.php?fid=25)
+--- Thread: Performance Metric Improvements July 22 (/showthread.php?tid=16154)



Performance Metric Improvements July 22 - em_20 - 07-29-2020 11:31 PM

Hi all!

Does anyone know of any updates in WPT that were deployed around July 22nd?

I've been tracking performance metrics via the WPT API for the past few months. I noticed a sudden improvement (about ~60% improvement) on all perf metrics for all URLs I'm tracking on July 22nd.

There were no changes to the URLs I'm testing, in addition the captured asset sizes for tests after July 22nd have stayed static. so I'm not sure

This wasn't a fluke, because the metrics have stayed at this improved level on all tests since July 22nd (so there's a weeks worth of data now).

I'm testing with the following connection ec2-eu-west-3:Chrome.4G on an emulated MotoG4 phone.

Thanks!

Elisa


RE: Performance Metric Improvements July 22 - pmeenan - 07-30-2020 12:40 AM

Most likely this change: https://github.com/WPO-Foundation/wptagent/commit/f7fe0d6b5b01bd1b042a1fe3144c68a6bff846a6

The agents were changed from using OS-level CPU throttling to Chrome-based throttling when emulating mobile CPU's (to match Lighthouse and because there were reports of the OS throttling having unexpected overhead).


RE: Performance Metric Improvements July 22 - em_20 - 07-30-2020 01:25 AM

^ that explains it. Thanks for getting back to me so quickly!