WebPagetest Forums
The “HTTP Archive” format - Printable Version

+- WebPagetest Forums (https://www.webpagetest.org/forums)
+-- Forum: WebPagetest (/forumdisplay.php?fid=7)
+--- Forum: Feature Suggestions (/forumdisplay.php?fid=9)
+--- Thread: The “HTTP Archive” format (/showthread.php?tid=11998)

Pages: 1 2

The “HTTP Archive” format - viveksingh98 - 01-22-2013 01:51 AM

Hi Pat,

How can we download a waterfall directly using WPT ? Right now there is an option - "Export HTTP Archive (.har)" which is very much like what's available in chrome but the problem is its quite difficult to find an executable which opens this file format. Can we somehow download the waterfall Time graph in common format like jpg because I just don’t know whether it’s directly accessible via WPT?


RE: The “HTTP Archive” format - andydavies - 01-22-2013 08:18 AM

There is a HAR viewer - http://www.softwareishard.com/blog/har-viewer/ but generally we need some better tools for analysing and comparing HAR files

RE: The “HTTP Archive” format - viveksingh98 - 01-22-2013 07:42 PM

Can we somehow parse the HAR files and plot graphs of individual element response times ?

For instance if we want to see a trend of response times for each element and graph them individually, can this be achieved by parsing the HAR files ?

RE: The “HTTP Archive” format - pmeenan - 01-23-2013 02:26 AM

Not sure exactly what you are looking for. The png's for the waterfalls are readily available (the API also includes links for them) though it won't plot anything at an individual element level over time.

If you want to watch specific elements and plot them over time you would need to parse either the XML from Webpagetest or the HAR's and implement the plotting logic yourself.

RE: The “HTTP Archive” format - viveksingh98 - 01-23-2013 04:46 AM

You've got that right Pat. I would like to download data in XML format so that i can write a logic to plot the performance of each element over a period of time. The reason for this is, i would like to monitor the trend of each element and compare which element takes more time to load and hence ending up degrading the overall performance of the page (talking shear from the page load angle).
I'm not much familiar with HAR file format and i do not know how to parse it but i'm quite comfortable with XML.
Can you tell me where exactly can i get data in xml format using WPT?
And if its possible to implement what i'm thinking about??

RE: The “HTTP Archive” format - pmeenan - 01-23-2013 04:47 AM

Here are the docs (for what they are) on the API which includes the XML interface: https://sites.google.com/a/webpagetest.org/docs/advanced-features/webpagetest-restful-apis

RE: The “HTTP Archive” format - viveksingh98 - 01-23-2013 04:55 AM

Perfect! I'll go through these and revert if i have any more question. Thanks a ton for your help with this Pat!

RE: The “HTTP Archive” format - viveksingh98 - 01-23-2013 09:40 PM

The API converts the result summary page into XML tags but i don't see it translating the waterfall into xml.

For example - The page http://www.webpagetest.org/result/091111_2XFH/?r=12345 can be converted into xml like this:

but this page http://www.webpagetest.org/result/091111_2XFH/1/details/
cannot be converted in the similar way - http://www.webpagetest.org/xmlResult/091111_2XFH/1/details/.

I'm more concerned in converting the waterfall result into xml where i can get the load times of individual elements.

RE: The “HTTP Archive” format - pmeenan - 01-24-2013 03:18 AM

Sorry, try throwing a &requests=1 on the end of the XML request - that will get it to include the raw request data in the XML as well (not enabled by default because it's a fair bit slower). I'll make sure to add that to the docs:


RE: The “HTTP Archive” format - pmeenan - 01-24-2013 03:27 AM

Docs updated: https://sites.google.com/a/webpagetest.org/docs/advanced-features/webpagetest-restful-apis?pli=1#TOC-Getting-test-results

There are a few other parameters that also add more data to the XML responses.