WebPageTest

sajal · 10-12-2010, 03:12 AM

http://dl.dropbox.com/u/361747/WebPagetest1.png - summary of 5 runs

http://dl.dropbox.com/u/361747/WebPagetest2.png - first run first view

Happened from a VPS in Thailand. Saw same issues when running from an ec2 instance in Singapore.

The server hosting the web portion is in the states about 300ms away from test sites.

Any clues on why this happens?

Viewing it via HTTP API shows this

Code:

<?xml version="1.0" encoding="UTF-8"?>

<response>

<statusCode>200</statusCode>

<statusText>Ok</statusText>

<data>

<runs>5</runs>

<average>

<firstView>

<loadTime>9929</loadTime>

<TTFB>724</TTFB>

<bytesIn>966750</bytesIn>

<bytesInDoc>966750</bytesInDoc>

<requests>241</requests>

<requestsDoc>241</requestsDoc>

<render>2545</render>

<fullyLoaded>9982</fullyLoaded>

<docTime>9929</docTime>

<domTime>0</domTime>

<avgRun>3</avgRun>

</firstView>

<repeatView>

<loadTime>6704</loadTime>

<TTFB>472</TTFB>

<bytesIn>393141</bytesIn>

<bytesInDoc>393141</bytesInDoc>

<requests>48</requests>

<requestsDoc>48</requestsDoc>

<render>1226</render>

<fullyLoaded>6748</fullyLoaded>

<docTime>6704</docTime>

<domTime>0</domTime>

<avgRun>1</avgRun>

</repeatView>

</average>

<run>

<id>1</id>

<repeatView>

<results>

<URL>http://www.sanook.com/</URL>

<loadTime>6790</loadTime>

<TTFB>344</TTFB>

<bytesOut>19762</bytesOut>

<bytesOutDoc>19762</bytesOutDoc>

<bytesIn>411406</bytesIn>

<bytesInDoc>411406</bytesInDoc>

<requests>49</requests>

<requestsDoc>49</requestsDoc>

<result>0</result>

<render>1107</render>

<fullyLoaded>6790</fullyLoaded>

<cached>1</cached>

<web>1</web>

<docTime>6790</docTime>

<domTime>0</domTime>

<score_cache>90</score_cache>

<score_cdn>13</score_cdn>

<score_gzip>94</score_gzip>

<score_cookies>94</score_cookies>

<score_keep-alive>34</score_keep-alive>

<score_minify>100</score_minify>

<score_combine>100</score_combine>

<score_compress>100</score_compress>

<score_etags>97</score_etags>

<date>1286858795</date>

</results>

<pages>

<details>http://xxxxxxxxxxxxxxxxxxxxx/result/101011_TB/1/details/cached/</details>

<checklist>http://xxxxxxxxxxxxxxxxxxxxx/result/101011_TB/1/performance_optimization/cached/</checklist>

<report>http://xxxxxxxxxxxxxxxxxxxxx/result/101011_TB/1/optimization_report/cached/</report>

<breakdown>http://xxxxxxxxxxxxxxxxxxxxx/result/101011_TB/1/breakdown/</breakdown>

<domains>http://xxxxxxxxxxxxxxxxxxxxx/result/101011_TB/1/domains/</domains>

<screenShot>http://xxxxxxxxxxxxxxxxxxxxx/result/101011_TB/1/screen_shot/cached/</screenShot>

</pages>

<thumbnails>

<waterfall>http://xxxxxxxxxxxxxxxxxxxxx/result/101011_TB/1_Cached_waterfall_thumb.png</waterfall>

<checklist>http://xxxxxxxxxxxxxxxxxxxxx/result/101011_TB/1_Cached_optimization_thumb.png</checklist>

<screenShot>http://xxxxxxxxxxxxxxxxxxxxx/result/101011_TB/1_Cached_screen_thumb.jpg</screenShot>

</thumbnails>

<images>

<waterfall>http://xxxxxxxxxxxxxxxxxxxxx/results/10/10/11/TB/1_Cached_waterfall.png</waterfall>

<checklist>http://xxxxxxxxxxxxxxxxxxxxx/results/10/10/11/TB/1_Cached_optimization.png</checklist>

<screenShot>http://xxxxxxxxxxxxxxxxxxxxx/results/10/10/11/TB/1_Cached_screen.jpg</screenShot>

</images>

<rawData>

<headers>http://xxxxxxxxxxxxxxxxxxxxx/results/10/10/11/TB/1_Cached_report.txt</headers>

<pageData>http://xxxxxxxxxxxxxxxxxxxxx/results/10/10/11/TB/1_Cached_IEWPG.txt</pageData>

<requestsData>http://xxxxxxxxxxxxxxxxxxxxx/results/10/10/11/TB/1_Cached_IEWTR.txt</requestsData>

<utilization>http://xxxxxxxxxxxxxxxxxxxxx/results/10/10/11/TB/1_Cached_progress.csv</utilization>

</rawData>

</repeatView>

</run>

<run>

<id>2</id>

<repeatView>

<results>

<URL>http://www.sanook.com/</URL>

<loadTime>5924</loadTime>

<TTFB>963</TTFB>

<bytesOut>19138</bytesOut>

<bytesOutDoc>19138</bytesOutDoc>

<bytesIn>367870</bytesIn>

<bytesInDoc>367870</bytesInDoc>

<requests>47</requests>

<requestsDoc>47</requestsDoc>

<result>0</result>

<render>1634</render>

<fullyLoaded>6003</fullyLoaded>

<cached>1</cached>

<web>1</web>

<docTime>5924</docTime>

<domTime>0</domTime>

<score_cache>92</score_cache>

<score_cdn>0</score_cdn>

<score_gzip>100</score_gzip>

<score_cookies>94</score_cookies>

<score_keep-alive>32</score_keep-alive>

<score_minify>-1</score_minify>

<score_combine>100</score_combine>

<score_compress>100</score_compress>

<score_etags>97</score_etags>

<date>1286858848</date>

</results>

<pages>

<details>http://xxxxxxxxxxxxxxxxxxxxx/result/101011_TB/2/details/cached/</details>

<checklist>http://xxxxxxxxxxxxxxxxxxxxx/result/101011_TB/2/performance_optimization/cached/</checklist>

<report>http://xxxxxxxxxxxxxxxxxxxxx/result/101011_TB/2/optimization_report/cached/</report>

<breakdown>http://xxxxxxxxxxxxxxxxxxxxx/result/101011_TB/2/breakdown/</breakdown>

<domains>http://xxxxxxxxxxxxxxxxxxxxx/result/101011_TB/2/domains/</domains>

<screenShot>http://xxxxxxxxxxxxxxxxxxxxx/result/101011_TB/2/screen_shot/cached/</screenShot>

</pages>

<thumbnails>

<waterfall>http://xxxxxxxxxxxxxxxxxxxxx/result/101011_TB/2_Cached_waterfall_thumb.png</waterfall>

<checklist>http://xxxxxxxxxxxxxxxxxxxxx/result/101011_TB/2_Cached_optimization_thumb.png</checklist>

<screenShot>http://xxxxxxxxxxxxxxxxxxxxx/result/101011_TB/2_Cached_screen_thumb.jpg</screenShot>

</thumbnails>

<images>

<waterfall>http://xxxxxxxxxxxxxxxxxxxxx/results/10/10/11/TB/2_Cached_waterfall.png</waterfall>

<checklist>http://xxxxxxxxxxxxxxxxxxxxx/results/10/10/11/TB/2_Cached_optimization.png</checklist>

<screenShot>http://xxxxxxxxxxxxxxxxxxxxx/results/10/10/11/TB/2_Cached_screen.jpg</screenShot>

</images>

<rawData>

<headers>http://xxxxxxxxxxxxxxxxxxxxx/results/10/10/11/TB/2_Cached_report.txt</headers>

<pageData>http://xxxxxxxxxxxxxxxxxxxxx/results/10/10/11/TB/2_Cached_IEWPG.txt</pageData>

<requestsData>http://xxxxxxxxxxxxxxxxxxxxx/results/10/10/11/TB/2_Cached_IEWTR.txt</requestsData>

<utilization>http://xxxxxxxxxxxxxxxxxxxxx/results/10/10/11/TB/2_Cached_progress.csv</utilization>

</rawData>

</repeatView>

</run>

<run>

<id>3</id>

<firstView>

<results>

<URL>http://www.sanook.com/</URL>

<loadTime>9929</loadTime>

<TTFB>724</TTFB>

<bytesOut>77871</bytesOut>

<bytesOutDoc>77871</bytesOutDoc>

<bytesIn>966750</bytesIn>

<bytesInDoc>966750</bytesInDoc>

<requests>241</requests>

<requestsDoc>241</requestsDoc>

<result>0</result>

<render>2545</render>

<fullyLoaded>9982</fullyLoaded>

<cached>0</cached>

<web>1</web>

<docTime>9929</docTime>

<domTime>0</domTime>

<score_cache>98</score_cache>

<score_cdn>0</score_cdn>

<score_gzip>96</score_gzip>

<score_cookies>99</score_cookies>

<score_keep-alive>86</score_keep-alive>

<score_minify>99</score_minify>

<score_combine>0</score_combine>

<score_compress>99</score_compress>

<score_etags>99</score_etags>

<date>1286858870</date>

</results>

<pages>

<details>http://xxxxxxxxxxxxxxxxxxxxx/result/101011_TB/3/details/</details>

<checklist>http://xxxxxxxxxxxxxxxxxxxxx/result/101011_TB/3/performance_optimization/</checklist>

<report>http://xxxxxxxxxxxxxxxxxxxxx/result/101011_TB/3/optimization_report/</report>

<breakdown>http://xxxxxxxxxxxxxxxxxxxxx/result/101011_TB/3/breakdown/</breakdown>

<domains>http://xxxxxxxxxxxxxxxxxxxxx/result/101011_TB/3/domains/</domains>

<screenShot>http://xxxxxxxxxxxxxxxxxxxxx/result/101011_TB/3/screen_shot/</screenShot>

</pages>

<thumbnails>

<waterfall>http://xxxxxxxxxxxxxxxxxxxxx/result/101011_TB/3_waterfall_thumb.png</waterfall>

<checklist>http://xxxxxxxxxxxxxxxxxxxxx/result/101011_TB/3_optimization_thumb.png</checklist>

<screenShot>http://xxxxxxxxxxxxxxxxxxxxx/result/101011_TB/3_screen_thumb.jpg</screenShot>

</thumbnails>

<images>

<waterfall>http://xxxxxxxxxxxxxxxxxxxxx/results/10/10/11/TB/3_waterfall.png</waterfall>

<checklist>http://xxxxxxxxxxxxxxxxxxxxx/results/10/10/11/TB/3_optimization.png</checklist>

<screenShot>http://xxxxxxxxxxxxxxxxxxxxx/results/10/10/11/TB/3_screen.jpg</screenShot>

</images>

<rawData>

<headers>http://xxxxxxxxxxxxxxxxxxxxx/results/10/10/11/TB/3_report.txt</headers>

<pageData>http://xxxxxxxxxxxxxxxxxxxxx/results/10/10/11/TB/3_IEWPG.txt</pageData>

<requestsData>http://xxxxxxxxxxxxxxxxxxxxx/results/10/10/11/TB/3_IEWTR.txt</requestsData>

<utilization>http://xxxxxxxxxxxxxxxxxxxxx/results/10/10/11/TB/3_progress.csv</utilization>

</rawData>

</firstView>

<repeatView>

<results>

<URL>http://www.sanook.com/</URL>

<loadTime>6385</loadTime>

<TTFB>241</TTFB>

<bytesOut>19791</bytesOut>

<bytesOutDoc>19791</bytesOutDoc>

<bytesIn>348352</bytesIn>

<bytesInDoc>348352</bytesInDoc>

<requests>49</requests>

<requestsDoc>49</requestsDoc>

<result>0</result>

<render>1091</render>

<fullyLoaded>6385</fullyLoaded>

<cached>1</cached>

<web>1</web>

<docTime>6385</docTime>

<domTime>0</domTime>

<score_cache>90</score_cache>

<score_cdn>13</score_cdn>

<score_gzip>94</score_gzip>

<score_cookies>94</score_cookies>

<score_keep-alive>34</score_keep-alive>

<score_minify>100</score_minify>

<score_combine>100</score_combine>

<score_compress>100</score_compress>

<score_etags>97</score_etags>

<date>1286858896</date>

</results>

<pages>

<details>http://xxxxxxxxxxxxxxxxxxxxx/result/101011_TB/3/details/cached/</details>

<checklist>http://xxxxxxxxxxxxxxxxxxxxx/result/101011_TB/3/performance_optimization/cached/</checklist>

<report>http://xxxxxxxxxxxxxxxxxxxxx/result/101011_TB/3/optimization_report/cached/</report>

<breakdown>http://xxxxxxxxxxxxxxxxxxxxx/result/101011_TB/3/breakdown/</breakdown>

<domains>http://xxxxxxxxxxxxxxxxxxxxx/result/101011_TB/3/domains/</domains>

<screenShot>http://xxxxxxxxxxxxxxxxxxxxx/result/101011_TB/3/screen_shot/cached/</screenShot>

</pages>

<thumbnails>

<waterfall>http://xxxxxxxxxxxxxxxxxxxxx/result/101011_TB/3_Cached_waterfall_thumb.png</waterfall>

<checklist>http://xxxxxxxxxxxxxxxxxxxxx/result/101011_TB/3_Cached_optimization_thumb.png</checklist>

<screenShot>http://xxxxxxxxxxxxxxxxxxxxx/result/101011_TB/3_Cached_screen_thumb.jpg</screenShot>

</thumbnails>

<images>

<waterfall>http://xxxxxxxxxxxxxxxxxxxxx/results/10/10/11/TB/3_Cached_waterfall.png</waterfall>

<checklist>http://xxxxxxxxxxxxxxxxxxxxx/results/10/10/11/TB/3_Cached_optimization.png</checklist>

<screenShot>http://xxxxxxxxxxxxxxxxxxxxx/results/10/10/11/TB/3_Cached_screen.jpg</screenShot>

</images>

<rawData>

<headers>http://xxxxxxxxxxxxxxxxxxxxx/results/10/10/11/TB/3_Cached_report.txt</headers>

<pageData>http://xxxxxxxxxxxxxxxxxxxxx/results/10/10/11/TB/3_Cached_IEWPG.txt</pageData>

<requestsData>http://xxxxxxxxxxxxxxxxxxxxx/results/10/10/11/TB/3_Cached_IEWTR.txt</requestsData>

<utilization>http://xxxxxxxxxxxxxxxxxxxxx/results/10/10/11/TB/3_Cached_progress.csv</utilization>

</rawData>

</repeatView>

</run>

<run>

<id>4</id>

<repeatView>

<results>

<URL>http://www.sanook.com/</URL>

<loadTime>8491</loadTime>

<TTFB>250</TTFB>

<bytesOut>19820</bytesOut>

<bytesOutDoc>19820</bytesOutDoc>

<bytesIn>407356</bytesIn>

<bytesInDoc>407356</bytesInDoc>

<requests>49</requests>

<requestsDoc>49</requestsDoc>

<result>0</result>

<render>984</render>

<fullyLoaded>8491</fullyLoaded>

<cached>1</cached>

<web>1</web>

<docTime>8491</docTime>

<domTime>0</domTime>

<score_cache>92</score_cache>

<score_cdn>0</score_cdn>

<score_gzip>94</score_gzip>

<score_cookies>92</score_cookies>

<score_keep-alive>32</score_keep-alive>

<score_minify>100</score_minify>

<score_combine>100</score_combine>

<score_compress>100</score_compress>

<score_etags>97</score_etags>

<date>1286858943</date>

</results>

<pages>

<details>http://xxxxxxxxxxxxxxxxxxxxx/result/101011_TB/4/details/cached/</details>

<checklist>http://xxxxxxxxxxxxxxxxxxxxx/result/101011_TB/4/performance_optimization/cached/</checklist>

<report>http://xxxxxxxxxxxxxxxxxxxxx/result/101011_TB/4/optimization_report/cached/</report>

<breakdown>http://xxxxxxxxxxxxxxxxxxxxx/result/101011_TB/4/breakdown/</breakdown>

<domains>http://xxxxxxxxxxxxxxxxxxxxx/result/101011_TB/4/domains/</domains>

<screenShot>http://xxxxxxxxxxxxxxxxxxxxx/result/101011_TB/4/screen_shot/cached/</screenShot>

</pages>

<thumbnails>

<waterfall>http://xxxxxxxxxxxxxxxxxxxxx/result/101011_TB/4_Cached_waterfall_thumb.png</waterfall>

<checklist>http://xxxxxxxxxxxxxxxxxxxxx/result/101011_TB/4_Cached_optimization_thumb.png</checklist>

<screenShot>http://xxxxxxxxxxxxxxxxxxxxx/result/101011_TB/4_Cached_screen_thumb.jpg</screenShot>

</thumbnails>

<images>

<waterfall>http://xxxxxxxxxxxxxxxxxxxxx/results/10/10/11/TB/4_Cached_waterfall.png</waterfall>

<checklist>http://xxxxxxxxxxxxxxxxxxxxx/results/10/10/11/TB/4_Cached_optimization.png</checklist>

<screenShot>http://xxxxxxxxxxxxxxxxxxxxx/results/10/10/11/TB/4_Cached_screen.jpg</screenShot>

</images>

<rawData>

<headers>http://xxxxxxxxxxxxxxxxxxxxx/results/10/10/11/TB/4_Cached_report.txt</headers>

<pageData>http://xxxxxxxxxxxxxxxxxxxxx/results/10/10/11/TB/4_Cached_IEWPG.txt</pageData>

<requestsData>http://xxxxxxxxxxxxxxxxxxxxx/results/10/10/11/TB/4_Cached_IEWTR.txt</requestsData>

<utilization>http://xxxxxxxxxxxxxxxxxxxxx/results/10/10/11/TB/4_Cached_progress.csv</utilization>

</rawData>

</repeatView>

</run>

<run>

<id>5</id>

<repeatView>

<results>

<URL>http://www.sanook.com/</URL>

<loadTime>5930</loadTime>

<TTFB>564</TTFB>

<bytesOut>19517</bytesOut>

<bytesOutDoc>19517</bytesOutDoc>

<bytesIn>430723</bytesIn>

<bytesInDoc>430723</bytesInDoc>

<requests>48</requests>

<requestsDoc>48</requestsDoc>

<result>0</result>

<render>1316</render>

<fullyLoaded>6069</fullyLoaded>

<cached>1</cached>

<web>1</web>

<docTime>5930</docTime>

<domTime>0</domTime>

<score_cache>93</score_cache>

<score_cdn>0</score_cdn>

<score_gzip>100</score_gzip>

<score_cookies>94</score_cookies>

<score_keep-alive>34</score_keep-alive>

<score_minify>-1</score_minify>

<score_combine>100</score_combine>

<score_compress>100</score_compress>

<score_etags>97</score_etags>

<date>1286858994</date>

</results>

<pages>

<details>http://xxxxxxxxxxxxxxxxxxxxx/result/101011_TB/5/details/cached/</details>

<checklist>http://xxxxxxxxxxxxxxxxxxxxx/result/101011_TB/5/performance_optimization/cached/</checklist>

<report>http://xxxxxxxxxxxxxxxxxxxxx/result/101011_TB/5/optimization_report/cached/</report>

<breakdown>http://xxxxxxxxxxxxxxxxxxxxx/result/101011_TB/5/breakdown/</breakdown>

<domains>http://xxxxxxxxxxxxxxxxxxxxx/result/101011_TB/5/domains/</domains>

<screenShot>http://xxxxxxxxxxxxxxxxxxxxx/result/101011_TB/5/screen_shot/cached/</screenShot>

</pages>

<thumbnails>

<waterfall>http://xxxxxxxxxxxxxxxxxxxxx/result/101011_TB/5_Cached_waterfall_thumb.png</waterfall>

<checklist>http://xxxxxxxxxxxxxxxxxxxxx/result/101011_TB/5_Cached_optimization_thumb.png</checklist>

<screenShot>http://xxxxxxxxxxxxxxxxxxxxx/result/101011_TB/5_Cached_screen_thumb.jpg</screenShot>

</thumbnails>

<images>

<waterfall>http://xxxxxxxxxxxxxxxxxxxxx/results/10/10/11/TB/5_Cached_waterfall.png</waterfall>

<checklist>http://xxxxxxxxxxxxxxxxxxxxx/results/10/10/11/TB/5_Cached_optimization.png</checklist>

<screenShot>http://xxxxxxxxxxxxxxxxxxxxx/results/10/10/11/TB/5_Cached_screen.jpg</screenShot>

</images>

<rawData>

<headers>http://xxxxxxxxxxxxxxxxxxxxx/results/10/10/11/TB/5_Cached_report.txt</headers>

<pageData>http://xxxxxxxxxxxxxxxxxxxxx/results/10/10/11/TB/5_Cached_IEWPG.txt</pageData>

<requestsData>http://xxxxxxxxxxxxxxxxxxxxx/results/10/10/11/TB/5_Cached_IEWTR.txt</requestsData>

<utilization>http://xxxxxxxxxxxxxxxxxxxxx/results/10/10/11/TB/5_Cached_progress.csv</utilization>

</rawData>

</repeatView>

</run>

</data>

</response>

***pmeenan*** · 10-12-2010, 03:42 AM

Is it always the same page? Also, what version of pagetest/urlblast? The missing data could mean either that pagetest/the browser crashed or that the files had problems uploading to the server (usually it's because of a crash, particularly if it happens on a specific page).

sajal · 10-12-2010, 06:54 AM

(10-12-2010 03:42 AM)pmeenan Wrote: Is it always the same page? Also, what version of pagetest/urlblast? The missing data could mean either that pagetest/the browser crashed or that the files had problems uploading to the server (usually it's because of a crash, particularly if it happens on a specific page).

both use the latest version from http://www.webpagetest.org/forums/showth...hp?tid=375

The test client i downloaded directly from this site today, and the web server i updated a few days ago when the version with the new UI was added.

Its usually similar behaviour for same sites.

Like for the test above, that site will show up some of the time and wont show some of the time.
Can be described into these categories.
1) For some sites it randomly misses screenshots.
2) For some sites most of the time the waterfall chart (and the traffic data) of the first view goes missing. <-- seems to be happening for particular sites generally.

the test client is on a cheap VPS windows 2003 server with ie8 + flash installed.

The current VPS is single core with 512 MB memory, but ive faced this issue on the bigger ec2 instances as well.

Right now im running it on a win xp vmware, the sample site im testing ( http://www.sanook.com/ ) gets the waterfall charts, but the screenshot is still missing... sounds like browser crash... will look into the logs to digg more..