Current time: 12-12-2017, 11:09 AM Hello There, Guest! (LoginRegister)

Post Reply 
 
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Revisiting browser and connectivity defaults
03-15-2013, 03:53 AM
Post: #1
Revisiting browser and connectivity defaults
WebPagetest provides a bunch of browser and connectivity options but by far the most testing us done using whatever the defaults are set to. It is a pretty big deal to users if they change which is why I try to do it when only absolutely necessary but I think it's time to re-visit what the defaults are and at least have the discussion if it's finally time to change them again.

Browser

The last time the browser default was changed was in May 2011 (close to 2 years ago) when it was changed from IE 7 to IE 8. IE 8 is getting pretty long in the tooth and market shares have changed a LOT in the last two years.

At least according to statcounter, IE 9 has eclipsed IE 8 in every region except for Asia and outside of the US Chrome and Firefox both have more usage than IE:

US
Europe
Asia

Global

IE 9, Chrome and Firefox are all much more modern and comparable with each other than IE 8.

Akamai also provides browser usage share as part of their IO data set which is reporting much higher shares for IE.

I'm leaning towards switching to Chrome for the default but I could probably be convinced to use IE 9 instead (though with the auto-upgrade to IE 10 coming shortly there is a good chance that the IE mix will get murkier).

Connectivity

The default connectivity has never changed since WebPagetest's launch back in 2008. 5 years is quite a long time and it has done us well but it is becoming increasingly difficult to justify. Getting good data on broadband speeds and adoption has been really difficult.

Akamai makes a bunch of data available regularly as part of their state of the Internet reports. The Q3 2012 report calls out the percent of users with > 4Mbps connections (62% in the US, over 80% in Asia and in the 70's for Europe).

Some other data I have been looking at also shows significant bandwidth increases across all percentiles, particularly over the last 2 years.

At 1.5Mbps (the current default), the majority of pages that I have seen are bandwidth constrained and any improvement basically requires reducing bytes (not a bad idea but may not move the needle for a lot of users that are not bandwidth constrained). Given the growth in sizes of pages, maybe it's a good idea to keep the focus there but it feels like it should be time to re-consider.

I'm inclined to switch to the "Cable" profile which is faster and with lower latency (5Mbps and 1/2 the latency) which should be a lot closer to the current medians (and more forward-looking) but I'd love to hear input.


Any changes will just be to the default settings, all of the options will continue to be available so the plan isn't to take anything away, just to update the defaults for where we steer people to optimize.
Visit this user's website Find all posts by this user
Quote this message in a reply
03-15-2013, 05:40 AM
Post: #2
RE: Revisiting browser and connectivity defaults
I couldn't agree more with you. We were just talking about this yesterday, and how it would be better to indeed change default to Chrome and Bandwidth to 'at least' the current Cable setting, maybe with an even higher download.

- C
Find all posts by this user
Quote this message in a reply
03-15-2013, 06:49 AM
Post: #3
RE: Revisiting browser and connectivity defaults
I'm not too concerned about the default browser choice I would be tempted to go for IE9 given the market shares in North America but aware Chrome has a lead elsewhere - in traffic terms where do most of WPTs users come from?

Bandwidth wise I think the cable settings are too optimistic - many people have faster connections these days but are they really achieving faster throughput?

I was quite disappointed when I saw the Netflix stats (http://ispspeedindex.netflix.com/) but aware they're an average rather than a distribution (know anyone at Netflix who can give us 50th, 90th percentiles?).

Andy

Using WebPageTest - http://usingwpt.com/
Visit this user's website Find all posts by this user
Quote this message in a reply
03-15-2013, 06:56 AM
Post: #4
RE: Revisiting browser and connectivity defaults
Definitely agree with changing the default connectivity to Cable.

As for browsers I'm a bit undecided. I pretty much always test IE9 and Chrome. I think it's more likely that people find performance issues when they test with IE9 though (although yesterday we found an issue with Chrome's speculative downloading that resulted in poorer performance than with IE9..). Either one would be fine though.
Find all posts by this user
Quote this message in a reply
03-15-2013, 06:58 AM
Post: #5
RE: Revisiting browser and connectivity defaults
I agree with the change:

- At least move to IE9
- Bump to CABLE profile
Find all posts by this user
Quote this message in a reply
03-15-2013, 08:44 AM
Post: #6
RE: Revisiting browser and connectivity defaults
Maybe Cable is too optimistic, however, I'm referring to http://www.netindex.com and looking at their stats, the average is higher than the default Cable, that's why I suggested and even higher download.
Find all posts by this user
Quote this message in a reply
03-15-2013, 09:27 AM
Post: #7
RE: Revisiting browser and connectivity defaults
I'd choose for cable and IE 9
Find all posts by this user
Quote this message in a reply
03-15-2013, 09:50 AM
Post: #8
RE: Revisiting browser and connectivity defaults
It would be good if users could save their own default. But Cable & IE9 as the default sounds good to me
Find all posts by this user
Quote this message in a reply
03-15-2013, 10:56 AM
Post: #9
RE: Revisiting browser and connectivity defaults
The Akamai data and other data I have seen are as-measured so it's safe to assume that's actual thruput and not just advertised or subscribed speeds. I'm less confident in the Netflix data (Google Fiber is 3Mbps, seriously?) I think they are limited somewhat by the bitrate of the encoded movies depending on how they measure or there's congestion somewhere else.

The bulk of the users doing testing are from the US and Europe and I can use different browser defaults by location and tune them for the different regions but the Dulles default is the main one I want to make as neutral as possible since the vast majority of users just drop in an URL and hit test.

IE 9 will probably be the most seamless change since it uses the same agent code as IE 8 and there are no missing features (like the PageSpeed score being missing for Chrome for example). There's a chance I'll have to re-visit it again in a couple of months but Chrome and Firefox change on their own every 6 weeks so it's still not that bad.

The more data I look at the more comfortable I get with switching to the 5Mbps cable profile as well though I still worry for the sites that do no testing at lower bandwidths and shove 4+MB of data down to users on each page view. I don't think that necessarily outweighs getting people to optimize for more modern browsers though so maybe there are other things I can do to alert them of that kind of issue.
Visit this user's website Find all posts by this user
Quote this message in a reply
03-15-2013, 11:14 AM
Post: #10
RE: Revisiting browser and connectivity defaults
Chrome and Cable.
Find all posts by this user
Quote this message in a reply
Post Reply 


Forum Jump:


User(s) browsing this thread: 1 Guest(s)