Current time: 12-14-2017, 02:32 AM Hello There, Guest! (LoginRegister)

Post Reply 
 
Thread Rating:
  • 1 Vote(s) - 4 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Do acceleration products really work for every request, 24x7?
07-10-2010, 12:05 AM
Post: #1
Do acceleration products really work for every request, 24x7?
Hi

My company has been investigating possible acceleration products after attending the velocity conf this year. We have identified a top 3 in this domain of Strangeloopnetworks, Aptimize, and Acceloweb. So my first question is are we missing any key players?

My first impressions of the product demonstrations are "it's too good to be true". After hunting around a little I'm starting to think this might be the case. Autoanything, a site who used Strangeloop's acceleration product was really touted as a huge success at the conference this year. Yet when I test that site, I see mixed results. There were several tests run a few weeks back during the conference, and several completed afterwards. I see these have been removed from public viewing now?

Likewise for customers of the Aptimize product. Inconsistent performance. I'm still not sure who Acceloweb's reference customers are, but I'd really like to hear from anyone who knows.

So, my question to the community is do these products deliver all they promise? Are they actually too good to be true or are my expectations too high? Perhaps my view on what they offer is somewhat distorted. Can anyone give me a real success story? Or can anyone offer a horror story?

We are deciding how to implement several web performance optimisation best practices. The site has been around a long time, and performance has never really been considered with regards to front end changes. Given this situation, we're anticipating significant cost in doing this, let alone maintaining the changes and standards we introduce. Thus the option to use an acceleration product has potential...

Cheers
stig
Find all posts by this user
Quote this message in a reply
07-10-2010, 01:36 AM
Post: #2
RE: Do acceleration products really work for every request, 24x7?
I would love to see some websites that use the acceleration products.

It would be nice if those companies had some sort of webpage setup where you could pass a link to it
and it would send back an accelerated webpage so we could see how fast our pages could be.
Find all posts by this user
Quote this message in a reply
07-10-2010, 02:45 AM
Post: #3
RE: Do acceleration products really work for every request, 24x7?
(07-10-2010 12:05 AM)astigley Wrote:  Hi

My company has been investigating possible acceleration products after attending the velocity conf this year. We have identified a top 3 in this domain of Strangeloopnetworks, Aptimize, and Acceloweb. So my first question is are we missing any key players?

My first impressions of the product demonstrations are "it's too good to be true". After hunting around a little I'm starting to think this might be the case. Autoanything, a site who used Strangeloop's acceleration product was really touted as a huge success at the conference this year. Yet when I test that site, I see mixed results. There were several tests run a few weeks back during the conference, and several completed afterwards. I see these have been removed from public viewing now?

Likewise for customers of the Aptimize product. Inconsistent performance. I'm still not sure who Acceloweb's reference customers are, but I'd really like to hear from anyone who knows.

So, my question to the community is do these products deliver all they promise? Are they actually too good to be true or are my expectations too high? Perhaps my view on what they offer is somewhat distorted. Can anyone give me a real success story? Or can anyone offer a horror story?

We are deciding how to implement several web performance optimisation best practices. The site has been around a long time, and performance has never really been considered with regards to front end changes. Given this situation, we're anticipating significant cost in doing this, let alone maintaining the changes and standards we introduce. Thus the option to use an acceleration product has potential...

Cheers
stig

They all appear to be offering "in the cloud" solutions. I'm willing to bet that you could get each of them to set up a trial where you can test through their cloud to see how it performs before committing.

From what I have seen of all 3 solutions, they should be able to deliver on most of their promises as most of the things they are doing are fairly straightforward (combining scripts and inlining images are the really huge wins assuming your hosting isn't completely broken and you already have gzip and keep-alives enabled).

Beyond the basics is where you will start to see differences with the products and how well they work is going to be pretty specific to your site.
Visit this user's website Find all posts by this user
Quote this message in a reply
07-12-2010, 05:13 PM
Post: #4
RE: Do acceleration products really work for every request, 24x7?
(07-10-2010 01:36 AM)green-watch.org Wrote:  I would love to see some websites that use the acceleration products.

It would be nice if those companies had some sort of webpage setup where you could pass a link to it
and it would send back an accelerated webpage so we could see how fast our pages could be.

All the companies I listed above will do a free demo for you. You send them the link, and a few days later they will send you an old vs. new waterfall and video from web page test. The videos look convincing! But is this realistic of final performance users will receive or is this "lab" performance levels which are ultimately unobtainable in the real world?
Find all posts by this user
Quote this message in a reply
07-12-2010, 07:25 PM
Post: #5
RE: Do acceleration products really work for every request, 24x7?
What concerns me is I never see prices advertised on their websites. I got contacted by one of the companies and it said the starting price was a few thousand and then there is a yearly maintenance fee; most small businesses and start-up companies simply can not afford that. I do not know if all the companies are that expensive. Another concern is I have asked for website urls that use their services so I can run it through Pat's pagetest but never get any responses. As far as two videos are concerned, would the companies send back average time or their fastest time and if it is average time how many tests were done to get the average?
Find all posts by this user
Quote this message in a reply
07-12-2010, 10:49 PM
Post: #6
RE: Do acceleration products really work for every request, 24x7?
Was that for their cloud offering or one of the software/device installs? I would have hoped that the cloud offerings were structured so that they were more reasonable for small companies.

There are some free software-based solutions but most of the ones I know about are for php and aren't NEARLY as comprehensive.

Hopefully more competition in the space will bring the costs down.
Visit this user's website Find all posts by this user
Quote this message in a reply
07-13-2010, 12:31 AM
Post: #7
RE: Do acceleration products really work for every request, 24x7?
The quote I got was from Aptimize.

"The Aptimize Website Accelerator (WAX) starts at $3k - that increases depending on your environment.

After year 1 there is a annual 20% (of your original costs) maintainence fee."

Perhaps that is for the software/device install?

If anybody has any price quotes on cloud offerings, please let us know Smile
Find all posts by this user
Quote this message in a reply
07-14-2010, 10:23 AM
Post: #8
RE: Do acceleration products really work for every request, 24x7?
I’m president of Strangeloop. Hopefully I can answer your questions about our products and service.

(07-10-2010 12:05 AM)astigley Wrote:  Autoanything, a site who used Strangeloop's acceleration product was really touted as a huge success at the conference this year. Yet when I test that site, I see mixed results. There were several tests run a few weeks back during the conference, and several completed afterwards. I see these have been removed from public viewing now?

To address the issue of inconsistent results, there are a few reasons why you might get these:

1. We are A/B testing the site all the time so that we can quantify performance improvements on an ongoing basis. This means you have a 50% chance of seeing an unaccelerated page.
2. In some of the A/B tests, we turn off some of the product features to measure and compare the impact of different feature combinations.
3. Site Optimizer is always learning, and to learn it might send pages back that are not treated.
4. Optimal Yslow/Page Speed scores are not always the best for overall conversion (especially when it comes to roundtrip reduction).

To respond to your other question: I'm not sure what you mean when you say that AutoAnything tests have been removed. Where did you see the tests originally?

(07-10-2010 02:45 AM)pmeenan Wrote:  They all appear to be offering "in the cloud" solutions. I'm willing to bet that you could get each of them to set up a trial where you can test through their cloud to see how it performs before committing.

We can do this. Contact me at joshua [dot] bixby [at] strangeloopnetworks [dot] com and let's talk more.

(07-12-2010 05:13 PM)astigley Wrote:  All the companies I listed above will do a free demo for you. You send them the link, and a few days later they will send you an old vs. new waterfall and video from web page test. The videos look convincing! But is this realistic of final performance users will receive or is this "lab" performance levels which are ultimately unobtainable in the real world?

Here's how we do our performance tests (not to be confused with running a trial of our service, which follows a different process):

1. We run the URL you provide through Web Page Test, which is housed on a server in our datacenter in Vancouver. The page test uses a real Internet Explorer 7 browser and a simulated DSL line.
2. One of our Performance Experts reviews the results to ensure that it accurately reflects your site's content and contains no anomalies. Then he or she configures our Site Optimizer service to accelerate the page. In order to get an accurate report, we must configure the system for your site's specific needs. Then we run the page test again.
3. After the report is generated, it is reviewed by one of our Performance Experts to ensure that it accurately reflects what Site Optimizer can do for the page.
4. Once we are satisfied with the results, we generate the final report and send it to you.

The reason we use Web Page Test is because it's the only third-party diagnostic tool that realistically simulates real-world user environments and browser behavior. We do this specifically to ensure that we don't provide unrealistic, unattainable lab performance levels.

(07-12-2010 07:25 PM)green-watch.org Wrote:  What concerns me is I never see prices advertised on their websites.

That's partly because the prices range depending on a bunch of variables that we need to discuss with you before giving you an estimate. And it's partly because we're all cagey about revealing our pricing to our competitors. Wink But I'm always happy to have a no-pressure chat. Please feel free to get in touch with me at the email address above.

President, Strangeloop
http://strangeloopnetworks.com
http://webperformancetoday.com
Find all posts by this user
Quote this message in a reply
07-14-2010, 06:10 PM (This post was last modified: 07-14-2010 06:53 PM by astigley.)
Post: #9
RE: Do acceleration products really work for every request, 24x7?
(07-14-2010 10:23 AM)JoshuaBixby Wrote:  I’m president of Strangeloop. Hopefully I can answer your questions about our products and service.

(07-10-2010 12:05 AM)astigley Wrote:  Autoanything, a site who used Strangeloop's acceleration product was really touted as a huge success at the conference this year. Yet when I test that site, I see mixed results. There were several tests run a few weeks back during the conference, and several completed afterwards. I see these have been removed from public viewing now?

To address the issue of inconsistent results, there are a few reasons why you might get these:

1. We are A/B testing the site all the time so that we can quantify performance improvements on an ongoing basis. This means you have a 50% chance of seeing an unaccelerated page.
2. In some of the A/B tests, we turn off some of the product features to measure and compare the impact of different feature combinations.
3. Site Optimizer is always learning, and to learn it might send pages back that are not treated.
4. Optimal Yslow/Page Speed scores are not always the best for overall conversion (especially when it comes to roundtrip reduction).

To respond to your other question: I'm not sure what you mean when you say that AutoAnything tests have been removed. Where did you see the tests originally?

Thanks Joshua, I've admit I've made a mistake on the Autoanything tests being removed. I failed to check show tests from all users, my apologies. A/B testing makes sense, but eventually I'd expect to see all traffic optimised. A faster web for all Smile. Thanks for replying.
OK, so we've weighed up our two options, Strangeloop and Aptimize. Both offering similar benefits of web page optimisation but with very different approaches. It really depends on the nature of your environment and how quickly you can implement changes to get this stuff up and running.

We're in touch with representatives in Europe for both companies (I'm based in Holland) and have been given quotes for trial and implementations (can't share those details sorry). Either way we will be doing a trial with at least one of the products. I'll let you know how we get on.

Time will tell!
Find all posts by this user
Quote this message in a reply
07-15-2010, 10:37 AM
Post: #10
RE: Do acceleration products really work for every request, 24x7?
[quote='astigley' pid='1384' dateline='1278684356']

You can check out the results from sharepoint.microsoft.com as Aptimize has been running on that site for almost a year now.

http://www.aptimize.com/blog/sharepoint2010

No smoke and mirrors here. Just run the test yourself with WAX OFF and you can see the impact of less is more!

Mike Iem
Aptimize
Find all posts by this user
Quote this message in a reply
Post Reply 


Forum Jump:


User(s) browsing this thread: 1 Guest(s)