MyBB Internal: One or more warnings occured. Please contact your administrator for assistance.
Unrealistic performance at beginning of agent start (EC2)
Current time: 02-25-2021, 06:48 PM Hello There, Guest! (LoginRegister)

Post Reply 
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Unrealistic performance at beginning of agent start (EC2)
11-10-2016, 03:29 AM
Post: #1
Unrealistic performance at beginning of agent start (EC2)
Hey Patrick -

I'm using the EC2 autoscale feature to keep costs down (since I only run tests a few hours a day), and I've noticed an unwelcome trend - it seems that the first few tests that run on any agent after it boots are extremely inaccurate. Load times can be as much as 4x slower, and if you look at the waterfall it appears the browser simply halts loading the page for several seconds.

Here's an example of the same url, run first at the beginning of the queue, and again at the end of the queue (only a few minutes apart, all settings and content the same). I have confirmed this is consistent behavior, happening every day for weeks since I set it up, and on different urls too. If you want more examples I have plenty.

I'm guessing that the agent is doing something in the background after it starts up the browser. Could it be that the EC2 images are so old that they're churning trying to update themselves to the latest code and browser?

Any suggestions other than keeping the agents always running, or throwing away the first X minutes of testing?

Thanks so much,
Find all posts by this user
Quote this message in a reply
Post Reply 

Messages In This Thread
Unrealistic performance at beginning of agent start (EC2) - ShaneLabs - 11-10-2016 03:29 AM

Forum Jump:

User(s) browsing this thread: 3 Guest(s)