Skip to end of metadata
Go to start of metadata

The Planet's Performance Cloud Server

Testing scalability on a Performance Cloud Server from The Planet.

Summary

This chart shows the average response (in seconds) for different levels of concurrency using the a Performance Cloud Server. In this case we were running the Test Harness from five different boxes some in Australia and others in the same data center at The Planet.

On this second chart we show the same level of concurrency as before but doubling the number of Test harness instances (10 boxes). As you can see, the response improves when the concurrency is higher which might suggest that there's a slight time delay on the Test harness side when running it with lots of users.

Conclusions

It seems that you can get tolerable response rate while running LAMS on a Performance Cloud Server for about 400 concurrent users (around 2.5 seconds response time).

Server setup

Description

Descr

100 Mbps Network Uplink

uplink

5 IPs

ip_addresses

1000 GB Bandwidth

bandwidth

Cloud Server Control Interface

control

60 GB SAN Storage - Primary Storage

virtual_storage

Cloud Server Provisioning Product

provcode

1 vCPU

virtual_processor

CentOS Enterprise Linux - 5.x - 64 bit

os

4 GB RAM

ram

1 vCPU, 4 GB RAM

server

Software setup

  • MySQL Server 5.1.51 (installed thru RPMs)
  • Java JDK 1.6 (Downloaded from java.sun.com)

No tuning for MySQL or Java (all settings just left as 'out-of-the-box')

LAMS setup

  • Compilation from source (no tuning)

Tests

JVM Settings:
-Xms256m -Xmx1024m -XX:MaxPermSize=130m -XX:NewSize=128m -XX:MaxNewSize=128m -XX:SurvivorRatio=95

Test harness setup: Learner min/max delay: 30/90 secs. Monitor 45/90 secs.

125 users (25x5)

5 instances of the test harness running

LC:
Total response time: 442.122 seconds
Average response time: 0.21255865384615386 seconds
Average response time of joinLesson calls: 0.64324 seconds

Planners:
Total response time: 434.531 seconds
Average response time: 0.20890913461538463 seconds
Average response time of joinLesson calls: 0.70908 seconds

Desktop Jun
Total response time: 3151.641 seconds
Average response time: 1.5144839019702068 seconds
Average response time of joinLesson calls: 1.42368 seconds

Desktop Ernie
Total response time: 3178.484 seconds
Average response time: 1.5273829889476214 seconds
Average response time of joinLesson calls: 1.4082400000000002 seconds

Planet dedicated server:
Total response time: 374.517 seconds
Average response time: 0.17945232390991855 seconds
Average response time of joinLesson calls: 0.69196 seconds

250 (50x5)

LC:
Total response time: 8005.945 seconds
Average response time: 1.9689977865223807 seconds
Average response time of joinLesson calls: 0.6673600000000001 seconds

PLanners:
Total response time: 6626.875 seconds
Average response time: 1.6041817961752602 seconds
Average response time of joinLesson calls: 0.70544 seconds

Desktop Jun
Total response time: 12459.18 seconds
Average response time: 3.0152904162633107 seconds
Average response time of joinLesson calls: 2.05202 seconds

Desktop Ernie
Total response time: 12321.621 seconds
Average response time: 3.0001512052593133 seconds
Average response time of joinLesson calls: 1.87304 seconds

Ernie's laptop
Total response time: 27223.094 seconds
Average response time: 6.638159960985126 seconds
Average response time of joinLesson calls: 8.0228 seconds

375 (75x5)

LC:
Total response time: 72264.419 seconds
Average response time: 12.016032424343198 seconds
Average response time of joinLesson calls: 10.265866666666668 seconds

Planners:
Total response time: 40243.882 seconds
Average response time: 6.5554458380843785 seconds
Average response time of joinLesson calls: 0.8378933333333333 seconds

Desktop Jun:
Total response time: 65187.661 seconds
Average response time: 10.534528280542986 seconds
Average response time of joinLesson calls: 10.96272 seconds

Desktop Ernie
Total response time: 65175.063 seconds
Average response time: 10.628679549902152 seconds
Average response time of joinLesson calls: 7.380213333333333 seconds

Planet dedicated server:
Total response time: 47022.863 seconds
Average response time: 7.594131621447028 seconds
Average response time of joinLesson calls: 1.05924 seconds

250 (25x10)

Desktop Jun (Sydney)
Total response time: 3151.641 seconds
Average response time: 1.5144839019702068 seconds
Average response time of joinLesson calls: 1.42368 seconds

Desktop Ernie (Sydney)
Total response time: 3266.091 seconds
Average response time: 1.5694814992791926 seconds
Average response time of joinLesson calls: 1.53528 seconds

LC (The Planet):
Total response time: 479.265 seconds
Average response time: 0.23052669552669552 seconds
Average response time of joinLesson calls: 0.6677200000000001 seconds

Planners (The Planet):
Total response time: 1.995 seconds
Average response time: 0.3325 seconds

Planet dedicated server (The Planet):
Total response time: 413.925 seconds
Average response time: 0.1983349305222808 seconds
Average response time of joinLesson calls: 0.75508 seconds

Pluto (Sydney):
Total response time: 3277.281 seconds
Average response time: 1.5688276687410243 seconds
Average response time of joinLesson calls: 1.48228 seconds

Olympus (Sydney):
Total response time: 3251.209 seconds
Average response time: 1.5578385241974124 seconds
Average response time of joinLesson calls: 1.5338800000000001 seconds

Shaun (Sydney):
Total response time: 3512.138 seconds
Average response time: 1.682058429118774 seconds
Average response time of joinLesson calls: 1.5944 seconds

LAMS01 (Sydney)
Total response time: 3288.424 seconds
Average response time: 1.5756703402012457 seconds
Average response time of joinLesson calls: 1.5481200000000002 seconds

LAMS02 (ecore - Sydney)
Total response time: 3680.668 seconds
Average response time: 1.762772030651341 seconds
Average response time of joinLesson calls: 1.66524 seconds

350 (25x10)

Desktop Jun
Total response time: 7760.507 seconds
Average response time: 2.6843676928398477 seconds
Average response time of joinLesson calls: 1.4660285714285715 seconds

Desktop Ernie
Total response time: 7817.976 seconds
Average response time: 2.6930678608336205 seconds
Average response time of joinLesson calls: 1.628942857142857 seconds

LC:
Total response time: 2736.778 seconds
Average response time: 0.9411203576341127 seconds
Average response time of joinLesson calls: 1.1082571428571428 seconds

PLanners:
Total response time: 2967.035 seconds
Average response time: 1.0231155172413793 seconds
Average response time of joinLesson calls: 0.8220285714285714 seconds

Planet dedicated server:
Total response time: 3260.316 seconds
Average response time: 1.123472088215024 seconds
Average response time of joinLesson calls: 0.7005142857142858 seconds

PLuto:
Total response time: 6706.386 seconds
Average response time: 2.306185006877579 seconds
Average response time of joinLesson calls: 1.8092285714285714 seconds

Olympus:
Total response time: 6762.557 seconds
Average response time: 2.325501031636864 seconds
Average response time of joinLesson calls: 2.1572285714285715 seconds

Shaun:
Total response time: 7008.584 seconds
Average response time: 2.4101045392022007 seconds
Average response time of joinLesson calls: 2.149542857142857 seconds

LAMS01 (melcoe)
Total response time: 6696.905 seconds
Average response time: 2.3029246905089407 seconds
Average response time of joinLesson calls: 1.7600571428571428 seconds

LAMS02 (ecore)
Total response time: 7273.532 seconds
Average response time: 2.500354761086284 seconds
Average response time of joinLesson calls: 2.0533714285714284 seconds

500 (50x10)

Desktop Jun
TestReporter - Total response time: 44540.631 seconds
Average response time: 10.761205846822904 seconds
Average response time of joinLesson calls: 1.64394 seconds

Desktop Ernie
Total response time: 45907.132 seconds
Average response time: 11.175056475170399 seconds
Average response time of joinLesson calls: 4.58338 seconds

LC:
Total response time: 33350.154 seconds
Average response time: 8.098628946090336 seconds
Average response time of joinLesson calls: 1.65326 seconds

PLanners:
Total response time: 27340.49 seconds
Average response time: 6.715915008597396 seconds
Average response time of joinLesson calls: 0.8027200000000001 seconds

Planet dedicated server:
Total response time: 25244.159 seconds
Average response time: 6.103520067698259 seconds
Average response time of joinLesson calls: 0.8338599999999999 seconds

PLuto:
Total response time: 38292.947 seconds
Average response time: 9.24280642046826 seconds
Average response time of joinLesson calls: 8.4676 seconds

Olympus:
Total response time: 38622.177 seconds
Average response time: 9.320023407335908 seconds
Average response time of joinLesson calls: 6.50926 seconds

Shaun:
Total response time: 37358.769 seconds
Average response time: 9.017322954380884 seconds
Average response time of joinLesson calls: 12.92338 seconds

LAMS01 (melcoe)
Total response time: 37443.862 seconds
Average response time: 9.035680984555984 seconds
Average response time of joinLesson calls: 11.07058 seconds

LAMS02 (ecore)
Total response time: 39395.667 seconds
Average response time: 9.5066763996139 seconds
Average response time of joinLesson calls: 8.154679999999999 seconds

500 (50x10)

Change Java OPTS increase to: -Xmx1792m

Desktop Jun
Total response time: 44380.324 seconds
Average response time: 10.719885024154589 seconds
Average response time of joinLesson calls: 1.5888999999999998 seconds

Desktop Ernie
Total response time: 44592.721 seconds
Average response time: 10.771188647342994 seconds
Average response time of joinLesson calls: 1.8386799999999999 seconds

Planet:
Total response time: 32323.463 seconds
Average response time: 7.801946174269853 seconds
Average response time of joinLesson calls: 0.9754 seconds

LC:
Total response time: 26946.42 seconds
Average response time: 6.601278784909358 seconds
Average response time of joinLesson calls: 0.7409399999999999 seconds

Planners:
Total response time: 24134.41 seconds
Average response time: 5.833795020546289 seconds
Average response time of joinLesson calls: 0.71482 seconds

PLuto:
Total response time: 37234.581 seconds
Average response time: 8.983011097708081 seconds
Average response time of joinLesson calls: 8.41496 seconds

Olympus:
Total response time: 36389.969 seconds
Average response time: 8.871274744027303 seconds
Average response time of joinLesson calls: 11.52722 seconds

Shaun:
Total response time: 34447.905 seconds
Average response time: 8.312718388030888 seconds
Average response time of joinLesson calls: 14.81936 seconds

LAMS01 (melcoe)
Total response time: 35894.322 seconds
Average response time: 8.665939642684693 seconds
Average response time of joinLesson calls: 13.213940000000001 seconds

LAMS02 (ecore)
Total response time: 37656.209 seconds
Average response time: 9.0913107194592 seconds
Average response time of joinLesson calls: 9.02156 seconds

Observations

Network latency is quite noticeable given the difference in seconds between the local test harness instances (The Planet) and the remote ones (Sydney). Nevertheless, the performance at 500 users is not bad considering this is a smallish cloud server.

As a general rule of thumb, I would suggest to add 1 Performance Cloud Server to the cluster for every 400 concurrent users.

  • No labels