THIS IS A TEST INSTANCE. ALL YOUR CHANGES WILL BE LOST!!!!
Page History
...
1. Management server
Processor
Dual core Intel(R) Xeon(R) CPU processor, 2.27GHz, ht enabled, 4 processor
Operating System
CentOS release 5.5 (Final), x86_64
Configuration Parameters
Following config parameters were used in both the management servers
- Java heap size = 5 GB
- db.cloud.maxActive = 250
- db.cloud.url.params=prepStmtCacheSize=517&cachePrepStmts=true&prepStmtCacheSqlLimit=4096&includeInnodbStatusInDeadlockExceptions=true&logSlowQueries=true
Java version
java version "1.6.0"
OpenJDK Runtime Environment (build 1.6.0-b09)
OpenJDK 64-Bit Server VM (build 1.6.0-b09, mixed mode)
2. Database
Processor
Quad-Core AMD Opteron(tm) Processor, 2.1GHz, ht enabled, 8 processor
Operating System
CentOS release 6.2 (Final), x86_64
Configuration Parameters
DB configurations for this run is detailed in the my.cnf attached: my.cnf.txt
Mysql version
MySQL-server-5.5.21-1.linux2.6.x86_64
RESULTS
Tests on Basic zone:
Set up a clustered Management Server (with 3 MS)
...
Due to following issues, the runs haven't been completed
https://issues.apache.org/jira/browse/CLOUDSTACK-4371
https://issues.apache.org/jira/browse/CLOUDSTACK-4350
https://issues.apache.org/jira/browse/CLOUDSTACK-4350 
https://issues.apache.org/jira/browse/CLOUDSTACK-2918
https://issues.apache.org/jira/browse/CLOUDSTACK-3441
...
Deploy VMs in batches and in sequence and following measures should be tracked in the Management Server:
- CPU and Memory Utilization during deploy VM
- Time for Async Job to complete
- Time to return job id
- DB connections
Following config parameters were used in both the management servers
- Java heap size = 5 GB
- db.cloud.maxActive = 250
- db.cloud.url.params=prepStmtCacheSize=517&cachePrepStmts=true&prepStmtCacheSqlLimit=4096&includeInnodbStatusInDeadlockExceptions=true&logSlowQueries=true
CPU Utilization during deploy VM
CPU Utilization measured in the Management server during deployment of 12K simulator VMs and post deploy when there were no external APIs being fired
The area marked in red is during Deploy VM
Response Time of async job:
Following graph shows the response time calculated for deploy VM jobs. It’s more or less constant between 3 and 5 seconds except for few spikes 
Test Scenario 5:
Restart Management Servers and track the time for host re balancing. Also track the numbers when few hosts are put into maintenance mode.
Following shows the time taken for each restart:
TC1: Stop both management servers. Then start up both. Time taken for all hosts to get to Up state: ~13 mins
TC2: Stop one management server. Time taken for hosts of that management server to get to Up state: ~5 mins
TC3: Start up the stopped management server. Time taken for hosts to rebalance between the 2 management server: ~16 mins
Now, add few hosts into maintenance mode and repeat the above restarts. Following are the time taken in each scenario:
TC1: ~10 mins
TC2: ~5 mins
TC3: ~13 mins
LIST API RESPONSE TIME
Configuration:
Advanced zone, Wiki Markup
224 Clusters \ [Each cluster having 8 hosts and one primary storage\]
2000 Hostsunmigrated-wiki-markup
4000 User accounts \ [Each account having one network\]
4000 User instancesunmigrated-wiki-markup
8000 Virtual Routers \ [Since we are using Redundant Virtual Router offering\]
API | Params | Time taken : in 4.1 | Time taken : in 4.2 | Time taken : in 4.2 |
|
|
|
| (with fix) |
listAccounts | listAll=true&pagesize=100&page=3 | 0m16.923s | 0m22 0m20.276s 017s 0m20 | 0m16.675s 680s |
(# of obj: 4000) | listAll=true&pagesize=800&page=2 | 0m26.555s | 0m38 0m34.436s 438s | 0m40 0m36.333s 118s |
| listAll=true&pagesize=1500&page=2 | 0m40.140s | 0m57 1m1.061s 036s | 0m55.245s 497s |
| listAll=true&pagesize=3000&page=1 | 1m3.906s | 1m50 2m2.861s 921s | 1m25 1m24.317s 601s |
| listAll=true | 1m25.348s | 2m26 2m22.092s 628s | 2m6 1m44.207s 621s |
|
|
|
|
|
listRouters | listAll=true&pagesize=100&page=1 | 0m2.398s | 0m3.067s 808s | 0m3.272s 261s |
(# of obj: 8000) | listAll=true&pagesize=800&page=1 | 0m10.372s | 0m18 0m23.899s 124s | 0m22.353s 164s |
| listAll=true&pagesize=1500&page=1 | 0m20.857s | 0m41 0m25.205s 727s | 0m39 0m38.987s 656s |
| listAll=true&pagesize=3000&page=1 | 0m35.034s | 1m9 1m39.899s 030s | 1m21 1m22.463s 330s |
| listAll=true&pagesize=5000&page=1 | 1m0.932s | 2m9 2m31.391s 960s | 2m15 2m5.068s 248s |
| listAll=true | 1m30.935s | 3m13 4m26.135s 163s | 3m33 3m30.504s 292s |
|
|
|
|
|
listEvents | listAll=true&pagesize=100&page=1 | 0m5.967s | 0m4 0m2.538s 169s | 0m3.958s 423s |
(# of obj: 8000) | listAll=true&pagesize=800&page=1 | 0m3.006s | 0m8 0m6.147s 356s 0m6 | 0m5.189s 192s |
| listAll=true&pagesize=1500&page=1 | 0m2.111s | 0m12 0m10.069s 402s | 0m9 0m7.927s 622s |
| listAll=true&pagesize=3000&page=1 | 0m4.122s | 0m15 0m13.280s 979s | 0m17 0m13.283s 520s |
| listAll=true&pagesize=5000&page=1 | 0m6.575s | 0m23 0m20.639s 277s 0m23 | 0m21.396s 931s |
| listAll=true | 0m15.399s | 2m1 2m16.919s 445s | 2m5 1m54.500s 454s |
|
|
|
|
|
listHosts | listAll=true&pagesize=100&page=1 | 0m1.906s | 0m2 0m1.061s 030s | 0m1.499s 159s |
(# of obj: 1985) | listAll=true&pagesize=800&page=1 | 0m13.316s | 0m14 0m7.496s 949s | 0m16 0m7.147s 091s |
| listAll=true&pagesize=1500&page=1 | 0m27.115s | 0m41 0m19.743s 168s | 0m26 0m9.752s 309s |
| listAll=true |
| 1m42 0m42.554s 024s | 0m53 0m41.995s 504s |
|
|
|
|
|
listUsers | listAll=true&pagesize=100&page=1 | 0m0.253s | 0m0.406s | 0m0.255s 704s |
(# of obj: 4000) | listAll=true&pagesize=800&page=1 | 0m2.105s | 0m3.526s | 0m3.952s 484s |
| listAll=true&pagesize=1500&page=1 | 0m2.485s | 0m12.411s | 0m7 0m6.324s 792s |
| listAll=true&pagesize=3000&page=1 | 0m6.975s | 0m14.739s | 0m15 0m14.287s 165s |
| listAll=true | 0m6.787s | 0m22.466s | 0m19.541s 312s |
|
|
|
|
|
listVirtualMachines | listAll=true&pagesize=100&page=1 | 0m1.671s | 0m3 0m9.581s 009s 0m3 | 0m2.317s 464s |
(# of obj: 8000) | listAll=true&pagesize=800&page=1 | 0m9.191s | 0m17 0m25.339s 621s | 0m16 0m14.868s 625s |
| listAll=true&pagesize=1500&page=1 | 0m13.068s | 0m27 0m20.626s 737s | 0m30 0m26.018s 461s |
| listAll=true&pagesize=3000&page=1 | 0m22.950s | 1m2 0m18.380s 503s | 1m3 0m51.870s 964s |
| listAll=true&pagesize=5000&page=1 | 0m35.443s | 1m46 0m18.912s 503s |
|
| listAll=true |
| 4m22 1m16.583s 001s 3m39. | 531s |
|
|
|
|
|
listVolumes | listAll=true&pagesize=100&page=1 | 0m0.830s | 0m4 0m0.162s 889s | 0m1.232s 092s |
(# of obj: 8000) | listAll=true&pagesize=800&page=1 | 0m3.900s | 0m8 0m7.611s 091s 0m8 | 0m7.176s 148s |
| listAll=true&pagesize=1500&page=1 | 0m5.887s | 0m16 0m13.396s 906s | 0m14 0m13.686s 077s |
| listAll=true&pagesize=3000&page=1 | 0m11.037s | 0m31 0m8.817s 737s | 0m28 0m27.245s 093s |
| listAll=true&pagesize=5000&page=1 | 0m18.859s | 0m51 0m40.160s 966s | 1m9.951s |
| listAll=true |
| 1m55 0m0.314s 526s 1m45. | 933s |
|
|
|
|
|
listStoragePools | listAll=true&pagesize=100&page=1 | 0m0.313s | 0m0.141s 526s | 0m0.647s 346s |
(# of obj: 248) | listAll=true | 0m0.454s | 0m2 0m1.497s 115s 0m2 | 0m1.772s 182s |
|
|
|
|
|
listProjects | listAll=true&pagesize=100&page=1 | 0m0.304s | 0m27.884s |
|
| listAll=true&pagesize=800&page=1 | 0m1.019s | 4m5.661s |
|
| listAll=true&pagesize=1500&page=1 | 0m1.696s |
|
|
| listAll=true&pagesize=3000&page=1 | 0m2.986s |
|
|
| listAll=true | 0m5.213s |
|
|
|
|
|
|
|
listProjectAccounts | listAll=true&projectid=3 | 0m33.247s |
|
|
| listAll=true&projectid=4 | 0m15.992s |
|
|
| listAll=true |
| 0m13.772s |
|
|
|
|
|
|
listProjectInvitations | listAll=true&pagesize=100&page=1 | 0m0.129s |
|
|
| listAll=true&pagesize=800&page=1 | 0m0.515s |
|
|
| listAll=true | 0m0.843s |
|
|
|
|
|
|
|
listAsyncJobs | listAll=true&pagesize=100&page=120 | 0m0.544s 0m1.936s |
| 0m2.157s 210s |
(# of obj: 12000) | listAll=true&pagesize=800&page=5 | 0m8.027s | 0m22 0m21.543s 987s | 0m19 0m18.571s 309s |
| listAll=true&pagesize=1500&page=6 | 0m1.856s | 0m48 0m29.073s 040s | 0m32 0m36.670s 051s |
| listAll=true&pagesize=3000&page=3 | 0m3.396s | 1m7 0m27.712s 300s 1m7 | 1m3.141s 663s |
| listAll=true&pagesize=5000&page=3 |
| 2m5 1m49.570s 942s | 1m57 1m50.502s 274s |
| listAll=true&pagesize=8000&page=1 | 0m7.731s |
|
|
| listAll=true | 0m9.139s | 4m29.778s | 4m18.513s |
|
|
|
|
|
listTags | listAll=true&pagesize=100&page=1 | 0m0.306s |
|
|
| listAll=true&resourcetype=UserVm | 0m1.023s |
|
|
| listAll=true&resourcetype=Volume | 0m0.704s |
|
|
| listAll=true&key=<somekey> | 0m0.469s |
|
|
| listAll=true&resourcetype=Volume&key=<somekey> | 0m0.113s |
|
|
| listAll=true&resourcetype=Volume&value=<somekey> | 0m0.113s |
|
|
| listAll=true | 0m2.048s |
|
|
|
|
|
|
|
listProjects | listAll=true&pagesize=100&page=1 | 0m0.978s |
|
|
| listAll=true&pagesize=800&page=1 | 0m0.504s |
|
|
| listAll=true&pagesize=1500&page=1 | 0m0.737s |
|
|
| listAll=true&pagesize=3000&page=1 | 0m0.573s |
|
|
| listAll=true | 0m4.243s |
|
|
|
|
|
|
|
listSecurityGroups | listAll=true&pagesize=100&page=1 | 0m9.681s |
|
|
| listAll=true&pagesize=800&page=1 | 0m12.481s |
|
|
| listAll=true&keyword=<somekeyword> | 0m7.411s |
|
|
| listAll=true&pagesize=1500&page=1 | 0m16.394s |
|
|
| listAll=true&pagesize=3000&page=1 | 0m20.719s |
|
|
| listAll=true | 0m26.439s | 1m32.254s |
|
Overview
Content Tools
Apps