...
...
...
...
Uploaded the baseline numbers which were recorded before API Optimization here:
https://cwiki.apache.org/confluence/display/CLOUDSTACK/Performance+Test+Baselines
Iteration 1:
Tests were carried out in two Iterations to start with, each iteration differs mostly in the configuration. The configuration used during ITERATION 2 is similar to the ones used with the Base Line Runs.
Following configuration was used for this runConfiguration:
Management Server :
8 proc Intel(R) Xeon(R) CPU E5620 @ 2.40GHz processor
CentOS release 6.3 (Final)
Database:
8 proc Intel(R) Xeon(R) CPU E5620 @ 2.40GHz processor
...
mysql configuration attached here: my.cnf.txt
Following are the results so far:
...
...
API
...
Parameters
...
Time taken for getting the complete response
...
Comments
...
...
...
...
...
...
1. listAccounts API: Total # of accounts: 2117
...
...
listAccounts
...
listAll=true&pagesize=200
...
> 5mins
...
Didn’t complete - response object was empty at the end of 5 mins
...
...
listAccounts
...
listAll=true
...
> 16 mins
...
Didn’t complete - response object was empty at the end of 16 mins
...
...
listAccounts
...
listAll=true
...
9 mins
...
2nd attempt - Failed with OOME within 9 mins
...
...
listAccounts
...
listAll=true
...
7 mins
...
2nd attempt - Failed with OOME within 7 mins
...
...
...
...
...
...
...
...
...
...
...
2. listRouters API: Total # of Domain Routers: 2206
...
...
...
...
...
...
...
listRouters
...
listAll=true&pagesize=100&page=1
...
0m15.112s
...
Returned 100 objects
...
...
listRouters
...
listAll=true&pagesize=800&page=1
...
0m19.080s
...
Returned 800 objects
...
...
listRouters
...
listAll=true&pagesize=1500&page=1
...
0m20.727s
...
Returned 1500 objects
...
...
listRouters
...
listAll=true
...
0m27.520s
...
Returned 2206 (= the #of objects)
...
...
...
...
...
...
3. listEvents API: Total # of Events in DB: 4426
...
...
...
...
...
...
...
listEvents
...
listAll=true&pagesize=100&page=1
...
0m2.093s
...
Returned 100 objects
...
...
listEvents
...
listAll=true&pagesize=800&page=1
...
0m1.822s
...
Returned 800 objects
...
...
listEvents
...
listAll=true&pagesize=1500&page=1
...
0m3.083s
...
Returned 1500 objects
...
...
listEvents
...
listAll=true&pagesize=3000&page=1
...
0m3.751s
...
Returned 3000 objects
...
...
listEvents
...
listAll=true
...
0m4.698s
...
Returned all 4426 objects
...
...
...
...
...
...
4. listHosts API: Total # of Hosts: 1986
...
...
...
...
...
...
...
listHosts
...
listAll=true&pagesize=100&page=1
...
0m2.914s
...
Returned 100 objects
...
...
listHosts
...
listAll=true&pagesize=800&page=1
...
0m9.139s
...
Returned 800 objects
...
...
listHosts
...
listAll=true&pagesize=1500&page=1
...
0m16.608s
...
Returned 1500 objects
...
...
listHosts
...
listAll=true
...
0m25.269s
...
Returned all 1986 objects
...
...
...
...
...
...
5. listUsers API: Total # of Users: 2116
...
...
...
...
...
...
...
listUsers
...
listAll=true&pagesize=100&page=1
...
0m38.827s
...
Returned 100 objects
...
...
listUsers
...
listAll=true&pagesize=800&page=1
...
6m2.565s
...
Returned 800 objects
...
...
listUsers
...
listAll=true&pagesize=1500&page=1
...
6m48.526s
...
Returned 1500 objects
...
...
listUsers
...
listAll=true&pagesize=3000&page=1
...
14m34.643s
...
Returned 2116 (= the #of objects)
...
...
listUsers
...
listAll=true
...
same as above
...
same as above
...
...
...
...
...
...
...
...
...
...
...
6. listVirtualMachines API: Total # of User VMs: 3299
...
...
...
...
...
...
...
listVirtualMachines
...
listAll=true&pagesize=100&page=1
...
0m16.526s
...
Returned 100 objects
...
...
listVirtualMachines
...
listAll=true&pagesize=800&page=1
...
0m20.336s
...
Returned 800 objects
...
...
listVirtualMachines
...
listAll=true&pagesize=1500&page=1
...
0m26.638s
...
Returned 1500 objects
...
...
listVirtualMachines
...
listAll=true&pagesize=3000&page=1
...
0m28.418s
...
Returned 3000 objects
...
...
listVirtualMachines
...
listAll=true
...
0m33.281s
...
Returned all 3299 objects
...
...
...
...
...
...
...
...
...
...
...
7. listVolumes API: Total # of User Volumes: 3299
...
...
listVolumes
...
listAll=true&pagesize=100&page=1
...
0m6.265s
...
Returned 100 objects
...
...
listVolumes
...
listAll=true&pagesize=800&page=1
...
0m8.811s
...
Returned 800 objects
...
...
listVolumes
...
listAll=true&pagesize=1500&page=1
...
0m10.315s
...
Returned 1500 objects
...
...
listVolumes
...
listAll=true&pagesize=3000&page=1
...
0m15.279s
...
Returned 3000 objects
...
...
listVolumes
...
listAll=true
...
0m18.518s
...
Returned all 3299 objects
...
...
...
...
...
...
8. listStoragePools API: Total # of Storage pools: 248
...
...
...
...
...
...
...
listStoragePools
...
listAll=true&pagesize=100&page=1
...
3m32.399s
...
Returned 100 objects
Results:
https://cwiki.apache.org/confluence/display/CLOUDSTACK/List+API+Perf+Results+Iteration+1
Following configuration was used for this run:
Management Server :
Dual core Intel(R) Xeon(R) CPU processor, 2.27GHz, ht enabled, 4 processor
Database:
Quad-Core AMD Opteron(tm) Processor, 2.1GHz, ht enabled, 8 processor
CentOS release 6.2 (Final), x86_64
MySQL-server-5.5.21-1.linux2.6.x86_64 (InnoDB engine)
mysql configuration - same as Iteration 1
Results:
https://cwiki.apache.org/confluence/display/CLOUDSTACK/List+API+Perf+Results+Iteration+2
For the ITERATION 2 which used the same configuration as baseline runs, the results were same or better.
...
...
listStoragePools
...
listAll=true
...
Didn’t complete by 20 mins
...