THIS IS A TEST INSTANCE. ALL YOUR CHANGES WILL BE LOST!!!!
Page History
Plan is to perform the tests for List API in multiple iterations. Each iteration will differ in terms of server configuration, number of List APIs executed etc.
...
Details are mentioned against each iteration.
...
Following outlines the results for Test Execution of few List API which were optimized as part of API re-factoring.
...
Base Line Numbers Before API Optimization:
...
Uploaded the baseline numbers which were recorded before API Optimization here:
https://cwiki.apache.org/confluence/display/CLOUDSTACK/Performance+Test+Baselines
Test Results for 4.1
...
Tests were carried out in two Iterations to start with, each iteration differs mostly in the configuration. The configuration used during ITERATION 2 is similar to the ones used with the Base Line Runs.
ITERATION 1:
Following configuration was used for this run:
Management Server :
8 proc Intel(R) Xeon(R) CPU E5620 @ 2.40GHz processor
CentOS release 6.3 (Final)
Database:
8 proc Intel(R) Xeon(R) CPU E5620 @ 2.40GHz processor
...
mysql configuration attached here: my.cnf.txt
Following are the results so far:
...
...
API
...
Parameters
...
Time taken for getting the complete response
...
Comments
...
...
...
...
...
...
1. listAccounts API: Total # of accounts: 2117
...
...
listAccounts
...
listAll=true&pagesize=200
...
> 5mins
...
Didn’t complete - response object was empty at the end of 5 mins
...
...
listAccounts
...
listAll=true
...
> 16 mins
...
Didn’t complete - response object was empty at the end of 16 mins
...
...
listAccounts
...
listAll=true
...
9 mins
...
2nd attempt - Failed with OOME within 9 mins
...
...
listAccounts
...
listAll=true
...
7 mins
...
2nd attempt - Failed with OOME within 7 mins
...
...
...
...
...
...
...
...
...
...
...
2. listRouters API: Total # of Domain Routers: 2206
...
...
...
...
...
...
...
listRouters
...
listAll=true&pagesize=100&page=1
...
0m15.112s
...
Returned 100 objects
...
...
listRouters
...
listAll=true&pagesize=800&page=1
...
0m19.080s
...
Returned 800 objects
...
...
listRouters
...
listAll=true&pagesize=1500&page=1
...
0m20.727s
...
Returned 1500 objects
...
...
listRouters
...
listAll=true
...
0m27.520s
...
Returned 2206 (= the #of objects)
...
...
...
...
...
...
3. listEvents API: Total # of Events in DB: 4426
...
...
...
...
...
...
...
listEvents
...
listAll=true&pagesize=100&page=1
...
0m2.093s
...
Returned 100 objects
...
...
listEvents
...
listAll=true&pagesize=800&page=1
...
0m1.822s
...
Returned 800 objects
...
...
listEvents
...
listAll=true&pagesize=1500&page=1
...
0m3.083s
...
Returned 1500 objects
...
...
listEvents
...
listAll=true&pagesize=3000&page=1
...
0m3.751s
...
Returned 3000 objects
...
...
listEvents
...
listAll=true
...
0m4.698s
...
Returned all 4426 objects
...
...
...
...
...
...
4. listHosts API: Total # of Hosts: 1986
...
...
...
...
...
...
...
listHosts
...
listAll=true&pagesize=100&page=1
...
0m2.914s
...
Returned 100 objects
...
...
listHosts
...
listAll=true&pagesize=800&page=1
...
0m9.139s
...
Returned 800 objects
...
...
listHosts
...
listAll=true&pagesize=1500&page=1
...
0m16.608s
...
Returned 1500 objects
...
...
listHosts
...
listAll=true
...
0m25.269s
...
Returned all 1986 objects
...
...
...
...
...
...
5. listUsers API: Total # of Users: 2116
...
...
...
...
...
...
...
listUsers
...
listAll=true&pagesize=100&page=1
...
0m38.827s
...
Returned 100 objects
...
...
listUsers
...
listAll=true&pagesize=800&page=1
...
6m2.565s
...
Returned 800 objects
...
...
listUsers
...
listAll=true&pagesize=1500&page=1
...
6m48.526s
...
Returned 1500 objects
...
...
listUsers
...
listAll=true&pagesize=3000&page=1
...
14m34.643s
...
Returned 2116 (= the #of objects)
...
...
listUsers
...
listAll=true
...
same as above
...
same as above
...
...
...
...
...
...
...
...
...
...
...
6. listVirtualMachines API: Total # of User VMs: 3299
...
...
...
...
...
...
...
listVirtualMachines
...
listAll=true&pagesize=100&page=1
...
0m16.526s
...
Returned 100 objects
...
...
listVirtualMachines
...
listAll=true&pagesize=800&page=1
...
0m20.336s
...
Returned 800 objects
...
...
listVirtualMachines
...
listAll=true&pagesize=1500&page=1
...
0m26.638s
...
Returned 1500 objects
...
...
listVirtualMachines
...
listAll=true&pagesize=3000&page=1
...
0m28.418s
...
Returned 3000 objects
...
...
listVirtualMachines
...
listAll=true
...
0m33.281s
...
Returned all 3299 objects
...
...
...
...
...
...
...
...
...
...
...
7. listVolumes API: Total # of User Volumes: 3299
...
...
listVolumes
...
listAll=true&pagesize=100&page=1
...
0m6.265s
...
Returned 100 objects
...
...
listVolumes
...
listAll=true&pagesize=800&page=1
...
0m8.811s
...
Returned 800 objects
...
...
listVolumes
...
listAll=true&pagesize=1500&page=1
...
0m10.315s
...
Returned 1500 objects
...
...
listVolumes
...
listAll=true&pagesize=3000&page=1
...
0m15.279s
...
Returned 3000 objects
...
...
listVolumes
...
listAll=true
...
0m18.518s
...
Returned all 3299 objects
...
...
...
...
...
...
8. listStoragePools API: Total # of Storage pools: 248
...
...
...
...
...
...
...
listStoragePools
...
listAll=true&pagesize=100&page=1
...
3m32.399s
...
Returned 100 objects
Results:
https://cwiki.apache.org/confluence/display/CLOUDSTACK/List+API+Perf+Results+Iteration+1
ITERATION 2:
Following configuration was used for this run:
Management Server :
Dual core Intel(R) Xeon(R) CPU processor, 2.27GHz, ht enabled, 4 processor
Database:
Quad-Core AMD Opteron(tm) Processor, 2.1GHz, ht enabled, 8 processor
CentOS release 6.2 (Final), x86_64
MySQL-server-5.5.21-1.linux2.6.x86_64 (InnoDB engine)
mysql configuration - same as Iteration 1
Results:
https://cwiki.apache.org/confluence/display/CLOUDSTACK/List+API+Perf+Results+Iteration+2
OVERALL RESULTS:
For the ITERATION 2 which used the same configuration as baseline runs, the results were same or better.
...
...
listStoragePools
...
listAll=true
...
Didn’t complete by 20 mins
...
Overview
Content Tools
Apps