List API Performance Test Execution

Following outlines the results for Test Execution of few List API which were optimized as part of API re-factoring.

Base Line Numbers Before API Optimization:

Uploaded the baseline numbers which were recorded before API Optimization here:

https://cwiki.apache.org/confluence/display/CLOUDSTACK/Performance+Test+Baselines

Test Results for 4.1

Tests were carried out in two Iterations to start with, each iteration differs mostly in the configuration. The configuration used during ITERATION 2 is similar to the ones used with the Base Line Runs.

ITERATION 1:

Following configuration was used for this run:

Management Server :

8 proc Intel(R) Xeon(R) CPU E5620  @ 2.40GHz processor

CentOS release 6.3 (Final)

Database: 

8 proc Intel(R) Xeon(R) CPU E5620  @ 2.40GHz processor

Red Hat Enterprise Linux Server release 6.2 (Santiago)

MySQL-server-5.5.21-1.linux2.6.x86_64 (InnoDB engine)

mysql configuration attached here: my.cnf.txt

Results:

https://cwiki.apache.org/confluence/display/CLOUDSTACK/List+API+Perf+Results+Iteration+1

ITERATION 2:

Following configuration was used for this run:

Management Server :

Dual core Intel(R) Xeon(R) CPU processor, 2.27GHz, ht enabled, 4 processor

Database:

Quad-Core AMD Opteron(tm) Processor, 2.1GHz, ht enabled, 8 processor

CentOS release 6.2 (Final), x86_64

MySQL-server-5.5.21-1.linux2.6.x86_64 (InnoDB engine)

mysql configuration - same as Iteration 1

Results:

https://cwiki.apache.org/confluence/display/CLOUDSTACK/List+API+Perf+Results+Iteration+2

OVERALL RESULTS:

For the ITERATION 2 which used the same configuration as baseline runs, the results were same or better. 

STATUS:

Following tasks are pending on this execution:

Out of the 15 list APIs, 11 are completed (follow link above for results) and the following APIs are remaining:

1. listVmGroups

2. listProjectInvitations - BLOCKED on CLOUDSTACK-1621

3. listResourceTags

4. listSecurityGroups

Also following task is remaining:

Upgrade from pre 4.1 to 4.1 since this involved DB changes and do a sanity check on all the APIs.