Summary:

-	QA cycle ran for 5 weeks
-	Validation exceeded by 3 days than what has been planned ( replanned ) and took additional 2 days to wrap up the validation of final bits due to changes in packaging of AWS APIs. 
-	We have planned well on OSS validation and non-OSS validation caused some unforeseen issues and need to plan better with this knowledge in future
-	Validated on supported platforms
-	Around 600+ TCs executed with pass rate of 97% ( this is high %age as we executed only regression and also selected test cases were executed for sanity validation )
-	JUNITS passed 100%
-	Unfortunately did not get Marvin tests run but will do it for next release
-	Overall 300 + defects logged with resolution rate of 71% - rest are moved to next release /around 5 are doc  + others in open state. Will close them before voting process ends.  
-	Need to make use of reports from code inspection tools – sonar is running but need to review critical issues and have goals for release to fix those 
-	All results are base lined for future reference

Test Case Execution:

ASF CS 40 QA Execution Plan	 	 	 	 	 	 	
Feature	QA Owner	Total TC	Executed	Pass	Fail	Blocked	Not Run	Comments	
 	 	 	 	 	 	 	 	 	
Install/upgrade	 	 	 	 	 	 	 	 	
Fresh install ( RHEL, Ubuntu, Quick and Fresh)	Abhinav	5	5	5	0	0	0	 	
Upgrade ( RHEL, Ubuntu )	Abhinav	4	4	4	0	0	0	 	
Regression - OSS	 	 	 	 	 	 	 	 	
Management Server	 	 	 	 	 	 	 	 	
Generic UI	Abhinav	4	4	4	 	 	0	 	
Dashboard	Abhinav	20	20	20	0	 	0	 	
accounts and Domain	Abhinav	54	54	53	1	 	0	 	
Projects	Abhinav	40	40	39	1	 	0	 	
Clustered mgmt Server	Angie	20	20	20	 	 	0	Done	
Global Config Parameters	Sowmya	12	12	12	0	 	0	 	
Primary and Secondary Storage	Sowmya	11	11	11	0	 	0	 	
Local Storage	Sowmya	24	24	23	1	 	0	 	
Storage Migration	Sowmya	15	13	13	0	 	2	2 TC not applicable	
Network	 	 	 	 	 	 	0	 	
Guest Network 	Sailaja	6	6	6	0	 	0	 	
DomR	Sailaja	21	21	21	0	 	0	 	
Ingress and Egress Rules	Sailaja	17	17	17	 	 	0	 	
RvR	Sailaja	22	22	22	0	 	0	 	
shared network	Chandan	14	14	13	1	 	0	 	
MPN	Chandan	29	29	28	1	 	0	 	
Firewall and load balancer	Chandan	15	15	15	0	 	0	 	
Network Domain	Chandan	7	7	6	1	 	0	 	
VPN	Suresh	25	25	23	2	 	0	 	
static NAT and Source NAT	Suresh	11	11	9	2	 	0	 	
Inter VLAN	Suresh	15	15	13	2	 	0	Sanity validation done 	
S2S	Suresh	20	20	18	2	 	0	 	
Host Management and Guest OS	 	 	 	 	 	 	0	 	
VM Life Cycle	Shweta	12	12	12	0	 	0	 	
snapshot mgmt	Shweta	40	40	38	2	 	0	 	
Template / ISO	Shweta	16	16	16	0	 	0	 	
volumes	Shweta	12	12	12	0	 	0	 	
Multiple zones	Shweta	2	2	2	0	 	0	 	
Host Maintenance	Shweta	10	10	10	 	 	0	 	
Zones/Pods/Clusters/Hosts	Prashanth	17	17	17	0	 	0	 	
HA	Prashanth	12	12	10	2	 	0	Done -  best effort	
Nexus Vswitch	Sailaja	 	 	 	 	 	 	Out of scope	
Tags	Prashanth	10	10	10	 	 	0	Done	
Non OSS	 	 	 	 	 	 	 	for non oss will do basic validation	
F5	Chandan	 	 	 	 	 	 	Done	
SRX	Angie	 	 	 	 	 	 	Done	
NetScaler	Sailaja	 	 	 	 	 	 	Done	
VMWare	Sowmya	 	 	 	 	 	 	Done	
NetAPP	N/A	 	 	 	 	 	 	Out of scope	
WS and API	Sangeetha/Swamy	 	 	 	 	 	 	Done – tested on all platforms – Did not select specific TC but did validation of major features	
PSR 	Open	 	 	 	 	 	 	 	
Recovery	Open	 	 	 	 	 	 	 	
Interoprability and Integration	Open	 	 	 	 	 	 	 	
security 	Open	 	 	 	 	 	 	 	
Usability	Open	 	 	 	 	 	 	 	
Localization	 	 	 	 	 	 	 	 	
Defect Validation	All	 	 	 	 	 	 	 	
Doc Review	All	 	 	 	 	 	 	 	
 	 	 	 	 	 	 	 	 	
Total TCs	 	542	540	522	18	0	2	 	
Executed %age	 	100%	100%	97%	3%	0%	0%	 	

Defect Metrics: