Goals:

  • Core Feature validation of ASF CS 4.0 RC drop. 
  • Fresh and Upgrade installation validation from Cloudstack 3.0.2 -> ASF CS 4.0

Resources: 

Team Members : 7

  • Abhinav
  • Chandan
  • Prashant
  • Sadhu
  • Sailaja
  • Shweta
  • Sowmya
  • Need help with "Open " Line items from community
  • Also need help with testing KVM HV

NOTE:   All QA engineers needs to  use existing test cases, if you see gaps go ahead and fill it

TESTING ACTIVITIES:

Primary Area                        

Status
Xen 6.0.2       

Status
ESXi 5.x
(HOLD)

Status
KVM

Start       Date        

End Date        

Testing Details 

QA Engineer

Comment

Installation / Upgrade

Fresh install on Ubuntu 12.04- DONE
(Advanced Zone)

Fresh install on CentOS/Rhel 6.3-  DONE
(Advanced Zone) 

 

Ubuntu 12.04 - Advanced Zone
DONE

Rhel 6.3 - Advanced Zone
DONE

[https://issues.apache.org/jira/browse/CLOUDSTACK-131 ]
(Fixed but yet to be tested because of below  blockers)

https://issues.apache.org/jira/browse/CLOUDSTACK-182


[https://issues.apache.org/jira/browse/CLOUDSTACK-181
]

https://issues.apache.org/jira/browse/CLOUDSTACK-120

10 Sept 2012

12 Sept 2012

Fresh Install / Quick Install - Ubuntu 12.04, CentOS/Rhel 6.3 ( Supported HV patches)

Abhinav

The install is working fine with workaround for few small issues.

Fresh install on RHEL 6.3 ( Basic Zone)

Fresh install on RHEL6.3 of MS
& Hypervisor Xen 6.0.2
(Basic Zone )-DONE

 

Fresh install on Rhel 6.3 of MS & 
Hypervisor RHEL6.3(KVM)
(Basic Zone)-Done

 

12th Sep

1-Fresh install on RHEL 6.3 & Xen 6.0.2 in Basic Zone

2-Fresh install on RHEL 6.3 & RHEL6.3(KVM) in Basic Zone
 

Prashant

 

Quick install KVM (Rhel 6.3) 

 

 

DONE

 

 

 

 

 

Upgrade from 3.0.2 -> ASF 4.0

DONE
(Advanced Zone)


 

DONE
https://issues.apache.org/jira/browse/CLOUDSTACK-248

13 Sept 2012

18 Sept 2012

Upgrade from 3.0.2 -> ASF 4.0 ( Supported HV patches)

Abhinav

Errors were seen after upgrade.
 
https://issues.apache.org/jira/browse/CLOUDSTACK-126

https://issues.apache.org/jira/browse/CLOUDSTACK-127

Upgrade from 2.2.14-> ASF 4.0

 

 

 

 

 

 

Abhinav

 

Automation BVTs

Not Started

 

 

Daily

 

Run BVTs on ASF CS 4.0 RC builds

Ahmad/ Prasanna

 

Management Server

DONE
DONE
DONE
DONE

 

DONE
DONE
DONE
DONE

11 Sept , 2012

25 Sept , 2012

Generic UI,
Dashboard,
Accounts & Domains,
Projects,




Abhinav

 

 

 

 

 

13 Sept, 2012

21 Sept, 2012

Cluster Mgmt Server 

Angeline

 

 

 

 

 

 

 

Additional Topics ??

 

 

 

DONE
DONE
DONE
DONE
To be executed for all features

 

 

Sept 10, 2012

Sept 25, 2012

Global Config Parameters ,
Primary and Secondary storage NFS ,
Local Storage concepts,
Storage Migration
VMware

Sowmya


 

 

 

 

 

 

 

 

 

Networking

DONE
DONE
DONE
DONE
DONE

 

DONE

Sept 3, 2012

Sept 18, 2012

Guest Network[sailajam],
DomR[sailajam],
Netscaler

Ingress and Egress rules (Security Groups),
Redundant Virtual Router

Sailaja



 

 

DONE

 

 

 

 

Shared Network concepts

Chandan

 

 

 

DONE

 

 

 

 

F5

Chandan

Status on Oct 3rd: 10 more cases left. Filed bug https://issues.apache.org/jira/browse/CLOUDSTACK-252. Should be able to complete by October 4th PST.

 

 

In Progress

 

 

 

 

Multiple Physical Networks

Chandan

 

 

 

DONE

 

 

 

 

Concepts around Firewall and load balancer,

Chandan

 

 

 

DONE

 

 

 

 

Network Domain

Chandan

 

 

 

 

 

 

 

 

EIP and ELB

-

 

 

 

Done

 

Done

 

 

VPN

Sadhu

Usage case is blocked to usage server start problem ,Observed same kind of problems in KVM also

 

 

 

 

 

 

 

SRX

Angie

 

 

DONE

 

Done(KVM/Advance zone)

 

 

Static Nat and Source NAT

Sadhu

2 issues reported

 

 

 

 

 

 

 

 

 

Hypervisor and Guest OS

Progress (70%)

 

 

Sept 5, 2012

Sept 25, 2012

VM Life Cycle (Shweta),
Snapshot mgmt(Shweta),
Templates/ISOs, Volumes,
Multiple Zones ,
Host maintenance


Shweta

Snapshots in Xen is done.
 Template, ISO, Volumes are done.

Note: Recurring snapshots are blocked

 

VR, RVR

 

 

 

 

Run P1, P2 test cases of VR, RVR

Shweta

 

 

DONE


DONE

 

 

Zones,  Pods,  Clusters, Hosts ( all operations) (Zone/Pod/Cluster/Host)

Prashant

 

 

In progress(30%)
https://issues.apache.org/jira/browse/CLOUDSTACK-118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ( Blocker issue)
In progress (90%)
DONE

 


1-https://issues.apache.org/jira/browse/CLOUDSTACK-118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ( Blocker issue)

2-https://issues.apache.org/jira/browse/CLOUDSTACK-267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13470718#comment-13470718

going through snapshot related test cases.

3-https://issues.apache.org/jira/browse/CLOUDSTACK-298

4-

https://issues.apache.org/jira/browse/CLOUDSTACK-300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

 

 

Basic Concepts of HA(HA)

Prashant

3 issue reported

 

DONE

 

DONE

 

 

Tags(Tags)

Prashant

Issue reported
1-[https://issues.apache.org/jira/browse/CLOUDSTACK-231
]
2-[https://issues.apache.org/jira/browse/CLOUDSTACK-240]

WS and API

 

 

 

Sept 3, 2012

Sept 18, 2012

EC2 Query Validation ??

Nilesh

 

 

 

 

 

 

 

 

 

 

PSR ( perf/scalability and Reliability)

 

 

 

 

 

 

Open

 

 

 

 

 

 

 

 

 

 

Recovery

 

 

 

 

 

 

Open

 

 

 

 

 

 

 

 

 

 

Interoperability and Integrations

 

 

 

 

 

 

Open

 

 

 

 

 

 

 

 

 

 

Security Review

 

 

 

 

 

 

Open

 

 

 

 

 

 

 

 

 

 

Usability

 

 

 

 

 

 

Open

 

 

 

 

 

 

 

 

 

 

Localization

 

 

 

 

 

 

Open

 

 

 

 

 

 

 

 

 

 

Defect Validation

 

 

 

 

 

 

Open

 

 

 

 

 

 

 

 

 

 

Doc Review

 

 

 

 

 

 

Open

 


  • No labels

2 Comments

  1. Srini, Can you review Bonita and Burbank features and assign them to team who is done with their tasks like inter VLAN, S2S, S3, Dedicated HA, Nexus Vswitch, Tags etc. Sangeetha will cover some during adhoc testing but need to have atleast some sanity validation is needed around these features even though these are tested very recently

  2. prashanth, move your test execution report under ASF CS 4.0 Test Execution so all of the execution reports can be in one place