Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  • Did not find tests for DNS. Rest of the VR services has some basic tests (even for meta data, password service etc).
  • No Service capability specific tests (for eg per account NAT, LB algorithms/stickiness etc)
  • Not all protocol/traffic types/all parameters have tests.
  • No multiple public interface on the VR tests.
  • Most tests verify the CloudStack VR as black box. No extensive verification on VR on expected configuration for Iptables, dnsmasq, haproxy etc
  • no VR upgrade tests
  • not all operation on network rule have tests. For e.g, tests veifying functionality after clean up of a (firewll/pf/static nat) rule



S. NoModuleExisting testsCommentsAdditional Marvin test required
1    
2    
3    
4    
5    
6    
7    
8    
9    
10    
11 VPC Sanity cases

test_vpc.py
test_vpc_network.py
test_vpc_network_pfrules.py
test_vpc_offerings.py
test_vpc_vm_life_cycle.py
test_vpc_distributed_routing_offering.py
test_vpc_network_lbrules.py
test_vpc_network_staticnatrule.py
test_vpc_routers.py -- tests private gateway
test_vpc_vms_deployment.py

Sufficiently covered buy automation 
12VPC RVRtest_vpc_redundant.py

Create a redundant VPC with two networks with two VMs in each network

Create a redundant VPC with 1 Tier, 1 VM, 1 ACL, 1 PF and test Network GC Nics

 

 
13 Inter Vlan Routing  Not sufficiently coveredYes
14 Access Lists test_network.py   
15 Static routes / Private Gateway test_escalations_networks.py  listing pw gateways,  -- No check for traffic flow 
16 Remote access VPN on VPC  Yes
17 Site - Site VPN   Yes
18 Remote Access VPN

 test_escalations_vpncustomergateways.py 

test_vpn_service.py 

 # api test, pagination

# Validate if IPSEC is running on the public, IP by using ike-scan

 
19 VPN Users test_vpn_users.py  VPN remote access user limit tests 

20

 VR + external devices side by side

 test_asa1000v_fw.py

test_bigswitch_bcf.py

  
21    
22    
23    
24    
25    
26    
27