...
S. No | Module | Existing tests | Comments | Additional Marvin test required | |||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
1 | |||||||||||||||||||
2 | |||||||||||||||||||
3 | |||||||||||||||||||
4 | |||||||||||||||||||
5 | |||||||||||||||||||
6 | |||||||||||||||||||
7 | |||||||||||||||||||
8 | |||||||||||||||||||
Egress Firewall Rules | test_egress_fw_rules.py | Tests sufficiently covers TCP, ICMP protocols for both deny/allow default network offering behaviors. | CLOUDSTACK-9487: Egress rules marvin tests for UDP | ||||||||||||||||
2 | Network services | test_network.py test_routers.py test_ha_proxy.py test_load_balancer.py test_security_groups.py test_vpn_service.py test_egress_fw_rules.py test_reset_ssh_keypair.py
| Most of the services has test cases except for DNS | CLOUDSTACK-9488: marvin tests for DNS | |||||||||||||||
3 | Persistent Networks | test_persistent_networks.py | Sufficiently automated | ||||||||||||||||
4 | Firewall and LoadBalancer | Sufficiently automated | |||||||||||||||||
5 | Password Reset Service | test_vm_passwdenabled.py | covers password reset of the VM and VM password functionality | ||||||||||||||||
6 | Reset SSh Key pair | test_reset_ssh_keypair.py | Sufficiently automated | ||||||||||||||||
7 | Network Update on RVR - CIDR , Network Offerings change9 | ||||||||||||||||||
8 | 10 | ||||||||||||||||||
9 | Network Update on Isolated VR's - CIDR , NW Offerings change | 11 | Sufficiently automated | VPC Sanity casestest_vpc.py test_vpc_network.py | |||||||||||||||
10 | Redundant Virtual Routers | test_vpcredundant_networkrouter_pfrulescleanups.py test_redundant_vpcrouter_offeringsservices.py test_vpcredundant_vmrouter_life_cycleupgrades.py smoke: test_vpc_redundent.py | Test sufficiently covers RVR fail over scenarios. | ||||||||||||||||
11 | VPC Sanity cases | test_vpc.py | Sufficiently covered buy automation | ||||||||||||||||
12 | VPC RVR | test_vpc_redundant.py | Create a redundant VPC with two networks with two VMs in each network Create a redundant VPC with 1 Tier, 1 VM, 1 ACL, 1 PF and test Network GC Nics
| ||||||||||||||||
13 | Inter Vlan Routing | Not sufficiently coveredYes |
| ||||||||||||||||
14 | Access Lists | test_network.py | Access Lists | test_network.py | |||||||||||||||
15 | Static routes / Private Gateway | test_escalations_networks.py | listing pw gateways, -- No check for traffic flow | ||||||||||||||||
16 | Remote access VPN on VPC | Yes |
| ||||||||||||||||
17 | Site - Site VPN | Yes | |||||||||||||||||
18 | Remote Access VPN | test_escalations_vpncustomergateways.py test_vpn_service.py | # api test, pagination # Validate if IPSEC is running on the public, IP by using ike-scan | ||||||||||||||||
19 | VPN Users | test_vpn_users.py | VPN remote access user limit tests | ||||||||||||||||
20 | VR + external devices side by side | test_asa1000v_fw.py test_bigswitch_bcf.py | |||||||||||||||||
21 | |||||||||||||||||||
22 | |||||||||||||||||||
23 | |||||||||||||||||||
24 | |||||||||||||||||||
25 | |||||||||||||||||||
| |||||||||||||||||||
18 | Remote Access VPN | test_escalations_vpncustomergateways.py test_vpn_service.py | # api test, pagination # Validate if IPSEC is running on the public, IP by using ike-scan | ||||||||||||||||
19 | VPN Users | test_vpn_users.py | VPN remote access user limit tests | ||||||||||||||||
20 | VR + external devices side by side | test_asa1000v_fw.py test_bigswitch_bcf.py | |||||||||||||||||
21 | Service Monitoring tool in VR | NA | Not covered |
| |||||||||||||||
22 | Shared Network | test_shared_networks.py Tests: | Sufficiently covered buy automation | ||||||||||||||||
23 | Advance Zone using Pvlan | NA | Not covered |
| |||||||||||||||
24 | Manual VR Operations - Stop , start , Destroy ( DomR Testing ) | test_routers.py in components test_routers.py in smoke | Sufficiently covered buy automation | ||||||||||||||||
25 | Security Groups in Basic Zone | test_security_groups.py test_01_authorizeIngressRule | Sufficiently covered buy automation | ||||||||||||||||
26 | Virtual Router Upgrades | Not covered |
| 26 | | ||||||||||||||
27 | |||||||||||||||||||
...