DUE TO SPAM, SIGN-UP IS DISABLED. Goto Selfserve wiki signup and request an account.
Page History
This is an exercise to extract unsupported tests on simulator from the existing smoke and regression integration test suites.
Here is the list of automated smoke/BVT/sanity tests which needs to be reviewed. There is a column 'type' added with the following values
- self service
- provisioning
- unsupported
- test issue
- Not Run -skipped test
- skipped tests need to be run manually.
- test issues need to be fixed an re run.
BVT Report - advanced zone:
...
| Sl. No. | test case | status | Error Description | Type | Comment |
| 1 | test_DeployVmAntiAffinityGroup | PASSED | None | self service |
|
| 2 | test_deploy_vm | PASSED | None | self service | |
| 3 | test_deployvm_userdata | PASSED | None | self service | |
| 4 | test_deployvm_userdata_post | PASSED | None | self service | |
| 5 | test_deployvm_firstfit | PASSED | None | self service | |
| 6 | test_deployvm_userconcentrated | PASSED | None | self service | |
| 7 | test_deployvm_userdispersing | PASSED | None | self service | |
| 8 | test_01_create_disk_offering | PASSED | None | self service | |
| 9 | test_02_edit_disk_offering | PASSED | None | self service | |
| 10 | test_03_delete_disk_offering | PASSED | None | self service | |
| 11 | test_UpdateConfigParamWithScope | PASSED | None | self service | |
| 12 | test_dedicateGuestVlanRange | PASSED | None | self service | |
| 13 | test_internallb | PASSED | None | self service | |
| 14 | test_01_create_iso | PASSED | None | self service | |
| 15 | test_02_edit_iso | PASSED | None | self service | |
| 16 | test_03_delete_iso | FAILED | Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to delete ISO'} | self service | Rajani: this can be fixed by implementing deleteAsync in SimulatorImageStoreDriverImpl.java (Fixed this locally. will push after more testing) |
| 17 | test_04_extract_Iso | FAILED | Extract ISO Failed with invalid URL http://192.168.2.3/userdata/9a95de36-9645-40c1-b473-f6665bb9a4f0.iso (ISO id: 297135cd-020a-47cb-ae0d-efb970876eee) | provisioning | This test can be modified for simulator not to download using URL |
| 18 | test_05_iso_permissions | PASSED | None | self service | |
| 19 | test_06_copy_iso | SKIPPED | None | Not Run | |
| 20 | test_01_create_lb_rule_src_nat | FAILED | Connection Failed: SSH failed for VM with IP Address: 192.168.2.8 | provisioning | avoid ssh connection |
| 21 | test_02_create_lb_rule_non_nat | FAILED | Connection Failed: SSH failed for VM with IP Address: 192.168.2.8: SSH failed for VM with IP Address: 192.168.2.8 | provisioning | avoid ssh connection |
| 22 | test_assign_and_removal_lb | FAILED | Connection Failed: SSH failed for VM with IP Address: 192.168.2.8 | provisioning | avoid ssh connection |
| 23 | test_nic_secondaryip_add_remove | PASSED | None | self service | |
| 24 | test_delete_account | PASSED | None | self service | |
| 25 | test_01_port_fwd_on_src_nat | FAILED | SSH Access failed for 10.1.1.56: SSH connection has Failed. Waited 600s. Error is Connection Failed | provisioning | avoid ssh connection |
| 26 | test_02_port_fwd_on_non_src_nat | FAILED | SSH Access failed for 10.1.1.56: SSH connection has Failed. Waited 600s. Error is Connection Failed | provisioning | avoid ssh connection |
| 27 | test_public_ip_admin_account | PASSED | None | self service | |
| 28 | test_public_ip_user_account | PASSED | None | self service | |
| 29 | test_reboot_router | FAILED | SSH Access failed for 192.168.2.5: Connection Failed | provisioning | avoid ssh connection |
| 30 | test_releaseIP | PASSED | None | self service | |
| 31 | test_network_acl | PASSED | None | self service | |
| 32 | test_01_nic | PASSED | None | self service | |
| 33 | test_extendPhysicalNetworkVlan | PASSED | None | self service | |
| 34 | test_createPortablePublicIPAcquire | PASSED | None | self service | |
| 35 | test_createPortablePublicIPRange | PASSED | None | self service | |
| 36 | test_01_primary_storage_iscsi | PASSED | None | self service | |
| 37 | test_01_primary_storage_nfs | PASSED | None | self service | |
| 38 | test_privategw_acl | PASSED | None | self service | |
| 39 | test_dedicatePublicIpRange | PASSED | None | self service | |
| 40 | test_create_pvlan_network | PASSED | None | self service | |
| 41 | test_createRegion | PASSED | None | self service | |
| 42 | test_01_reset_vm_on_reboot | PASSED | None | self service | |
| 43 | test_01_updatevolumedetail | PASSED | None | self service | |
| 44 | test_01_router_internal_basic | SKIPPED | None | Not Run | |
| 45 | test_02_router_internal_adv | SKIPPED | None | Not Run | |
| 46 | test_03_restart_network_cleanup | PASSED | None | self service | |
| 47 | test_04_restart_network_wo_cleanup | SKIPPED | None | Not Run | |
| 48 | test_05_router_basic | PASSED | None | self service | |
| 49 | test_06_router_advanced | PASSED | None | self service | |
| 50 | test_07_stop_router | PASSED | None | self service | |
| 51 | test_08_start_router | PASSED | None | self service | |
| 52 | test_09_reboot_router | PASSED | NoneNone | self service | |
| 53 | test_01_scale_vm | FAILED | Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'This operation not permitted for this hypervisor of the vm'} | Unsupported | unsupported |
| 54 | test_01_sys_vm_start | PASSED | None | self service | |
| 55 | test_02_sys_template_ready | PASSED | None | self service | |
| 56 | test_01_create_service_offering | PASSED | None | self service | |
| 57 | test_02_edit_service_offering | PASSED | None | self service | |
| 58 | test_03_delete_service_offering | PASSED | None | self service | |
| 59 | test_04_change_offering_small | FAILED | SSH Access failed for 10.1.1.130: SSH connection has Failed. Waited 600s. Error is Connection Failed | provisioning | avoid ssh connection |
| 60 | test_01_snapshot_root_disk | FAILED | 'simulator' | provisioning | Test script needs to be changed for simulator to avoid checking the existence of snapshot on secondary |
| 61 | test_01_list_sec_storage_vm | PASSED | None | self service | |
| 62 | test_02_list_cpvm_vm | PASSED | None | self service | |
| 63 | test_03_ssvm_internals | SKIPPED | None | Not Run | |
| 64 | test_04_cpvm_internals | SKIPPED | None | Not Run | |
| 65 | test_05_stop_ssvm | SKIPPED | None | Not Run | |
| 66 | test_06_stop_cpvm | SKIPPED | None | Not Run | |
| 67 | test_07_reboot_ssvm | SKIPPED | None | Not Run | |
| 68 | test_08_reboot_cpvm | SKIPPED | None | Not Run | |
| 69 | test_09_destroy_ssvm | SKIPPED | None | Not Run | |
| 70 | test_10_destroy_cpvm | SKIPPED | None | Not Run | |
| 71 | test_01_create_template | FAILED | Warning: Exception during cleanup : Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to delete template'} | self service | Delete template/ISO is eventually removing the entry from DB but errors out while trying to delete it from backend. |
| 72 | test_02_edit_template | PASSED | None | self service | |
| 73 | test_03_delete_template | FAILED | Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to delete template'} | self service | Delete template/ISO is eventually removing the entry from DB but errors out while trying to delete it from backend. |
| 74 | test_04_extract_template | FAILED | Extract Template Failed with invalid URL http://192.168.2.3/userdata/d408cfd8-bf7f-47ef-9aa0-84c353d24221.raw (template id: 31ea9fe5-3a0b-4425-b4ca-7aa9e0695605) | provisioning
| This test can be modified for simulator not to download using URL |
| 75 | test_05_template_permissions | PASSED | None | self service | |
| 76 | test_06_copy_template | SKIPPED | None | Not Run | |
| 77 | test_07_list_public_templates | PASSED | None | self service | |
| 78 | test_08_list_system_templates | PASSED | None | self service | |
| 79 | test_advZoneVirtualRouter | PASSED | None | self service | |
| 80 | test_deploy_vm | PASSED | None | self service | |
| 81 | test_01_stop_vm | PASSED | None | self service | |
| 82 | test_02_start_vm | PASSED | None | self service | |
| 83 | test_03_reboot_vm | PASSED | None | self service | |
| 84 | test_06_destroy_vm | PASSED | None | self service | |
| 85 | test_07_restore_vm | PASSED | None | self service | |
| 86 | test_08_migrate_vm | PASSED | None | self service | |
| 87 | test_09_expunge_vm | PASSED | None | self service | |
| 88 | test_10_attachAndDetach_iso | FAILED | SSH failed for virtual machine: 10.1.1.62 - SSH connection has Failed. Waited 600s. Error is Connection Failed | provisioning | avoid ssh connection |
| 89 | test_01_create_vm_snapshots | FAILED | SSH failed for Virtual machine: 10.1.1.44 | provisioning | avoid ssh connection |
| 90 | test_02_revert_vm_snapshots | FAILED | SSH failed for Virtual machine: 10.1.1.44 | provisioning | avoid ssh connection |
| 91 | test_03_delete_vm_snapshots | FAILED | Check list response returns a valid list | provisioning | |
| 92 | test_01_create_volume | FAILED | Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Command failed due to Internal Server Error'} | provisioning | attach volume is failing |
| 93 | test_02_attach_volume | FAILED | Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Command failed due to Internal Server Error'} | provisioning | attach volume is failing |
| 94 | test_03_download_attached_volume | FAILED | Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Command failed due to Internal Server Error'} | provisioning | attach volume is failing |
| 95 | test_04_delete_attached_volume | FAILED | Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Command failed due to Internal Server Error'} | provisioning | attach volume is failing |
| 96 | test_05_detach_volume | FAILED | Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Command failed due to Internal Server Error'} | provisioning | attach volume is failing |
| 97 | test_06_download_detached_volume | FAILED | Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Command failed due to Internal Server Error'} | provisioning | attach volume is failing |
| 98 | test_07_resize_fail | FAILED | Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Command failed due to Internal Server Error'} | provisioning | attach volume is failing |
| 99 | test_08_resize_volume | FAILED | Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Command failed due to Internal Server Error'} | provisioning | attach volume is failing |
| 100 | test_09_delete_detached_volume | FAILED | Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Command failed due to Internal Server Error'} | provisioning | attach volume is failing |
| 101 | test_vpc_remote_access_vpn | FAILED | Execute cmd: asyncquery failed, due to: {errorcode : 534, errortext : u'Resource [DataCenter:1] is unreachable: Unable to start vpn: Unable to add users to vpn in zone 1 for account 31 on domR: r-9-QA due to Unsupported command issued:com.cloud.agent.api.routing.VpnUsersCfgCommand. Are you sure you got the right type of server?'} | provisioning
| vpn user creation is failing |
| 102 | test_vpc_site2site_vpn | PASSED | None | self service |
Test Report Analysis:
29 out of 102 smoke tests failed.
...
Overview
Content Tools