Skip to content

test: improve purge expunged resources b/g task testcase#9426

Merged
yadvr merged 2 commits into
apache:mainfrom
shapeblue:harden-test-expunged
Jul 29, 2024
Merged

test: improve purge expunged resources b/g task testcase#9426
yadvr merged 2 commits into
apache:mainfrom
shapeblue:harden-test-expunged

Conversation

@shwstppr

@shwstppr shwstppr commented Jul 22, 2024

Copy link
Copy Markdown
Contributor

Description

Failures were seen for during purging of expunged resources via bacground task during different test runs. This PR tries to make sure b/g task execution is not skipped after MS restrat in a multi-MS environment. It also updates expunged.resources.purge.interval to allow running task again in 60s.

#9316 (comment)
#9316 (comment)

Types of changes

  • Breaking change (fix or feature that would cause existing functionality to change)
  • New feature (non-breaking change which adds functionality)
  • Bug fix (non-breaking change which fixes an issue)
  • Enhancement (improves an existing feature and functionality)
  • Cleanup (Code refactoring and cleanup, that may add test cases)
  • build/CI
  • test (unit or integration test code)

Feature/Enhancement Scale or Bug Severity

Feature/Enhancement Scale

  • Major
  • Minor

Bug Severity

  • BLOCKER
  • Critical
  • Major
  • Minor
  • Trivial

Screenshots (if appropriate):

How Has This Been Tested?

How did you try to break this feature and the system with this change?

Failures were seen for during purging of expunged resources via
bacground task during different test runs. This PR tries to make sure
b/g task execution is not skipped after MS restrat in a multi-MS
environment. It also updates expunged.resources.purge.interval to allow
running task again in 60s.

Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
@boring-cyborg boring-cyborg Bot added component:integration-test Python Warning... Python code Ahead! labels Jul 22, 2024
@codecov

codecov Bot commented Jul 22, 2024

Copy link
Copy Markdown

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 15.54%. Comparing base (d41dc17) to head (c46b20d).

Additional details and impacted files
@@             Coverage Diff             @@
##               main    #9426     +/-   ##
===========================================
  Coverage     15.54%   15.54%             
  Complexity    11977    11977             
===========================================
  Files          5494     5494             
  Lines        481055   481055             
  Branches      60787    59679   -1108     
===========================================
  Hits          74771    74771             
  Misses       398022   398022             
  Partials       8262     8262             
Flag Coverage Δ
uitests 4.18% <ø> (ø)
unittests 16.31% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@shwstppr

Copy link
Copy Markdown
Contributor Author

@blueorangutan package

@blueorangutan

Copy link
Copy Markdown

@shwstppr a [SL] Jenkins job has been kicked to build packages. It will be bundled with KVM, XenServer and VMware SystemVM templates. I'll keep you posted as I make progress.

@yadvr yadvr added this to the 4.20.0.0 milestone Jul 22, 2024

@DaanHoogland DaanHoogland left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

we should be able to use modern string formatting. other than that LGTM

logging.info("Waiting for 2x%d = %d seconds for background task to execute" % (purge_task_delay, wait))
wait_multiple = 2
wait = wait_multiple * purge_task_delay
logging.info("Waiting for %dx%d = %d seconds for background task to execute" % (wait_multiple, purge_task_delay, wait))

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
logging.info("Waiting for %dx%d = %d seconds for background task to execute" % (wait_multiple, purge_task_delay, wait))
logging.info(f"Waiting for {wait_multiple}x{purge_task_delay} = {wait} seconds for background task to execute")

return False
self.debug("Restarting all management server")
for idx, server_ip in enumerate(server_ips):
self.debug("Restarting management server #%d with IP %s" % (idx, server_ip))

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
self.debug("Restarting management server #%d with IP %s" % (idx, server_ip))
self.debug(f"Restarting management server #{idx} with IP {server_ip}")

@blueorangutan

Copy link
Copy Markdown

Packaging result [SF]: ✔️ el7 ✔️ el8 ✔️ el9 ✔️ debian ✔️ suse15. SL-JID 10435

@DaanHoogland

Copy link
Copy Markdown
Contributor

@blueorangutan test matrix

@blueorangutan

Copy link
Copy Markdown

@DaanHoogland a [SL] Trillian-Jenkins matrix job (centos7 mgmt + xenserver71, rocky8 mgmt + vmware67u3, centos7 mgmt + kvmcentos7) has been kicked to run smoke tests

@blueorangutan

Copy link
Copy Markdown

[SF] Trillian test result (tid-10937)
Environment: xenserver-71 (x2), Advanced Networking with Mgmt server 7
Total time taken: 58318 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr9426-t10937-xenserver-71.zip
Smoke tests completed. 115 look OK, 22 have errors, 0 did not run
Only failed and skipped tests results shown below:

Test Result Time (s) Test File
test_role_account_acls_multiple_mgmt_servers Error 2.21 test_dynamicroles.py
test_query_async_job_result Error 124.48 test_async_job.py
test_revoke_certificate Error 0.01 test_certauthority_root.py
test_configure_ha_provider_invalid Error 0.01 test_hostha_simulator.py
test_configure_ha_provider_valid Error 0.01 test_hostha_simulator.py
test_ha_configure_enabledisable_across_clusterzones Error 0.01 test_hostha_simulator.py
test_ha_disable_feature_invalid Error 0.01 test_hostha_simulator.py
test_ha_enable_feature_invalid Error 0.01 test_hostha_simulator.py
test_ha_list_providers Error 0.01 test_hostha_simulator.py
test_ha_multiple_mgmt_server_ownership Error 0.01 test_hostha_simulator.py
test_ha_verify_fsm_available Error 0.01 test_hostha_simulator.py
test_ha_verify_fsm_degraded Error 0.01 test_hostha_simulator.py
test_ha_verify_fsm_fenced Error 0.01 test_hostha_simulator.py
test_ha_verify_fsm_recovering Error 0.01 test_hostha_simulator.py
test_hostha_configure_default_driver Error 0.01 test_hostha_simulator.py
test_hostha_configure_invalid_provider Error 0.01 test_hostha_simulator.py
test_hostha_disable_feature_valid Error 0.01 test_hostha_simulator.py
test_hostha_enable_feature_valid Error 0.01 test_hostha_simulator.py
test_hostha_enable_feature_without_setting_provider Error 0.01 test_hostha_simulator.py
test_list_ha_for_host Error 0.01 test_hostha_simulator.py
test_list_ha_for_host_invalid Error 0.01 test_hostha_simulator.py
test_list_ha_for_host_valid Error 0.01 test_hostha_simulator.py
test_01_host_ping_on_alert Error 0.07 test_host_ping.py
test_01_host_ping_on_alert Error 0.07 test_host_ping.py
test_01_browser_migrate_template Error 15.35 test_image_store_object_migration.py
test_01_invalid_upgrade_kubernetes_cluster Failure 288.20 test_kubernetes_clusters.py
test_02_upgrade_kubernetes_cluster Failure 295.92 test_kubernetes_clusters.py
test_03_deploy_and_scale_kubernetes_cluster Failure 267.56 test_kubernetes_clusters.py
test_04_autoscale_kubernetes_cluster Failure 286.11 test_kubernetes_clusters.py
test_05_basic_lifecycle_kubernetes_cluster Failure 267.02 test_kubernetes_clusters.py
test_06_delete_kubernetes_cluster Failure 267.44 test_kubernetes_clusters.py
test_08_upgrade_kubernetes_ha_cluster Failure 423.54 test_kubernetes_clusters.py
test_10_vpc_tier_kubernetes_cluster Failure 301.95 test_kubernetes_clusters.py
test_11_test_unmanaged_cluster_lifecycle Error 122.58 test_kubernetes_clusters.py
test_01_add_delete_kubernetes_supported_version Error 0.12 test_kubernetes_supported_versions.py
login_test_saml_user Error 3.15 test_login.py
test_01_deployVMInSharedNetwork Error 115.22 test_network.py
test_03_destroySharedNetwork Failure 1.08 test_network.py
ContextSuite context=TestSharedNetwork>:teardown Error 2.17 test_network.py
test_oobm_issue_power_cycle Error 3.31 test_outofbandmanagement_nestedplugin.py
test_oobm_issue_power_off Error 3.31 test_outofbandmanagement_nestedplugin.py
test_oobm_issue_power_on Error 3.30 test_outofbandmanagement_nestedplugin.py
test_oobm_issue_power_reset Error 3.34 test_outofbandmanagement_nestedplugin.py
test_oobm_issue_power_soft Error 3.30 test_outofbandmanagement_nestedplugin.py
test_oobm_issue_power_status Error 2.26 test_outofbandmanagement_nestedplugin.py
test_oobm_background_powerstate_sync Failure 21.62 test_outofbandmanagement.py
test_oobm_background_powerstate_sync Error 21.62 test_outofbandmanagement.py
test_oobm_configure_default_driver Error 0.07 test_outofbandmanagement.py
test_oobm_configure_invalid_driver Error 0.05 test_outofbandmanagement.py
test_oobm_disable_feature_invalid Error 0.04 test_outofbandmanagement.py
test_oobm_disable_feature_valid Error 1.14 test_outofbandmanagement.py
test_oobm_enable_feature_invalid Error 0.04 test_outofbandmanagement.py
test_oobm_enable_feature_valid Error 0.10 test_outofbandmanagement.py
test_oobm_enabledisable_across_clusterzones Error 11.88 test_outofbandmanagement.py
test_oobm_enabledisable_across_clusterzones Error 11.88 test_outofbandmanagement.py
test_oobm_issue_power_cycle Error 4.33 test_outofbandmanagement.py
test_oobm_issue_power_cycle Error 4.33 test_outofbandmanagement.py
test_oobm_issue_power_off Error 4.35 test_outofbandmanagement.py
test_oobm_issue_power_off Error 4.35 test_outofbandmanagement.py
test_oobm_issue_power_on Error 4.33 test_outofbandmanagement.py
test_oobm_issue_power_on Error 4.33 test_outofbandmanagement.py
test_oobm_issue_power_reset Error 4.34 test_outofbandmanagement.py
test_oobm_issue_power_reset Error 4.34 test_outofbandmanagement.py
test_oobm_issue_power_soft Error 4.34 test_outofbandmanagement.py
test_oobm_issue_power_soft Error 4.35 test_outofbandmanagement.py
test_oobm_issue_power_status Error 3.30 test_outofbandmanagement.py
test_oobm_issue_power_status Error 3.30 test_outofbandmanagement.py
test_oobm_multiple_mgmt_server_ownership Error 1.17 test_outofbandmanagement.py
test_oobm_multiple_mgmt_server_ownership Error 1.18 test_outofbandmanagement.py
test_oobm_zchange_password Error 2.22 test_outofbandmanagement.py
test_oobm_zchange_password Error 2.22 test_outofbandmanagement.py
test_02_edit_primary_storage_tags Error 0.02 test_primary_storage.py
test_01_vpc_privategw_acl Error 0.03 test_privategw_acl_ovs_gre.py
test_03_vpc_privategw_restart_vpc_cleanup Error 0.02 test_privategw_acl_ovs_gre.py
test_05_vpc_privategw_check_interface Error 0.02 test_privategw_acl_ovs_gre.py
test_01_vpc_privategw_acl Error 58.80 test_privategw_acl.py
test_02_vpc_privategw_static_routes Error 280.69 test_privategw_acl.py
test_03_vpc_privategw_restart_vpc_cleanup Error 236.58 test_privategw_acl.py
test_04_rvpc_privategw_static_routes Error 378.83 test_privategw_acl.py
test_01_purge_expunged_api_vm_start_date Error 52.91 test_purge_expunged_vms.py
test_02_purge_expunged_api_vm_end_date Error 57.48 test_purge_expunged_vms.py
test_03_purge_expunged_api_vm_start_end_date Error 65.70 test_purge_expunged_vms.py
test_04_purge_expunged_api_vm_no_date Error 63.40 test_purge_expunged_vms.py
test_05_purge_expunged_vm_service_offering Error 273.21 test_purge_expunged_vms.py
test_06_purge_expunged_vm_background_task Error 471.18 test_purge_expunged_vms.py
test_01_snapshot_root_disk Error 20.66 test_snapshots.py
test_CreateTemplateWithDuplicateName Error 40.19 test_templates.py
test_01_positive_tests_usage Error 10.57 test_usage_events.py
test_01_ISO_usage Error 1.09 test_usage.py
test_01_lb_usage Error 5.24 test_usage.py
test_01_nat_usage Error 9.35 test_usage.py
test_01_public_ip_usage Error 1.08 test_usage.py
test_01_snapshot_usage Error 22.73 test_usage.py
test_01_template_usage Error 8.37 test_usage.py
test_01_vm_usage Error 15.47 test_usage.py
test_01_volume_usage Error 9.63 test_usage.py
test_01_vpn_usage Error 13.61 test_usage.py
test_12_start_vm_multiple_volumes_allocated Error 11.56 test_vm_life_cycle.py
test_01_vmschedule_create Error 0.10 test_vm_schedule.py

@blueorangutan

Copy link
Copy Markdown

[SF] Trillian test result (tid-10939)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 58933 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr9426-t10939-kvm-centos7.zip
Smoke tests completed. 112 look OK, 25 have errors, 0 did not run
Only failed and skipped tests results shown below:

Test Result Time (s) Test File
test_role_account_acls_multiple_mgmt_servers Error 2.26 test_dynamicroles.py
test_query_async_job_result Error 93.72 test_async_job.py
test_revoke_certificate Error 0.01 test_certauthority_root.py
test_configure_ha_provider_invalid Error 0.01 test_hostha_simulator.py
test_configure_ha_provider_valid Error 0.01 test_hostha_simulator.py
test_ha_configure_enabledisable_across_clusterzones Error 0.01 test_hostha_simulator.py
test_ha_disable_feature_invalid Error 0.01 test_hostha_simulator.py
test_ha_enable_feature_invalid Error 0.01 test_hostha_simulator.py
test_ha_list_providers Error 0.01 test_hostha_simulator.py
test_ha_multiple_mgmt_server_ownership Error 0.01 test_hostha_simulator.py
test_ha_verify_fsm_available Error 0.01 test_hostha_simulator.py
test_ha_verify_fsm_degraded Error 0.01 test_hostha_simulator.py
test_ha_verify_fsm_fenced Error 0.01 test_hostha_simulator.py
test_ha_verify_fsm_recovering Error 0.01 test_hostha_simulator.py
test_hostha_configure_default_driver Error 0.01 test_hostha_simulator.py
test_hostha_configure_invalid_provider Error 0.01 test_hostha_simulator.py
test_hostha_disable_feature_valid Error 0.01 test_hostha_simulator.py
test_hostha_enable_feature_valid Error 0.01 test_hostha_simulator.py
test_hostha_enable_feature_without_setting_provider Error 0.01 test_hostha_simulator.py
test_list_ha_for_host Error 0.01 test_hostha_simulator.py
test_list_ha_for_host_invalid Error 0.01 test_hostha_simulator.py
test_list_ha_for_host_valid Error 0.01 test_hostha_simulator.py
test_01_condensed_drs_algorithm Failure 174.57 test_cluster_drs.py
test_02_balanced_drs_algorithm Error 41.73 test_cluster_drs.py
ContextSuite context=TestClusterDRS>:teardown Error 42.83 test_cluster_drs.py
test_01_host_ping_on_alert Error 0.06 test_host_ping.py
test_01_host_ping_on_alert Error 0.07 test_host_ping.py
test_01_browser_migrate_template Error 15.33 test_image_store_object_migration.py
test_01_invalid_upgrade_kubernetes_cluster Failure 245.95 test_kubernetes_clusters.py
test_02_upgrade_kubernetes_cluster Failure 252.34 test_kubernetes_clusters.py
test_03_deploy_and_scale_kubernetes_cluster Failure 219.41 test_kubernetes_clusters.py
test_04_autoscale_kubernetes_cluster Failure 271.95 test_kubernetes_clusters.py
test_05_basic_lifecycle_kubernetes_cluster Failure 248.19 test_kubernetes_clusters.py
test_06_delete_kubernetes_cluster Failure 252.35 test_kubernetes_clusters.py
test_08_upgrade_kubernetes_ha_cluster Failure 340.31 test_kubernetes_clusters.py
test_10_vpc_tier_kubernetes_cluster Failure 259.86 test_kubernetes_clusters.py
test_11_test_unmanaged_cluster_lifecycle Error 85.82 test_kubernetes_clusters.py
test_01_add_delete_kubernetes_supported_version Error 0.12 test_kubernetes_supported_versions.py
login_test_saml_user Error 3.19 test_login.py
test_01_deployVMInSharedNetwork Error 74.20 test_network.py
test_03_destroySharedNetwork Failure 1.07 test_network.py
ContextSuite context=TestSharedNetwork>:teardown Error 2.18 test_network.py
test_oobm_issue_power_cycle Error 3.34 test_outofbandmanagement_nestedplugin.py
test_oobm_issue_power_off Error 3.33 test_outofbandmanagement_nestedplugin.py
test_oobm_issue_power_on Error 3.33 test_outofbandmanagement_nestedplugin.py
test_oobm_issue_power_reset Error 3.35 test_outofbandmanagement_nestedplugin.py
test_oobm_issue_power_soft Error 3.29 test_outofbandmanagement_nestedplugin.py
test_oobm_issue_power_status Error 2.22 test_outofbandmanagement_nestedplugin.py
test_oobm_background_powerstate_sync Failure 21.66 test_outofbandmanagement.py
test_oobm_background_powerstate_sync Error 21.66 test_outofbandmanagement.py
test_oobm_configure_default_driver Error 0.06 test_outofbandmanagement.py
test_oobm_configure_invalid_driver Error 0.05 test_outofbandmanagement.py
test_oobm_disable_feature_invalid Error 0.05 test_outofbandmanagement.py
test_oobm_disable_feature_valid Error 1.15 test_outofbandmanagement.py
test_oobm_enable_feature_invalid Error 0.04 test_outofbandmanagement.py
test_oobm_enable_feature_valid Error 1.13 test_outofbandmanagement.py
test_oobm_enabledisable_across_clusterzones Error 10.82 test_outofbandmanagement.py
test_oobm_enabledisable_across_clusterzones Error 10.82 test_outofbandmanagement.py
test_oobm_issue_power_cycle Error 4.37 test_outofbandmanagement.py
test_oobm_issue_power_cycle Error 4.37 test_outofbandmanagement.py
test_oobm_issue_power_off Error 3.36 test_outofbandmanagement.py
test_oobm_issue_power_off Error 3.36 test_outofbandmanagement.py
test_oobm_issue_power_on Error 3.34 test_outofbandmanagement.py
test_oobm_issue_power_on Error 3.34 test_outofbandmanagement.py
test_oobm_issue_power_reset Error 4.39 test_outofbandmanagement.py
test_oobm_issue_power_reset Error 4.39 test_outofbandmanagement.py
test_oobm_issue_power_soft Error 4.40 test_outofbandmanagement.py
test_oobm_issue_power_soft Error 4.40 test_outofbandmanagement.py
test_oobm_issue_power_status Error 4.36 test_outofbandmanagement.py
test_oobm_issue_power_status Error 4.36 test_outofbandmanagement.py
test_oobm_multiple_mgmt_server_ownership Error 1.17 test_outofbandmanagement.py
test_oobm_multiple_mgmt_server_ownership Error 1.17 test_outofbandmanagement.py
test_oobm_zchange_password Error 2.22 test_outofbandmanagement.py
test_oobm_zchange_password Error 2.22 test_outofbandmanagement.py
test_02_edit_primary_storage_tags Error 0.02 test_primary_storage.py
test_01_primary_storage_scope_change Error 0.07 test_primary_storage_scope.py
test_01_vpc_privategw_acl Error 0.03 test_privategw_acl_ovs_gre.py
test_03_vpc_privategw_restart_vpc_cleanup Error 0.02 test_privategw_acl_ovs_gre.py
test_05_vpc_privategw_check_interface Error 0.02 test_privategw_acl_ovs_gre.py
test_01_vpc_privategw_acl Error 52.74 test_privategw_acl.py
test_02_vpc_privategw_static_routes Error 202.23 test_privategw_acl.py
test_03_vpc_privategw_restart_vpc_cleanup Error 195.71 test_privategw_acl.py
test_04_rvpc_privategw_static_routes Error 316.52 test_privategw_acl.py
test_01_purge_expunged_api_vm_start_date Error 48.68 test_purge_expunged_vms.py
test_02_purge_expunged_api_vm_end_date Error 44.08 test_purge_expunged_vms.py
test_03_purge_expunged_api_vm_start_end_date Error 43.08 test_purge_expunged_vms.py
test_04_purge_expunged_api_vm_no_date Error 40.92 test_purge_expunged_vms.py
test_05_purge_expunged_vm_service_offering Error 269.08 test_purge_expunged_vms.py
test_06_purge_expunged_vm_background_task Error 461.37 test_purge_expunged_vms.py
test_01_snapshot_root_disk Error 4.33 test_snapshots.py
test_CreateTemplateWithDuplicateName Error 19.86 test_templates.py
test_01_register_template_direct_download_flag Error 0.27 test_templates.py
test_01_positive_tests_usage Error 11.43 test_usage_events.py
test_01_ISO_usage Error 1.10 test_usage.py
test_01_lb_usage Error 4.26 test_usage.py
test_01_nat_usage Error 7.29 test_usage.py
test_01_public_ip_usage Error 1.08 test_usage.py
test_01_snapshot_usage Error 29.88 test_usage.py
test_01_template_usage Error 11.45 test_usage.py
test_01_vm_usage Error 133.10 test_usage.py
test_01_volume_usage Error 126.43 test_usage.py
test_01_vpn_usage Error 9.58 test_usage.py
test_03_secured_to_nonsecured_vm_migration Error 394.80 test_vm_life_cycle.py
test_12_start_vm_multiple_volumes_allocated Error 10.54 test_vm_life_cycle.py
test_01_vmschedule_create Error 0.11 test_vm_schedule.py
test_disable_oobm_ha_state_ineligible Error 0.05 test_hostha_kvm.py
test_hostha_configure_default_driver Error 0.05 test_hostha_kvm.py
test_hostha_enable_ha_when_host_disabled Error 0.05 test_hostha_kvm.py
test_hostha_enable_ha_when_host_disconected Error 0.05 test_hostha_kvm.py
test_hostha_enable_ha_when_host_in_maintenance Error 0.05 test_hostha_kvm.py
test_hostha_kvm_host_degraded Error 0.04 test_hostha_kvm.py
test_hostha_kvm_host_fencing Error 0.05 test_hostha_kvm.py
test_hostha_kvm_host_recovering Error 0.05 test_hostha_kvm.py
test_remove_ha_provider_not_possible Error 0.07 test_hostha_kvm.py

@blueorangutan

Copy link
Copy Markdown

[SF] Trillian test result (tid-10938)
Environment: vmware-67u3 (x2), Advanced Networking with Mgmt server r8
Total time taken: 59025 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr9426-t10938-vmware-67u3.zip
Smoke tests completed. 135 look OK, 2 have errors, 0 did not run
Only failed and skipped tests results shown below:

Test Result Time (s) Test File
test_02_restore_vm_with_disk_offering Error 57.21 test_restore_vm.py
test_03_restore_vm_with_disk_offering_custom_size Error 55.21 test_restore_vm.py
test_01_single_VPC_iptables_policies Error 1037.92 test_routers_iptables_default_policy.py

@DaanHoogland

Copy link
Copy Markdown
Contributor

@blueorangutan package

@blueorangutan

Copy link
Copy Markdown

@DaanHoogland a [SL] Jenkins job has been kicked to build packages. It will be bundled with KVM, XenServer and VMware SystemVM templates. I'll keep you posted as I make progress.

@blueorangutan

Copy link
Copy Markdown

Packaging result [SF]: ✔️ el7 ✔️ el8 ✔️ el9 ✔️ debian ✔️ suse15. SL-JID 10446

@DaanHoogland

Copy link
Copy Markdown
Contributor

@blueorangutan test matrix

@blueorangutan

Copy link
Copy Markdown

@DaanHoogland a [SL] Trillian-Jenkins matrix job (centos7 mgmt + xenserver71, rocky8 mgmt + vmware67u3, centos7 mgmt + kvmcentos7) has been kicked to run smoke tests

@blueorangutan

Copy link
Copy Markdown

[SF] Trillian Build Failed (tid-10951)

@blueorangutan

Copy link
Copy Markdown

[SF] Trillian test result (tid-10952)
Environment: vmware-67u3 (x2), Advanced Networking with Mgmt server r8
Total time taken: 54988 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr9426-t10952-vmware-67u3.zip
Smoke tests completed. 136 look OK, 1 have errors, 0 did not run
Only failed and skipped tests results shown below:

Test Result Time (s) Test File
test_02_restore_vm_with_disk_offering Error 61.22 test_restore_vm.py
test_03_restore_vm_with_disk_offering_custom_size Error 55.05 test_restore_vm.py

@blueorangutan

Copy link
Copy Markdown

[SF] Trillian test result (tid-10953)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 55437 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr9426-t10953-kvm-centos7.zip
Smoke tests completed. 113 look OK, 24 have errors, 0 did not run
Only failed and skipped tests results shown below:

Test Result Time (s) Test File
test_role_account_acls_multiple_mgmt_servers Error 2.17 test_dynamicroles.py
test_query_async_job_result Error 96.67 test_async_job.py
test_revoke_certificate Error 0.01 test_certauthority_root.py
test_configure_ha_provider_invalid Error 0.01 test_hostha_simulator.py
test_configure_ha_provider_valid Error 0.01 test_hostha_simulator.py
test_ha_configure_enabledisable_across_clusterzones Error 0.01 test_hostha_simulator.py
test_ha_disable_feature_invalid Error 0.01 test_hostha_simulator.py
test_ha_enable_feature_invalid Error 0.01 test_hostha_simulator.py
test_ha_list_providers Error 0.01 test_hostha_simulator.py
test_ha_multiple_mgmt_server_ownership Error 0.01 test_hostha_simulator.py
test_ha_verify_fsm_available Error 0.01 test_hostha_simulator.py
test_ha_verify_fsm_degraded Error 0.01 test_hostha_simulator.py
test_ha_verify_fsm_fenced Error 0.01 test_hostha_simulator.py
test_ha_verify_fsm_recovering Error 0.01 test_hostha_simulator.py
test_hostha_configure_default_driver Error 0.01 test_hostha_simulator.py
test_hostha_configure_invalid_provider Error 0.01 test_hostha_simulator.py
test_hostha_disable_feature_valid Error 0.01 test_hostha_simulator.py
test_hostha_enable_feature_valid Error 0.01 test_hostha_simulator.py
test_hostha_enable_feature_without_setting_provider Error 0.01 test_hostha_simulator.py
test_list_ha_for_host Error 0.01 test_hostha_simulator.py
test_list_ha_for_host_invalid Error 0.01 test_hostha_simulator.py
test_list_ha_for_host_valid Error 0.01 test_hostha_simulator.py
test_01_host_ping_on_alert Error 0.08 test_host_ping.py
test_01_host_ping_on_alert Error 0.09 test_host_ping.py
test_01_browser_migrate_template Error 15.35 test_image_store_object_migration.py
test_01_invalid_upgrade_kubernetes_cluster Failure 232.16 test_kubernetes_clusters.py
test_02_upgrade_kubernetes_cluster Failure 235.82 test_kubernetes_clusters.py
test_03_deploy_and_scale_kubernetes_cluster Failure 240.33 test_kubernetes_clusters.py
test_04_autoscale_kubernetes_cluster Failure 232.02 test_kubernetes_clusters.py
test_05_basic_lifecycle_kubernetes_cluster Failure 233.13 test_kubernetes_clusters.py
test_06_delete_kubernetes_cluster Failure 238.28 test_kubernetes_clusters.py
test_08_upgrade_kubernetes_ha_cluster Failure 345.88 test_kubernetes_clusters.py
test_10_vpc_tier_kubernetes_cluster Failure 255.38 test_kubernetes_clusters.py
test_11_test_unmanaged_cluster_lifecycle Error 82.70 test_kubernetes_clusters.py
test_01_add_delete_kubernetes_supported_version Error 0.10 test_kubernetes_supported_versions.py
login_test_saml_user Error 2.91 test_login.py
test_01_deployVMInSharedNetwork Error 76.24 test_network.py
test_03_destroySharedNetwork Failure 1.08 test_network.py
ContextSuite context=TestSharedNetwork>:teardown Error 2.18 test_network.py
test_oobm_issue_power_cycle Error 3.34 test_outofbandmanagement_nestedplugin.py
test_oobm_issue_power_off Error 3.29 test_outofbandmanagement_nestedplugin.py
test_oobm_issue_power_on Error 2.27 test_outofbandmanagement_nestedplugin.py
test_oobm_issue_power_reset Error 3.30 test_outofbandmanagement_nestedplugin.py
test_oobm_issue_power_soft Error 3.27 test_outofbandmanagement_nestedplugin.py
test_oobm_issue_power_status Error 2.19 test_outofbandmanagement_nestedplugin.py
test_oobm_background_powerstate_sync Failure 20.60 test_outofbandmanagement.py
test_oobm_background_powerstate_sync Error 20.60 test_outofbandmanagement.py
test_oobm_configure_default_driver Error 0.05 test_outofbandmanagement.py
test_oobm_configure_invalid_driver Error 0.04 test_outofbandmanagement.py
test_oobm_disable_feature_invalid Error 0.04 test_outofbandmanagement.py
test_oobm_disable_feature_valid Error 1.15 test_outofbandmanagement.py
test_oobm_enable_feature_invalid Error 0.05 test_outofbandmanagement.py
test_oobm_enable_feature_valid Error 1.11 test_outofbandmanagement.py
test_oobm_enabledisable_across_clusterzones Error 11.84 test_outofbandmanagement.py
test_oobm_enabledisable_across_clusterzones Error 11.84 test_outofbandmanagement.py
test_oobm_issue_power_cycle Error 4.32 test_outofbandmanagement.py
test_oobm_issue_power_cycle Error 4.32 test_outofbandmanagement.py
test_oobm_issue_power_off Error 4.31 test_outofbandmanagement.py
test_oobm_issue_power_off Error 4.31 test_outofbandmanagement.py
test_oobm_issue_power_on Error 4.31 test_outofbandmanagement.py
test_oobm_issue_power_on Error 4.31 test_outofbandmanagement.py
test_oobm_issue_power_reset Error 4.32 test_outofbandmanagement.py
test_oobm_issue_power_reset Error 4.32 test_outofbandmanagement.py
test_oobm_issue_power_soft Error 4.33 test_outofbandmanagement.py
test_oobm_issue_power_soft Error 4.33 test_outofbandmanagement.py
test_oobm_issue_power_status Error 4.32 test_outofbandmanagement.py
test_oobm_issue_power_status Error 4.32 test_outofbandmanagement.py
test_oobm_multiple_mgmt_server_ownership Error 1.14 test_outofbandmanagement.py
test_oobm_multiple_mgmt_server_ownership Error 1.14 test_outofbandmanagement.py
test_oobm_zchange_password Error 1.21 test_outofbandmanagement.py
test_oobm_zchange_password Error 1.21 test_outofbandmanagement.py
test_02_edit_primary_storage_tags Error 0.02 test_primary_storage.py
test_01_primary_storage_scope_change Error 0.07 test_primary_storage_scope.py
test_01_vpc_privategw_acl Error 0.02 test_privategw_acl_ovs_gre.py
test_03_vpc_privategw_restart_vpc_cleanup Error 0.02 test_privategw_acl_ovs_gre.py
test_05_vpc_privategw_check_interface Error 0.02 test_privategw_acl_ovs_gre.py
test_01_vpc_privategw_acl Error 55.48 test_privategw_acl.py
test_02_vpc_privategw_static_routes Error 199.67 test_privategw_acl.py
test_03_vpc_privategw_restart_vpc_cleanup Error 201.70 test_privategw_acl.py
test_04_rvpc_privategw_static_routes Error 328.43 test_privategw_acl.py
test_01_purge_expunged_api_vm_start_date Error 58.75 test_purge_expunged_vms.py
test_02_purge_expunged_api_vm_end_date Error 49.16 test_purge_expunged_vms.py
test_03_purge_expunged_api_vm_start_end_date Error 44.08 test_purge_expunged_vms.py
test_04_purge_expunged_api_vm_no_date Error 43.92 test_purge_expunged_vms.py
test_05_purge_expunged_vm_service_offering Error 274.19 test_purge_expunged_vms.py
test_06_purge_expunged_vm_background_task Error 466.57 test_purge_expunged_vms.py
test_01_snapshot_root_disk Error 4.35 test_snapshots.py
test_CreateTemplateWithDuplicateName Error 18.65 test_templates.py
test_01_register_template_direct_download_flag Error 0.14 test_templates.py
test_01_positive_tests_usage Error 13.41 test_usage_events.py
test_01_ISO_usage Error 1.10 test_usage.py
test_01_lb_usage Error 5.24 test_usage.py
test_01_nat_usage Error 7.31 test_usage.py
test_01_public_ip_usage Error 1.08 test_usage.py
test_01_snapshot_usage Error 41.10 test_usage.py
test_01_template_usage Error 13.47 test_usage.py
test_01_vm_usage Error 138.17 test_usage.py
test_01_volume_usage Error 131.12 test_usage.py
test_01_vpn_usage Error 9.60 test_usage.py
test_12_start_vm_multiple_volumes_allocated Error 15.66 test_vm_life_cycle.py
test_01_vmschedule_create Error 0.09 test_vm_schedule.py
test_disable_oobm_ha_state_ineligible Error 0.05 test_hostha_kvm.py
test_hostha_configure_default_driver Error 0.04 test_hostha_kvm.py
test_hostha_enable_ha_when_host_disabled Error 0.04 test_hostha_kvm.py
test_hostha_enable_ha_when_host_disconected Error 0.04 test_hostha_kvm.py
test_hostha_enable_ha_when_host_in_maintenance Error 0.04 test_hostha_kvm.py
test_hostha_kvm_host_degraded Error 0.05 test_hostha_kvm.py
test_hostha_kvm_host_fencing Error 0.04 test_hostha_kvm.py
test_hostha_kvm_host_recovering Error 0.05 test_hostha_kvm.py
test_remove_ha_provider_not_possible Error 0.05 test_hostha_kvm.py

@shwstppr

Copy link
Copy Markdown
Contributor Author

@blueorangutan test alma8 kvm-alma8

@blueorangutan

Copy link
Copy Markdown

@shwstppr a [SL] Trillian-Jenkins test job (alma8 mgmt + kvm-alma8) has been kicked to run smoke tests

@blueorangutan

Copy link
Copy Markdown

[SF] Trillian test result (tid-10956)
Environment: kvm-alma8 (x2), Advanced Networking with Mgmt server a8
Total time taken: 47651 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr9426-t10956-kvm-alma8.zip
Smoke tests completed. 137 look OK, 0 have errors, 0 did not run
Only failed and skipped tests results shown below:

Test Result Time (s) Test File

@yadvr yadvr merged commit cd8442a into apache:main Jul 29, 2024
@yadvr yadvr deleted the harden-test-expunged branch July 29, 2024 10:19
dhslove pushed a commit to ablecloud-team/ablestack-cloud that referenced this pull request Jul 31, 2024
* test: improve purge expunged resources b/g task testcase

Failures were seen for during purging of expunged resources via
bacground task during different test runs. This PR tries to make sure
b/g task execution is not skipped after MS restrat in a multi-MS
environment. It also updates expunged.resources.purge.interval to allow
running task again in 60s.

Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>

* new string formatting

---------

Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

component:integration-test Python Warning... Python code Ahead!

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants