Last Modified: Jul 12, 2023
Affected Product(s):
BIG-IQ Platform
Known Affected Versions:
7.1.0, 7.1.0.1, 7.1.0.2, 7.1.0.3, 7.1.6, 7.1.6.1, 7.1.7, 7.1.7.1, 7.1.7.2, 7.1.8, 7.1.8.1, 7.1.8.2, 7.1.8.3, 7.1.8.4, 7.1.8.5, 7.1.9, 7.1.9.7, 7.1.9.8, 7.1.9.9
Opened: Apr 17, 2020 Severity: 4-Minor
If an individual BIG-IQ or BIG-IQ/DCD cluster upgrade fails, BIG-IQ is supposed to roll back to the previous version and classify the upgrade task as FAILED. Under certain circumstances, the failed upgrade task is left in an inconsistent state, with "status": "STARTED". This prevents BIG-IQ from starting a new upgrade task, because it appears like the upgrade task that failed is still in progress. There is no way for the user to find and cancel the failed upgrade task using the GUI.
After a failed upgrade, subsequent attempts to upgrade fail because the BIG-IQ thinks a previous upgrade is still in progress.
This problem was initially discovered while trying to upgrade a BIG-IQ HA pair (primary and standby). Removing the standby node failed, which caused the upgrade task to fail without setting the upgrade status correctly. It is possible that there are other failure conditions that could leave the upgrade task status in the STARTED instead of FAILED state.
Before you can update the BIG-IQ, you need to find and change the upgrade task status from STARTED to CANCELLED. You can do this with a sequence of REST commands. The command you use to find the failed status depends on whether you are performing a Regular or Rolling upgrade. 1. Log in to the BIG-IQ command line interface (CLI) as root. 2. Use the appropriate REST command to find the failed status. * To find the failed status setting for a Regular upgrade run the following command: restcurl /cm/shared/esmgmt/upgrade/regular/ * To find the failed status setting for a Rolling upgrade run the following command: restcurl /cm/shared/esmgmt/upgrade/rolling/ 3. Use the following REST command to view the individual upgrade task: restcurl /cm/shared/esmgmt/upgrade/regular/d1f8f1b2-d9b6-4a65-92a8-de4728b6e05e { "id": "d1f8f1b2-d9b6-4a65-92a8-de4728b6e05e", "kind": "cm:shared:esmgmt:upgrade:regular:regularclusterupgradeprocesstaskstate", "name": "regular_upgrade_4_16_2020", "status": "STARTED", "selfLink": "https://localhost/mgmt/cm/shared/esmgmt/upgrade/regular/d1f8f1b2-d9b6-4a65-92a8-de4728b6e05e", ... } 4. Change the upgrade task status to CANCELED: restcurl -X PATCH /cm/shared/esmgmt/upgrade/regular/d1f8f1b2-d9b6-4a65-92a8-de4728b6e05e -d '{ "status": "CANCELED" }' After you cancel the upgrade task that failed, you can upgrade the BIG-IQ.
None