Bug ID 1280365: WebUI and shell admin access unavailable after upgrade to when one of the previously installed images is no longer present

Last Modified: Feb 08, 2024

Affected Product(s):
F5OS F5OS, Install/Upgrade, Velos(all modules)

Known Affected Versions:
F5OS-A 1.3.1, F5OS-A 1.3.2, F5OS-C 1.5.0, F5OS-C 1.5.1

Fixed In:
F5OS-C 1.6.0, F5OS-A 1.7.0, F5OS-A 1.5.0

Opened: Mar 23, 2023

Severity: 2-Critical

Related Article: K000133253

Symptoms

1. WebUI or CLI inaccessible via admin account (that is, ConfD is not up): [root@appliance-1(XXXXXXXXX) log]# su admin Failed to connect to server 2. sw-mgmt.debug file will have a line similar to this one (with image version changing depending on which image is missing): DEBUG: Source file /var/export/chassis/import/.mounts/iso/R2R4/1.1.1-9159/m3/*-services/F5OS*.img does not exist, removing from all_sw. 3. Containers stuck in ImagePullBackOff. For example, system_network container cannot be pulled, and the following error is observed in messages log: appliance-1 dockerd-current: time="2023-03-24T15:09:26.631359235Z" level=error msg="Not continuing with pull after error: Error: image system_network:1.4.5-f5os-a-1-4-0-candidate.2023-02-14-15-09-15.S9b340f7e not found"

Impact

Device webUI is inaccessible. Cannot access ConfD. Root access is working.

Conditions

Both of the below conditions: 1. Certain ISO image has been ungracefully removed from the /var/import/staging folder. Examples of ungraceful removals: -- Deleted via bash (after running chattr -i <image name>) -- Image name had parentheses in it and as per ID1273021 it is wiped out upon reboot. 2. /var/import/import.json file includes reference to removed image that is listed BEFORE the reference to currently used image.

Workaround

Two workarounds: 1. Re-import the deleted image and reboot the box. 2. Remove the whole section that references the deleted image from import.json file and reboot the box.

Fix Information

N/A

Behavior Change

Guides & references

K10134038: F5 Bug Tracker Filter Names and Tips