Last Modified: Feb 11, 2025
Affected Product(s):
BIG_IP_NEXT(CM) Install/Upgrade, TMOS
Known Affected Versions:
20.3.0
Opened: Sep 11, 2024 Severity: 1-Blocking
The Central Manager VM might not properly mount all filesystems after a reboot when external storage is configured. The following symptoms have been observed in such cases: - Subsequent upgrade to the BIG-IP Next 20.3.0 release failed due to an error writing to the /tmp directory as the admin user. - Multiple pods remain stuck with the CreateContainerConfigError due to a missing volume. - One or both of the /opt/cm-backup and /opt/cm-qkview directories are no longer using external storage.
If the Central Manager VM failed to mount all filesystems properly after a reboot, future operations on the Central Manager would fail.
When External storage is configured and the BIG-IP Next Central Manager is rebooted.
Before rebooting the system, including prior to upgrading, modify the /etc/fstab and /etc/fstab.external-storage files to add the _netdev mount option immediately after the nosuid mount option for the mounts of the /opt/cm-backup and /opt/cm-qkview directories, as shown below. This must be done on every node in a multi-node cluster. If the system has already been rebooted and is experiencing any of the documented symptoms, this workaround can be applied, followed by rebooting the VM to recover. $ cat /etc/fstab ... 10.1.1.1:/export/data /mnt/external-storage nfs auto,nofail,noatime,noexec,nosuid,nodev,nolock,tcp,actimeo=1800,retry=2,_netdev 0 0/mnt/external-storage/a05d57ec-2703-47b8-a742-ca1c2148ad2b/cm-backup /opt/cm-backup none bind,rw,auto,nouser,nodev,noatime,exec,nosuid,_netdev 0 0 /mnt/external-storage/a05d57ec-2703-47b8-a742-ca1c2148ad2b/cm-qkview /opt/cm-qkview none bind,rw,auto,nouser,nodev,noatime,exec,nosuid,_netdev 0 0 $ cat /etc/fstab.external-storage 10.1.1.1:/export/data /mnt/external-storage nfs auto,nofail,noatime,noexec,nosuid,nodev,nolock,tcp,actimeo=1800,retry=2,_netdev 0 0 /mnt/external-storage/7cdb4e2f-4c2f-42bf-b759-f106da06100d/cm-backup /opt/cm-backup none bind,rw,auto,nouser,nodev,noatime,exec,nosuid,_netdev 0 0 /mnt/external-storage/7cdb4e2f-4c2f-42bf-b759-f106da06100d/cm-qkview /opt/cm-qkview none bind,rw,auto,nouser,nodev,noatime,exec,nosuid,_netdev 0 0
None