Bug ID 692239: AOM menu power off then on results in 'Host Power Cycle Event' SEL log entries posted every two seconds

Last Modified: Sep 13, 2023

Affected Product(s):
BIG-IP AOM(all modules)

Known Affected Versions:
12.1.3.1, 12.1.3.2, 12.1.3.3, 12.1.3.4, 13.0.0, 13.0.0 HF1, 13.0.0 HF2, 13.0.0 HF3, 13.0.1

Fixed In:
14.0.0, 12.1.3.5

Opened: Nov 02, 2017

Severity: 3-Major

Related Article: K31554905

Symptoms

When using the AOM menu, LCD touchscreen, or the operating system 'halt' command to power off then on the host CPU on i5600, i5800, i7600, i7800, i10600, i10800 platforms, the AOM creates a 'Host Power Cycle Event' SEL log entry every two seconds. The SEL log will continue to grow until external power to the appliance is fully power cycled.

Impact

This results in ongoing 'Host Power Cycle Event' messages to post in the SEL log (tail /var/log/sel) every two seconds. The SEL log will continue to grow and wrap as this message continues to post to the SEL log every two seconds. This results in a very large number of SEL entry fetches by the host CPU to the AOM and can place a substantial load on the AOM interface. In addition, the loss of communication between the BIG-IP host and the AOM can cause a number of related errors to be logged in the LTM log, such as: 012a0022:4: Host to AOM communication error 012a0004:4: Unable to get sensor reading for sens num # 012a0004:4: AomSelLogger: unable to sync SEL log time 012a0004:4: AomSelLogger: unable to process SEL logs 012a0004:4: Error writing SEL records, BmcDev: Unable to get SEL Info 012a0004:4: Error syncing SEL time, BmcDev: IpmiCmdDev: : Unable to Set SEL time ######## (rv=fd) Other error 0xfd (cc=80) Invalid Session Handle or Empty Buffer

Conditions

-- Running on i5600, i5800, i7600, i7800, i10600, i10800 platforms. -- With an older version of CPLD code installed (e.g., CPLD 0x45), power-off the host using the AOM menu, the LCD touchscreen, or the operating system's 'halt' command. + Bring up the AOM menu using ESC shift-9, then select 'p' and '0' from the menu to power off the host CPU complex. + On the LCD touchscreen, navigate to [System] menu and select [Power Off] to power off the host CPU complex. + Run the 'halt' command on the BIG-IP host subsystem. -- Wait a few seconds, and power on the host. + On the AOM menu, select 'p' and '1' to power on the host CPU complex. + On the LCD touchscreen, navigate to [System] menu and select [Power On] to power on the host CPU complex. + There is no equivalent shell method to turn the power back on after running the 'halt' command.

Workaround

The actual fix is to install a newer version of i5600, i5800, i7600, i7800, i10600, i10800 platform CPLD code (e.g., CPLD 0x54 or CPLD 0x55). Another workaround is to fully power cycle the appliance. However, every time the AOM menu is used to power off then on the host, the SEL log entries re-appear.

Fix Information

This issue is fixed in newer versions of the i5600, i5800, i7600, i7800, i10600, i10800 platforms CPLD (e.g., CPLD 0x54 or CPLD 0x55).

Behavior Change

Guides & references

K10134038: F5 Bug Tracker Filter Names and Tips