Last Modified: Jul 12, 2023
Affected Product(s):
BIG-IQ AppIQ
Known Affected Versions:
7.1.0, 7.1.0.1, 7.1.0.2, 7.1.0.3, 7.1.6, 7.1.6.1, 7.1.7, 7.1.7.1, 7.1.7.2, 7.1.8, 7.1.8.1, 7.1.8.2, 7.1.8.3, 7.1.8.4, 7.1.8.5, 7.1.9, 7.1.9.7, 7.1.9.8, 7.1.9.9, 8.0.0
Fixed In:
8.0.0.1
Opened: Feb 23, 2021 Severity: 3-Major
User configured analytics statistics retention (real-time, hourly, daily, monthly) might not work as expected in BIG-IQ v7.1.0 after upgrading from 7.0.X, or for BIG-IQ v8.0.0 after upgrading from BIG-IQ 7.1.0. This is setting is configured from BIG-IQ by navigating to System -> BIG-IQ DATA COLLECTION -> BIG-IQ Data Collection Cluster -> Configuration -> Statistics Data Collection -> Configure Retention.
If default retention values were changed, and the config server was restarted, BIG-IQ reloads the previous retention value or might remove the user-configured retention data. For example if the retention for raw-data was 10 hours and then was adjusted to 13 hours, then after the appiqconfig restart, the retention will be 10 hours again and 3 oldest indexes of raw data are deleted.
For the issue to occur, the following conditions must be met: 1. Upgrade BIG-IQ v7.0.x to v7.1.0 or upgrade BIG-IQ v7.0.X to v7.1.0 and then to v8.0.0. NOTE: If there was an incremental upgrade from v7.0.x to v7.1.0.1, 7.1.0.2 or 7.1.0.3 this issue will not occur. 2. After upgrading, change the retention under System -> BIG-IQ DATA COLLECTION -> BIG-IQ Data Collection Cluster -> Configuration -> Statistics Data Collection -> Configure Retention. For example, adjust "real-time" to another value. 3. During the upgrade process, restart appiqconfig from BIG-IQ using the command: "bigstart restart appiqconfig" 4.View data in System -> BIG-IQ DATA COLLECTION -> BIG-IQ Data Collection Cluster -> Configuration -> Statistics Data Collection -> Configure Retention and see that the value is not what was previously configured.
If this issue is recognized according to conditions above then the workaround is as follows: For BIG-IQ v7.1.0: 1. From the BIG-IQ command line, run the following command: curl -XPOST -s localhost:9200/metadata_indices_management/meta-data/_delete_by_query -H 'Content-Type: application/json' -d ' {"query":{"bool":{"must":{"match":{"indexFamily":"statistics"}},"must_not":{"term":{"_id":"statistics"}}}}}' 2. Restart the appiqconfig by running the following command: bigstart restart appiqconfig For BIG-IQ v8.0.0: 1. From the BIG-IQ command line, run the following command: curl -XPOST -ks https://localhost:9200/metadata_indices_management/meta-data/_delete_by_query -H 'Content-Type: application/json' -d ' {"query":{"bool":{"must":{"match":{"indexFamily":"statistics"}},"must_not":{"term":{"_id":"statistics"}}}}}' 2. Restart the appiqconfig by running the following command: bigstart restart appiqconfig
Statistics data retained as expected following an upgrade.