Bug ID 1040777: APM broken due to missing scripts after upgrade

Last Modified: Apr 11, 2023

Affected Product(s):
BIG-IQ Access(all modules)

Known Affected Versions:
8.0.0, 8.0.0.1, 8.1.0, 8.1.0.1, 8.1.0.2

Opened: Aug 15, 2021

Severity: 2-Critical

Related Article: K63534030

Symptoms

Run below commands on BIG-IQ CM on command line #curl -s -u admin:admin --insecure -X GET https://localhost:9200/_scripts/updateNetworkAccessTunnels | jq .found #curl -s -u admin:admin --insecure -X GET https://localhost:9200/_scripts/updateSessionSummary | jq .found #curl -s -u admin:admin --insecure -X GET https://localhost:9200/_scripts/updateTokenFromPhase1Task | jq .found #curl -s -u admin:admin --insecure -X GET https://localhost:9200/_scripts/updateTokenFromPhase2Task | jq .found #curl -s -u admin:admin --insecure -X GET https://localhost:9200/_scripts/updateTokenFromSessionSummary | jq .found If it prints found = false then it indicates that APM (.painless) scripts are missing in Elasticsearch and you are impacted by current bug

Impact

Access/APM statistics GUI does not work

Conditions

This occurs after an upgrade to 8.0.x/8.1.x from a prior version

Workaround

The recovery process involves fixing APM (.painless) scripts in Elasticsearch cluster as follows 1. Download the repair scripts/tools following steps in https://support.f5.com/csp/article/K63534030 (Step1 under 'Recommended Actions') 2. Backup, Overwrite .painless scripts by following Step 2.A/2.B under 'Recommended Actions' 3. Update .painless files in Elasticsearch cluster (Step 2.C under 'Recommended Actions') using below command # sh PushAPMScriptsToES.sh 4. You do not need to do Step 2.D 5. Instead of Step 3, run below command and confirm it prints "found": true # curl -sk https://localhost:9200/_scripts/updateSessionSummary? { "_id": "updateSessionSummary", "found": true, <-------- ... } 5. Finish by running Step 4

Fix Information

None

Behavior Change

Guides & references

K10134038: F5 Bug Tracker Filter Names and Tips